-- Logs begin at Mon 2022-08-08 07:52:42 UTC, end at Mon 2022-08-08 09:29:55 UTC. -- Aug 08 08:32:53.605445 dv-cinder-836973-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 08:32:53.614946 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 08:32:53.617051 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 08:32:53 2022] *** Aug 08 08:32:53.617051 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 08:32:53.617051 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 08:32:53.617051 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: nodename: dv-cinder-836973-17-iscsi Aug 08 08:32:53.617051 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: machine: x86_64 Aug 08 08:32:53.617051 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: clock source: unix Aug 08 08:32:53.617051 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: pcre jit disabled Aug 08 08:32:53.617051 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: detected number of CPU cores: 4 Aug 08 08:32:53.617051 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: current working directory: / Aug 08 08:32:53.617051 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: detected binary path: /usr/bin/uwsgi-core Aug 08 08:32:53.617866 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: your processes number limit is 47680 Aug 08 08:32:53.617866 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: your memory page size is 4096 bytes Aug 08 08:32:53.617866 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: detected max file descriptor number: 2048 Aug 08 08:32:53.617866 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: lock engine: pthread robust mutexes Aug 08 08:32:53.617866 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: thunder lock: enabled Aug 08 08:32:53.617866 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 08:32:53.617866 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 08:32:53.656490 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: Python main interpreter initialized at 0x563b6bf269c0 Aug 08 08:32:53.656490 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: python threads support enabled Aug 08 08:32:53.656490 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: your server socket listen backlog is limited to 100 connections Aug 08 08:32:53.656490 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: your mercy for graceful operations on workers is 90 seconds Aug 08 08:32:53.656814 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 08:32:53.656916 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: *** Operational MODE: preforking *** Aug 08 08:32:53.657183 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: *** uWSGI is running in multiple interpreter mode *** Aug 08 08:32:53.657183 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: spawned uWSGI master process (pid: 110143) Aug 08 08:32:53.657369 dv-cinder-836973-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 08:32:53.657910 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: spawned uWSGI worker 1 (pid: 110144, cores: 1) Aug 08 08:32:53.660229 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: spawned uWSGI worker 2 (pid: 110145, cores: 1) Aug 08 08:32:53.660229 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 08:32:54.320784 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 08:32:54.337532 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 08:32:55.471917 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 08:32:55.471917 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: from cryptography.utils import int_from_bytes Aug 08 08:32:55.472452 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 08:32:55.472452 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: from cryptography.utils import int_from_bytes Aug 08 08:32:55.504318 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 08:32:55.504318 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: from cryptography.utils import int_from_bytes Aug 08 08:32:55.504825 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 08:32:55.504825 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: from cryptography.utils import int_from_bytes Aug 08 08:32:57.971972 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 08:32:57.972524 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 08:32:57.972740 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 08:32:57.972853 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 08:32:57.973232 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 08:32:57.973311 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 08:32:57.973391 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 08:32:57.973562 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 08:32:57.973756 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.974008 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 08:32:57.974168 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.974262 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 08:32:57.974498 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.974650 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.974813 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.974981 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.975146 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.975289 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.975459 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.975608 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.975778 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.975939 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.976097 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.976249 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.976425 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.976570 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.976686 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.976892 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.976985 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.977260 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.977363 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-17-iscsi {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.977525 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.977654 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.977843 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.977962 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.978168 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-17-iscsi {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.978280 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.978492 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.978581 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.978803 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.978896 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.979116 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.979211 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.979437 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.979536 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.979742 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.979971 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.980128 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.981101 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.981275 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.981275 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.981505 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.981639 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.981774 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.981897 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.982024 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.982145 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.982273 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.982405 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.982543 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.982674 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.982811 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.982934 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.983053 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.983181 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.983303 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.983423 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.983543 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.983671 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-17-iscsi {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.983792 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.983913 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.984033 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.984160 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.984342 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-17-iscsi {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.984477 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.984661 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.984839 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.984971 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.985162 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.985311 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.985488 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.985701 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.985839 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.986019 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.986156 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.986333 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.986457 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.986659 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.986792 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.986996 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.987121 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.987309 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.987438 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.987639 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.987773 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.987953 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.988077 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.988262 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.988389 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.988571 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.988721 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.988873 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.989003 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.989205 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.989334 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.990034 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.990165 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.990353 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.990508 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.990669 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.990805 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.990971 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.991096 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.991219 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.991342 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.991524 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.991663 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.991849 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.991975 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.992105 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.992236 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.992407 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.992550 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.992731 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.992859 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.993042 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.993211 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.993367 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.993557 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.993684 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.993885 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.994013 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.994201 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.994334 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.994514 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.994640 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.994828 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.994955 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.995140 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.995276 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.995453 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.995579 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.995764 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.995890 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.996073 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.996200 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.996382 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.996516 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.996701 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.996826 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.997020 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.997174 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.997360 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.997485 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.997672 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.997811 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.997993 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.998118 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.998317 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.998442 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.998631 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.998765 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.998938 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.999063 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.999258 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.999399 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.999566 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.999705 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.999873 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:57.999999 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.000181 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.000316 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.000501 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.000640 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.000807 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.000932 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.001115 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.001259 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.001468 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.001599 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.001730 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.001861 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.001984 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.002106 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.002273 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.002404 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.002581 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.002707 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.002887 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.003020 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.003194 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.003327 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.003493 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.003619 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.003798 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.003925 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.004106 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.004239 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.004409 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.004520 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.004710 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.004840 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.005012 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.005793 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.005934 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.006069 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.006201 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.006336 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.006462 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.006600 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.006777 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.006911 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.007084 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.007249 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.007396 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.007523 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.007702 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.007826 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.008008 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.008142 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.008312 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.008437 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.008623 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.008757 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.008936 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.009074 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.009267 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.009407 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.009574 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.009700 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.009897 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.010085 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.010325 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.010646 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.010962 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.011290 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.011603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.011911 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.012240 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.012551 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.012861 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.013213 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.013511 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.013822 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.014351 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.014670 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.015060 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.015372 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.015746 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.015884 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.016179 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.016565 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.016878 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.017206 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.017516 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.018054 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.018390 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.018648 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.018785 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.019007 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.019141 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.019347 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.019473 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.019682 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.019809 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.020027 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.020161 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.020349 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.020475 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.020672 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.020798 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.021029 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.021223 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.021394 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.021537 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.021732 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.021857 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.022057 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.022196 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.022373 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.022503 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.022696 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.022823 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.023033 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.023160 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.023344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.023476 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.023658 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.023784 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.023964 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.024089 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.024287 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.024410 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.024611 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.024745 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.024925 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.025063 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.025272 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.025410 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.025589 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.025733 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.025912 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.026037 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:32:58.026229 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.026361 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.026552 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.026687 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.026888 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.027015 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.027213 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.027339 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.027529 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.027667 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.027865 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.028065 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.028198 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.028332 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.028493 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.028628 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.028814 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.028949 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.029178 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.029309 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.029488 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.029628 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.029804 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.029928 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.030118 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.030243 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.030444 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.030577 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.030766 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.030890 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.031087 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.031211 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.031409 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.031546 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.031726 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.031861 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.032043 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.032170 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.032356 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.032495 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.032670 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.032794 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.032991 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.033117 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.033338 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.033472 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.033652 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.033779 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.033972 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.034095 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.034291 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.034418 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.034614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.034750 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.034932 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.035070 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.035250 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.035385 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.035561 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.035687 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.035869 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.036002 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.036180 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.036306 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.036556 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.036681 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.036918 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.037270 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.037399 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.037598 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.037734 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.037932 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.038058 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.038244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.038371 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.038563 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.038688 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.038880 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.039013 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.039196 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.039412 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.039543 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.039665 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.039797 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.039930 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.040109 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.040244 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.040427 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.040555 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.040741 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.040876 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.041050 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.041216 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.041393 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.041526 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.041713 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.041848 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.042022 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.042146 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.042328 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.042454 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.042636 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.042763 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.042945 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.043079 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.043258 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.043384 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.043566 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.043701 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.043879 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.044011 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.044195 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.044329 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.044499 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.044625 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.044827 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.044952 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.045133 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.045281 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.045468 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.045596 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.045782 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.045909 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.046097 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.046232 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.046410 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.047230 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.048987 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.049522 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.049666 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.049666 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.049926 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.050053 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.050176 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.050306 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.050437 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.050569 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.050702 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.050833 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.050833 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.051074 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.051197 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.051330 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.051454 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.051577 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.051700 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.051859 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.052484 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.052639 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.052764 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.052891 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.053022 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.053165 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.053302 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.053428 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.053550 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.053550 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.053781 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.053904 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.054039 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.054161 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.054291 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.054421 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.054552 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.054675 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.054810 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.054947 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.055133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.055259 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.055259 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.055500 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.055624 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.055746 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.055868 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.055868 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.056099 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.056229 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.056354 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.056476 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.056606 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.056736 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.056867 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.057000 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.057124 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.057313 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.057437 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.057576 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.057699 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.057829 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.057951 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.058073 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.058185 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.058304 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.058503 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.058635 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.058764 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.058886 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.058886 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.059114 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.059244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.059364 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.059526 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.059652 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.059858 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.059983 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.060177 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.060309 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.060503 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.060626 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.060810 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.060934 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.061132 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.061277 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.061476 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.061600 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.061790 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.061914 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.062106 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.062232 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.062461 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.062599 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.062734 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.062870 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.063057 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.063182 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.063371 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.063497 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.063688 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.063822 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.063999 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.064125 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.064314 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.064445 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.064624 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.064759 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.064938 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.065062 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.065284 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.065412 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.065601 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.065746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.065929 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.066056 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.066242 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.066375 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.066566 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.066694 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.066874 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.067000 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.067193 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.067320 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.067523 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.067656 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.068443 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.068569 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.068824 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.068960 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.069174 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.069305 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.069486 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.069612 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.069813 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.069940 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.070129 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.070264 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.070448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.070579 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.070761 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.070894 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.071071 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.071198 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.071385 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.071510 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.071700 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.071832 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.072004 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.072130 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.072315 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.072439 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.072623 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.072815 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.072942 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.073066 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.073261 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.073388 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.073571 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.073710 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.073882 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.074010 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.074193 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.074319 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.074504 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.074632 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.074818 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.074945 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.075127 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.075254 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.075434 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.075560 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.075746 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.075871 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.076054 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.076181 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.076363 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.076495 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.076674 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.076801 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.076979 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.077103 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.077310 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.077439 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.077620 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.077744 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.077926 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.078052 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.078230 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.078358 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.078543 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.078677 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.078865 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.078999 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.079180 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.079306 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.079492 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.079617 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.079811 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.079946 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.080116 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.080240 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.080421 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.080547 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.080743 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.080877 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.081051 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.081191 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.081386 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.081512 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.081692 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.081826 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.081998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.082125 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.082310 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.082442 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.082625 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.082751 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.082936 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.083060 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.083275 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.083402 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.083614 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.083774 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.083931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.084358 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.084515 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.084668 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.084830 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.084985 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.085190 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.085335 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.085492 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.085810 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.085945 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.086126 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.086252 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.086442 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.086569 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.086758 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.086886 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.087080 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.087206 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.087393 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.087520 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.087720 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.087839 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.088033 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.088169 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.088348 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.088475 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.088675 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.088813 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.088945 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.089069 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.089278 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.089406 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.089600 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.089734 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.089948 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.090167 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.090301 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.090503 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.090630 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.090823 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.090958 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.091143 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.091269 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.091450 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.091575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.091760 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.091894 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.092070 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.092197 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.092381 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.092516 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.092699 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.092826 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.093008 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.093189 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.093351 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.093478 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.093659 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.093793 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.093969 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.094097 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.094285 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.094410 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.094592 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.094718 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.094897 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.095030 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.095201 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.095334 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.095515 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.095649 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.095822 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.095956 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.096127 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.096255 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.096432 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.096559 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.096736 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.096864 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.097056 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.097216 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.097387 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.097514 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.097702 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.097828 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.098005 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.098140 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.098328 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.098455 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.098633 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.098765 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.098973 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.099118 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.099298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.099517 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.099650 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.099780 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.099904 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.100035 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.100186 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.100314 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.100500 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.100633 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.100811 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.100939 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.101120 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.101337 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.101472 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.101603 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.101735 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.101860 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.102053 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.102179 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.102364 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.102491 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.102669 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.102804 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.102974 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.103110 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.103288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.103414 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.103596 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.103730 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.103898 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.104030 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.104208 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.104343 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.104512 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.104645 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.104819 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.104951 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.105123 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.105295 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.105450 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.105584 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.105755 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.105888 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.106056 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.106190 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.106366 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.106491 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.106672 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.106798 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.106981 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.107121 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.107279 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.107404 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.107578 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.107705 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.107881 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.108014 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.108182 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.108307 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.108486 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.108617 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.108788 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.108914 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.109098 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.109260 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.109426 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.109559 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.109731 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.109859 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.110036 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.110163 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.110347 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.110472 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.110653 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.110780 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.110956 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.111082 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.111261 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.111394 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.111573 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.111707 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.111873 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.111998 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.112175 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.112381 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.112508 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.112632 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.112762 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.112887 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.113062 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.113233 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.113396 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.113521 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.113717 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.113849 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.114026 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.114161 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.114327 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.114459 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.115204 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.115468 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.115602 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.115727 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.115851 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.115974 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.116150 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.116277 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.116457 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.116583 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.116759 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.116885 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.117072 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.117219 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.117405 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.117539 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.117711 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.117839 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.118017 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.118153 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.118322 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.118455 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.118639 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.118765 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.118942 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.119076 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.119249 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.119383 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.119552 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.119679 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.119856 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.119989 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.120181 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.120308 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.120498 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.120625 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.120813 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.120949 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.121129 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.121313 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.121472 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.121603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.121785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.121923 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.122090 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.122222 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.122401 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.122533 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.122707 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.122834 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.123016 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.123141 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.123326 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.123458 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.123640 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.123766 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.123945 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.124071 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.124248 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.124375 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.124560 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.124685 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.124870 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.124994 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.125200 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.125331 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.125514 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.125640 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.125827 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.125953 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.126140 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.126266 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.126442 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.126569 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.126759 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.126886 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.127069 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.127203 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.127375 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.127508 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.127684 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.127809 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.127990 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.128126 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.128300 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.128425 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.128605 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.128730 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.128915 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.129048 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.129252 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.129392 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.129566 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.129694 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.129874 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.130014 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.130758 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.130891 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.131098 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.131314 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.131448 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.131573 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.131686 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.131809 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.131992 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.132126 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.132297 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.132447 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.132608 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.132766 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.132901 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.133082 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.133302 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.133429 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.133559 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.133720 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.133941 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.134077 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.134255 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.134381 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.134568 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.134694 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.134874 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.135014 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.135185 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.135306 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.135496 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.135623 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.135813 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.135948 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.136117 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.136249 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.136423 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.136557 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.136844 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.136979 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.137183 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.137322 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.137487 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.137620 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.137800 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.137934 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.138107 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.138233 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.138413 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.138545 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.138725 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.138859 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.139050 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.139186 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.139365 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.139490 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.139646 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.139781 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.139949 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.140076 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.140271 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.140405 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.140576 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.140703 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.140897 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.141023 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.141293 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.141432 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.141615 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.141743 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.141924 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.142080 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.142250 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.142380 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.142576 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.142711 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.142892 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.143020 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.143222 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.143350 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.143564 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.143698 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.143890 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.144028 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.144196 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.144324 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.144511 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.144646 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.144823 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.144950 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.145193 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.145341 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.145489 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.145628 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.145829 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.146099 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.146229 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.146354 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.146524 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.146665 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.146854 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.146987 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.147164 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.147289 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.147482 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.147609 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.147796 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.147929 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.148111 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.148238 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.148423 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.148545 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.148733 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.148860 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.149061 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.149204 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.149396 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.149532 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.149727 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.149854 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.150047 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.150174 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.150369 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.150495 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.150678 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.150806 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.150987 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.151122 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.151310 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.151435 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.151615 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.151748 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.151917 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.152050 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.152215 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.152342 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.152524 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.152650 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.152828 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.152996 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.153122 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.153277 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.153470 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.153597 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.153778 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.153912 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.154101 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.154229 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.154417 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.154544 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.154740 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.154870 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.155064 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.155192 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.155370 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.155490 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.155695 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.155822 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.156010 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.156136 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.156315 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.156447 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.156619 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.156746 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.156925 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.157066 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.157252 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.157392 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.157564 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.157692 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.157871 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.158000 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.158183 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.158319 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.158488 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.158609 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.158794 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.158922 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.159100 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.159228 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.159425 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.159553 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.159731 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.159864 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.160056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.160262 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.160390 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.160520 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.160644 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.160775 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.160956 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.161084 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.161285 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.161442 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.161658 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.161786 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.161970 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.162144 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.162280 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.162405 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.162594 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.162719 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.162872 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.163001 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.163179 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.163307 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.163484 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.163611 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.163806 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.163924 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.164107 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.164228 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.164431 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.164569 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.164740 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.164867 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.165045 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.165197 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.165377 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.165523 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.165688 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.165817 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.166034 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.166167 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.166340 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.166480 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.166671 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.166881 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.167016 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.167213 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.167348 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.167546 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.167673 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.167835 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.167962 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.168151 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.168319 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.168471 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.168598 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.168788 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.168915 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.169103 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.169270 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.169442 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.169570 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.169758 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.169885 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.170067 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.170206 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.170380 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.170507 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.170699 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.170828 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.171028 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.171220 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.171349 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.171550 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.171685 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.171867 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.172007 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.172180 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.172308 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.172495 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.172622 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.172812 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.172941 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.173126 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.173304 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.173462 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.173590 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.173774 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.173902 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.174087 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.174221 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.174399 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.174526 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.174729 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.174865 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.175051 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.175186 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.175364 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.175489 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.175680 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.175807 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.175996 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.176123 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.176310 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.176449 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.176624 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.176757 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.176936 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.177612 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.177822 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.178036 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.178167 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.178361 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.178491 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.178672 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.178809 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.178991 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.179118 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.179309 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.179444 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.179624 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.179884 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.180013 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.180201 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.180335 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.180535 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.180669 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.180848 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.180974 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.181186 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.181318 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.181498 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.181643 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.181812 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.181941 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.182127 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.182254 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.182432 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.182570 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.182746 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.182873 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.183060 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.183188 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.183373 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.183508 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.183680 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.183807 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.183995 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.184120 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.184307 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.184518 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.184645 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.184836 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.184962 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.185190 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.185331 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.185530 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.185779 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.185919 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.186129 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.186262 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.186446 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.186574 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.186775 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.186909 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.187080 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.187204 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.187385 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.187513 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.187698 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.187825 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.188008 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.188136 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.188314 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.188444 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.188619 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.188744 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.188936 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.189071 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.189264 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.189391 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.189571 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.189696 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.189880 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.190023 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.190194 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.190411 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.190546 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.190758 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.190893 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.191075 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.191210 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.191387 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.191513 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.191714 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.191840 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.192020 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.192146 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.192328 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.192454 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.192685 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.192823 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.193015 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.193160 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.193350 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.193478 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.193658 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.193799 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.193967 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.194102 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.194275 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.194402 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.194590 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.194726 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.194896 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.195031 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.195206 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.195339 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.195510 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.195644 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.195818 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.195943 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.196124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.196258 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.196433 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.196559 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.196740 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.196875 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.197042 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.197215 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.197415 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.197543 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.197667 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.197805 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.197964 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.198099 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.198269 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.198398 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.198574 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.198702 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.198877 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.199005 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.199189 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.199317 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.199493 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.199621 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.199803 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.199944 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.200107 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.200403 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.200531 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.200709 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.200834 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.201019 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.201208 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.201337 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.201461 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.201662 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.201790 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.201970 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.202100 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.202322 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.202443 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.202633 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.202766 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.202945 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.203072 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.203266 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.203392 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.203576 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.203710 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.203888 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.204020 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.204203 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.204330 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.204517 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.204651 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.204826 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.205064 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.205237 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.205433 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.205560 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.205760 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.205896 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.206070 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.206196 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.206383 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.206518 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.206695 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.206822 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.207005 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.207131 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.207333 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.207473 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.207628 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.207754 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.207942 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.208068 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.208296 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.208437 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.208618 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.208743 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.208940 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.209336 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.209547 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.209688 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.209863 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.209991 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.210177 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.210313 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.210491 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.210627 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.210802 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.210927 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.211113 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.211240 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.211424 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.211553 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.211737 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.211864 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.212043 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.212169 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.212352 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.212479 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.212670 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.212808 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.213011 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.213187 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.213358 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.213486 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.213681 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.213820 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.214001 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.214137 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.214322 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.214449 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.214633 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.214760 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.214947 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.215086 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.215258 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.215383 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.215563 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.215698 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.215881 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.216010 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.216214 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.216343 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.216531 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.216658 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.216838 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.216966 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.217157 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.217285 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.217472 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.217600 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.217785 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.217913 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.218104 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.218232 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.218416 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.218556 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.218722 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.218851 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.219028 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.219155 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.219341 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.219469 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.219645 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.219773 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.219958 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.220105 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.220262 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.220408 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.220570 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.220697 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.220882 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.221017 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.221208 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.221350 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.221521 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.221656 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.221827 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.221962 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.222174 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.222316 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.222453 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.222577 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.222726 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.222854 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.223038 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.223166 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.223343 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.223471 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.223648 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.223776 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.224524 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.224656 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.224861 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.224987 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.225187 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.225319 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.225527 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.225655 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.225865 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.225992 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.226175 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.226308 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.226481 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.226609 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.226787 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.226921 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.227092 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.227293 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.227421 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.227545 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.227689 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.227816 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.227994 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.228130 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.228305 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.228432 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.228610 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.228737 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.228915 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.229053 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.229244 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.229385 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.229550 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.229677 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.229854 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.229990 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.230174 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.230308 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.230488 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.230623 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.230801 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.230928 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.231120 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.231245 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.231431 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.231560 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.231749 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.231875 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.232101 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.232233 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.232421 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.232556 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.232743 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.232869 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.233060 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.233206 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.233397 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.233537 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.233728 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.233862 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.234040 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.234166 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.234351 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.234486 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.234661 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.234787 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.234972 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.235097 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.235281 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.235415 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.235591 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.235731 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.235900 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.236027 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.236215 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.236343 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.236531 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.236658 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.236845 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.236978 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.237183 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.237313 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.237508 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.237635 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.237820 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.237960 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.238131 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.238265 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.238465 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.238590 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.238775 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.238909 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.239089 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.239238 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.239396 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.239589 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.239835 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.239971 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.240174 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.240308 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.240494 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.240621 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.240808 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.240945 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.241097 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 08:32:58.241243 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.241494 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.241771 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.242097 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.242424 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.242735 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.243063 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.243390 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.243736 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.244054 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.244397 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.244725 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.245047 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.245387 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.245694 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:32:58.245938 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 08:32:58.395458 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO dbcounter [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Registered counter for database nova_api Aug 08 08:32:58.400401 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO dbcounter [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Registered counter for database nova_api Aug 08 08:32:58.417112 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_db.sqlalchemy.engines [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:32:58.420358 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG oslo_db.sqlalchemy.engines [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:32:58.423754 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writer thread running {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:32:58.427102 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG dbcounter [-] [110144] Writer thread running {{(pid=110144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:32:58.480267 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.context [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),567bf3f4-f382-4f0b-ae3e-26600132734b(cell1) {{(pid=110145) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 08:32:58.482827 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.context [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),567bf3f4-f382-4f0b-ae3e-26600132734b(cell1) {{(pid=110144) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 08:32:58.484048 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:32:58.484525 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:32:58.486151 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:32:58.486663 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG oslo_concurrency.lockutils [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:32:58.486889 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:32:58.487139 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG oslo_concurrency.lockutils [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:32:58.487344 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:32:58.488716 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG oslo_concurrency.lockutils [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:32:58.489365 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:32:58.489520 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG oslo_concurrency.lockutils [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:32:58.489977 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG oslo_concurrency.lockutils [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:32:58.491773 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO dbcounter [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Registered counter for database nova_cell0 Aug 08 08:32:58.491963 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG oslo_concurrency.lockutils [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:32:58.493959 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO dbcounter [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Registered counter for database nova_cell0 Aug 08 08:32:58.497198 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO dbcounter [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Registered counter for database nova_cell1 Aug 08 08:32:58.499289 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO dbcounter [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Registered counter for database nova_cell1 Aug 08 08:32:58.504637 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_db.sqlalchemy.engines [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:32:58.508993 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG oslo_db.sqlalchemy.engines [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:32:58.509183 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_db.sqlalchemy.engines [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:32:58.511192 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG oslo_db.sqlalchemy.engines [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:32:58.511606 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writer thread running {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:32:58.515496 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG dbcounter [-] [110144] Writer thread running {{(pid=110144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:32:58.650042 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writer thread running {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:32:58.654587 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG dbcounter [-] [110144] Writer thread running {{(pid=110144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:32:58.658761 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO dbcounter [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Registered counter for database nova_cell0 Aug 08 08:32:58.663570 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO dbcounter [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Registered counter for database nova_cell0 Aug 08 08:32:58.667710 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_db.sqlalchemy.engines [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:32:58.670684 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG oslo_db.sqlalchemy.engines [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:32:58.672177 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writer thread running {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:32:58.675288 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG dbcounter [-] [110144] Writer thread running {{(pid=110144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:32:59.080634 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: WARNING keystonemiddleware.auth_token [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 08:32:59.088840 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: WARNING keystonemiddleware.auth_token [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 08:32:59.110026 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: WARNING keystonemiddleware.auth_token [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 08:32:59.117327 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: WARNING keystonemiddleware.auth_token [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 08:32:59.441103 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: WARNING keystonemiddleware.auth_token [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 08:32:59.447195 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: WARNING keystonemiddleware.auth_token [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 08:32:59.452439 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b6bf269c0 pid: 110145 (default app) Aug 08 08:32:59.454544 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:32:59.455737 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 Aug 08 08:32:59.456138 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Mon Aug 8 08:32:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:32:59.460130 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: WARNING keystonemiddleware.auth_token [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 08:32:59.466109 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: WARNING keystonemiddleware.auth_token [None req-f7c7814a-ec6e-4fe8-8ba2-4c3d8d3a3b98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 08:32:59.471342 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b6bf269c0 pid: 110144 (default app) Aug 08 08:34:17.676700 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:17.678565 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002357 Aug 08 08:34:17.679373 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:34:17.692362 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG dbcounter [-] [110144] Writing DB stats nova_api:SELECT=3 {{(pid=110144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:34:17.693270 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG dbcounter [-] [110144] Writing DB stats nova_cell0:SELECT=3 {{(pid=110144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:34:17.694024 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG dbcounter [-] [110144] Writing DB stats nova_cell1:SELECT=3 {{(pid=110144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:34:17.695052 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG dbcounter [-] [110144] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:34:18.561742 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-a49b5a1a-e65b-4fb8-8735-4c487f6a4709 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:18.596328 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-a49b5a1a-e65b-4fb8-8735-4c487f6a4709 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.909821 Aug 08 08:34:18.597174 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Aug 8 08:34:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:34:20.822364 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:20.823377 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-44eb1c9d-7126-4a98-8647-d9e4bf4ecf9f None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 08 08:34:20.823938 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:34:21.310585 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-50fa0421-dbfb-4a06-b304-f43f396aa238 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0}} {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:21.331040 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 08:34:21.331040 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: warnings.warn(msg) Aug 08 08:34:21.424633 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-50fa0421-dbfb-4a06-b304-f43f396aa238 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.593839 Aug 08 08:34:21.425229 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 08:34:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:34:21.439621 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writing DB stats nova_api:SELECT=3 {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:34:21.440950 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writing DB stats nova_cell0:SELECT=3 {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:34:21.441714 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writing DB stats nova_cell1:SELECT=3 {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:34:21.442443 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:34:21.650092 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-7fa50b30-a646-415b-bb7b-958b0b5bd8b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:21.654535 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 08:34:21.654535 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: warnings.warn(msg) Aug 08 08:34:21.794916 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-7fa50b30-a646-415b-bb7b-958b0b5bd8b7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.361158 Aug 08 08:34:21.797286 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Aug 8 08:34:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:34:24.004800 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-50fa0421-dbfb-4a06-b304-f43f396aa238 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:24.005849 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-50fa0421-dbfb-4a06-b304-f43f396aa238 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 08 08:34:24.006246 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:34:24.665499 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-a08b638b-c272-490e-8fca-7940c0d54b0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:24.685479 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 08:34:24.685479 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: warnings.warn(msg) Aug 08 08:34:24.793744 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-a08b638b-c272-490e-8fca-7940c0d54b0a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.781244 Aug 08 08:34:24.801201 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 08:34:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 08:34:24.807516 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-d8782eed-1ea5-414e-ac22-3a196efc6fbf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:24.810334 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 08:34:24.810334 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: warnings.warn(msg) Aug 08 08:34:24.928216 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-d8782eed-1ea5-414e-ac22-3a196efc6fbf admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124416 Aug 08 08:34:24.937211 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Aug 8 08:34:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:34:27.122596 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-a08b638b-c272-490e-8fca-7940c0d54b0a admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:27.123635 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-a08b638b-c272-490e-8fca-7940c0d54b0a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 08 08:34:27.124032 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:34:27.521374 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-d3eb0bae-213b-4299-a0f9-e63365b3bc47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "ram": 1024, "vcpus": 1, "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:27.589242 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-d3eb0bae-213b-4299-a0f9-e63365b3bc47 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459061 Aug 08 08:34:27.589798 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 08:34:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:34:27.601956 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-f060b605-706e-45bf-a26a-8b39728842ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:27.698029 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-f060b605-706e-45bf-a26a-8b39728842ef admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099680 Aug 08 08:34:27.698536 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Aug 8 08:34:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:34:29.921900 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-d3eb0bae-213b-4299-a0f9-e63365b3bc47 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:29.923497 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-d3eb0bae-213b-4299-a0f9-e63365b3bc47 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 08 08:34:29.923902 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:34:30.382504 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-a66dcb02-3188-491a-9eba-fc281c4c6c91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "id": "d3", "swap": 0, "vcpus": 2}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:30.451569 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-a66dcb02-3188-491a-9eba-fc281c4c6c91 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.517566 Aug 08 08:34:30.451569 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 08:34:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:34:30.462811 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-ec0287af-51ac-4048-bf32-1a21c33c30ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:30.570873 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-ec0287af-51ac-4048-bf32-1a21c33c30ba admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111906 Aug 08 08:34:30.571666 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Aug 8 08:34:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:34:32.774938 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-a66dcb02-3188-491a-9eba-fc281c4c6c91 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:32.775938 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-a66dcb02-3188-491a-9eba-fc281c4c6c91 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 08 08:34:32.776576 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:34:33.202656 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-be450e94-d23b-4483-af97-c299d7f17950 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "d4", "ram": 4096, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:33.288764 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-be450e94-d23b-4483-af97-c299d7f17950 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505352 Aug 08 08:34:33.289519 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 08:34:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:34:33.302109 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-5606ae0a-6dc8-409a-81f6-b7b2e569b09d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:33.381270 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-5606ae0a-6dc8-409a-81f6-b7b2e569b09d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083136 Aug 08 08:34:33.382075 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1336 bytes} [Mon Aug 8 08:34:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:34:35.795615 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-be450e94-d23b-4483-af97-c299d7f17950 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:35.796702 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-be450e94-d23b-4483-af97-c299d7f17950 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 08 08:34:35.797105 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:34:36.226811 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-f4483ebd-c1e1-4b79-92c6-6d78f8b2466d admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:36.251776 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-f4483ebd-c1e1-4b79-92c6-6d78f8b2466d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448189 Aug 08 08:34:36.252257 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Aug 8 08:34:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:34:38.455382 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-be450e94-d23b-4483-af97-c299d7f17950 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:38.456406 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-be450e94-d23b-4483-af97-c299d7f17950 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 08 08:34:38.456814 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:34:38.866502 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-e6443e7e-9d17-4064-93e6-2e3629a3ff52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "ram": 512, "vcpus": 1}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:38.951826 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-e6443e7e-9d17-4064-93e6-2e3629a3ff52 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.488684 Aug 08 08:34:38.952393 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 08:34:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 08:34:38.965618 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-358b7a8e-6077-421c-ae49-8f16d4802bb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:39.043537 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-358b7a8e-6077-421c-ae49-8f16d4802bb6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081426 Aug 08 08:34:39.044488 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Aug 8 08:34:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:34:41.283336 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-e6443e7e-9d17-4064-93e6-2e3629a3ff52 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:41.284390 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-e6443e7e-9d17-4064-93e6-2e3629a3ff52 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 08 08:34:41.284799 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:34:41.679144 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-81131f4f-5904-4b6e-9b5b-a1a708c7ae7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20}} {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:41.745818 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-81131f4f-5904-4b6e-9b5b-a1a708c7ae7b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.454732 Aug 08 08:34:41.746377 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 08:34:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 08:34:41.758403 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-e23792f3-2959-41ff-abd4-f758c2c3a0ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:41.832367 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-e23792f3-2959-41ff-abd4-f758c2c3a0ce admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077617 Aug 08 08:34:41.832967 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Aug 8 08:34:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:34:44.058198 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-81131f4f-5904-4b6e-9b5b-a1a708c7ae7b admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:44.059901 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-81131f4f-5904-4b6e-9b5b-a1a708c7ae7b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002367 Aug 08 08:34:44.060504 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:34:44.432458 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-5abefd43-1e24-4e9c-8f9a-78b9c974757d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "disk": 40, "id": "3", "rxtx_factor": 1.0}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:44.526564 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-5abefd43-1e24-4e9c-8f9a-78b9c974757d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.459288 Aug 08 08:34:44.527048 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 08:34:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:34:44.540049 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-37b071ec-2a7c-4141-bdd8-50123ba64b42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:44.641474 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-37b071ec-2a7c-4141-bdd8-50123ba64b42 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094617 Aug 08 08:34:44.641474 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Aug 8 08:34:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:34:46.890323 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-5abefd43-1e24-4e9c-8f9a-78b9c974757d admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:46.891402 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-5abefd43-1e24-4e9c-8f9a-78b9c974757d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 08 08:34:46.892062 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:34:47.337266 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-e1613688-8fd6-4e10-8eda-6b8b4cfe43e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:47.401406 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-e1613688-8fd6-4e10-8eda-6b8b4cfe43e9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.503272 Aug 08 08:34:47.402253 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 08:34:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:34:47.414379 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-48caedc8-8961-408b-84f3-f6fea1875e74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:47.484553 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-48caedc8-8961-408b-84f3-f6fea1875e74 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073801 Aug 08 08:34:47.503487 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Aug 8 08:34:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:34:49.810067 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-e1613688-8fd6-4e10-8eda-6b8b4cfe43e9 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:34:49.813391 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-e1613688-8fd6-4e10-8eda-6b8b4cfe43e9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 08 08:34:49.813391 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:34:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:34:50.248617 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-6cb9e3cb-a6f3-43a1-bd88-512e41446fd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "id": "5", "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:50.326395 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-6cb9e3cb-a6f3-43a1-bd88-512e41446fd7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.508893 Aug 08 08:34:50.327241 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1283 bytes} [Mon Aug 8 08:34:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:34:50.340340 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-1a4c356c-ece8-48f7-b27e-1f857a1f8cec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:34:50.346173 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG dbcounter [-] [110144] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:34:50.439055 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-1a4c356c-ece8-48f7-b27e-1f857a1f8cec admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102518 Aug 08 08:34:50.441459 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1333 bytes} [Mon Aug 8 08:34:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:35:10.651175 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-6cb9e3cb-a6f3-43a1-bd88-512e41446fd7 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:10.652214 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-6cb9e3cb-a6f3-43a1-bd88-512e41446fd7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 08 08:35:10.652618 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:35:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:35:11.041349 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-8285fc0f-ba90-47f7-b08e-b6ee94161319 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:11.059616 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-8285fc0f-ba90-47f7-b08e-b6ee94161319 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400481 Aug 08 08:35:11.060153 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Aug 8 08:35:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:35:12.118229 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-6cb9e3cb-a6f3-43a1-bd88-512e41446fd7 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:12.119235 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-6cb9e3cb-a6f3-43a1-bd88-512e41446fd7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 08 08:35:12.119630 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:35:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:35:12.635434 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-ec965088-a911-43cf-adf1-f32a90034c3b admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:12.641063 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.wsgi [None req-ec965088-a911-43cf-adf1-f32a90034c3b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-ec965088-a911-43cf-adf1-f32a90034c3b admin admin] Request method failure captured: Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Accept: application/json Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Accept-Encoding: gzip, deflate Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Connection: keep-alive Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Content-Length: 0 Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Host: 10.222.0.33 Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Openstack-Api-Version: compute 2.90 Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Openstack-System-Scope: None Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: User-Agent: python-novaclient Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Auth-Token: gAAAAABi8MrAR9zkmhcgvIPkH6pLjyD4hBV0EZeWx4xOForPP3FJ_bMzJF3lzAbyn754bHJQ1hT7OR9vpkR5zBxUt32XchaAyPPBU9-NJTASvQdI7g91A1ZLf3QOIUTy5Pcuo3Fld1BUkI03i6LOkwlhw5w6-pxudSrIE2IZWr5AaWDBO0xfpIQ Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Domain-Id: None Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Domain-Name: None Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Identity-Status: Confirmed Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Is-Admin-Project: True Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Domain-Id: default Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Domain-Name: Default Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Name: admin Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Role: member,admin,reader Aug 08 08:35:12.644359 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Roles: member,admin,reader Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/785791bda4044663bfe6cd25439a8358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Tenant: admin Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Tenant-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Tenant-Name: admin Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User: admin Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Domain-Id: default Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Domain-Name: Default Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Id: 63f02a13b768446ca706d7594e04d3fc Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Name: admin Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: method: > Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: exception: Flavor 42 could not be found. Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: action_args: {'id': '42'} Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:35:12.645998 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:12.649931 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:12.651344 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-ec965088-a911-43cf-adf1-f32a90034c3b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110144) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:35:12.652402 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-ec965088-a911-43cf-adf1-f32a90034c3b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.389541 Aug 08 08:35:12.652402 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Aug 8 08:35:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 08:35:12.655620 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-8deec479-e661-4324-bd5f-5e931773ac72 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:12.660434 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:35:12.679314 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-8deec479-e661-4324-bd5f-5e931773ac72 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027198 Aug 08 08:35:12.679893 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 08:35:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:35:12.690053 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-b52dbe2e-2bc1-4005-b40d-302911e46825 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:12.713561 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-b52dbe2e-2bc1-4005-b40d-302911e46825 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027339 Aug 08 08:35:12.714099 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 08:35:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:35:12.724282 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-2da9870d-53b6-4391-8257-60ed52716419 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:12.729899 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.wsgi [None req-2da9870d-53b6-4391-8257-60ed52716419 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-2da9870d-53b6-4391-8257-60ed52716419 admin admin] Request method failure captured: Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Accept: application/json Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Accept-Encoding: gzip, deflate Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Connection: keep-alive Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Content-Length: 0 Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Host: 10.222.0.33 Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Openstack-Api-Version: compute 2.90 Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Openstack-System-Scope: None Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: User-Agent: python-novaclient Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Auth-Token: gAAAAABi8MrAR9zkmhcgvIPkH6pLjyD4hBV0EZeWx4xOForPP3FJ_bMzJF3lzAbyn754bHJQ1hT7OR9vpkR5zBxUt32XchaAyPPBU9-NJTASvQdI7g91A1ZLf3QOIUTy5Pcuo3Fld1BUkI03i6LOkwlhw5w6-pxudSrIE2IZWr5AaWDBO0xfpIQ Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Domain-Id: None Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Domain-Name: None Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Identity-Status: Confirmed Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Is-Admin-Project: True Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Domain-Id: default Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Domain-Name: Default Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Name: admin Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Role: member,admin,reader Aug 08 08:35:12.733096 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Roles: member,admin,reader Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/785791bda4044663bfe6cd25439a8358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Tenant: admin Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Tenant-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Tenant-Name: admin Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User: admin Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Domain-Id: default Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Domain-Name: Default Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Id: 63f02a13b768446ca706d7594e04d3fc Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Name: admin Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: method: > Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: exception: Flavor 42 could not be found. Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: action_args: {'id': '42'} Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:35:12.734614 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:12.736133 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:12.737244 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-2da9870d-53b6-4391-8257-60ed52716419 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:35:12.741854 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-2da9870d-53b6-4391-8257-60ed52716419 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014125 Aug 08 08:35:12.741854 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Aug 8 08:35:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 08:35:13.693620 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-b52dbe2e-2bc1-4005-b40d-302911e46825 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:13.694647 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-b52dbe2e-2bc1-4005-b40d-302911e46825 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 08 08:35:13.695033 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:35:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:35:14.223051 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-b45e549d-dd71-4411-836d-abc8fd15838c admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:14.228312 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.wsgi [None req-b45e549d-dd71-4411-836d-abc8fd15838c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-b45e549d-dd71-4411-836d-abc8fd15838c admin admin] Request method failure captured: Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Accept: application/json Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Accept-Encoding: gzip, deflate Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Connection: keep-alive Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Content-Length: 0 Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Host: 10.222.0.33 Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Openstack-Api-Version: compute 2.90 Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Openstack-System-Scope: None Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: User-Agent: python-novaclient Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Auth-Token: gAAAAABi8MrBt21_7Wc4zCM8PQSuvhi2tRW2F_jMFXp768bF4BiEDa7gZRB6Vmx5twrDc3Al6QlzrfVaD2JauUf8MpgsO8pYFSliWFzNARAQEzRikn2LtIgQGBCEqXH5TykbDo5aaluyBa3W2X-hWVXITJPUnpipNFOyEtM__AnEG-D_dyASGCM Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Domain-Id: None Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Domain-Name: None Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Identity-Status: Confirmed Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Is-Admin-Project: True Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Domain-Id: default Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Domain-Name: Default Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Name: admin Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Role: member,admin,reader Aug 08 08:35:14.229823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Roles: member,admin,reader Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/785791bda4044663bfe6cd25439a8358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Tenant: admin Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Tenant-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Tenant-Name: admin Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User: admin Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Domain-Id: default Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Domain-Name: Default Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Id: 63f02a13b768446ca706d7594e04d3fc Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Name: admin Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: method: > Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: exception: Flavor 84 could not be found. Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: action_args: {'id': '84'} Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:35:14.231337 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:14.232288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:14.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-b45e549d-dd71-4411-836d-abc8fd15838c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:35:14.234848 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-b45e549d-dd71-4411-836d-abc8fd15838c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397608 Aug 08 08:35:14.234848 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Aug 8 08:35:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 08:35:14.240739 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-79d5b41f-f2de-487e-85ae-4170ab4edc22 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:14.255654 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-79d5b41f-f2de-487e-85ae-4170ab4edc22 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018445 Aug 08 08:35:14.256172 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 08:35:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:35:14.265158 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-f37250e9-83a3-4eaa-93b4-aa6a11fe38bd admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:14.280491 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-f37250e9-83a3-4eaa-93b4-aa6a11fe38bd admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018742 Aug 08 08:35:14.281016 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 08:35:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:35:14.289959 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-a2171b28-8cd7-4505-851c-d30cfd504212 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:14.295091 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.wsgi [None req-a2171b28-8cd7-4505-851c-d30cfd504212 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-a2171b28-8cd7-4505-851c-d30cfd504212 admin admin] Request method failure captured: Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Accept: application/json Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Accept-Encoding: gzip, deflate Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Connection: keep-alive Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Content-Length: 0 Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Host: 10.222.0.33 Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Openstack-Api-Version: compute 2.90 Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Openstack-System-Scope: None Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: User-Agent: python-novaclient Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Auth-Token: gAAAAABi8MrBt21_7Wc4zCM8PQSuvhi2tRW2F_jMFXp768bF4BiEDa7gZRB6Vmx5twrDc3Al6QlzrfVaD2JauUf8MpgsO8pYFSliWFzNARAQEzRikn2LtIgQGBCEqXH5TykbDo5aaluyBa3W2X-hWVXITJPUnpipNFOyEtM__AnEG-D_dyASGCM Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Domain-Id: None Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Domain-Name: None Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Identity-Status: Confirmed Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Is-Admin-Project: True Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Domain-Id: default Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Domain-Name: Default Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Name: admin Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Role: member,admin,reader Aug 08 08:35:14.296575 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Roles: member,admin,reader Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/785791bda4044663bfe6cd25439a8358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Tenant: admin Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Tenant-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Tenant-Name: admin Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User: admin Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Domain-Id: default Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Domain-Name: Default Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Id: 63f02a13b768446ca706d7594e04d3fc Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Name: admin Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: method: > Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: exception: Flavor 84 could not be found. Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: action_args: {'id': '84'} Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:35:14.298746 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:14.299679 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:14.300749 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-a2171b28-8cd7-4505-851c-d30cfd504212 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110144) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:35:14.301783 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-a2171b28-8cd7-4505-851c-d30cfd504212 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012079 Aug 08 08:35:14.301783 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Aug 8 08:35:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 08:35:15.264635 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-f37250e9-83a3-4eaa-93b4-aa6a11fe38bd admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:15.265679 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-f37250e9-83a3-4eaa-93b4-aa6a11fe38bd admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 08 08:35:15.266286 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:35:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:35:15.785607 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-90dcc1d9-bac4-4cbf-b6a4-4aa0e340cc2f admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:15.791288 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.wsgi [None req-90dcc1d9-bac4-4cbf-b6a4-4aa0e340cc2f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-90dcc1d9-bac4-4cbf-b6a4-4aa0e340cc2f admin admin] Request method failure captured: Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Accept: application/json Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Accept-Encoding: gzip, deflate Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Connection: keep-alive Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Content-Length: 0 Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Host: 10.222.0.33 Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Openstack-Api-Version: compute 2.90 Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Openstack-System-Scope: None Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: User-Agent: python-novaclient Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Auth-Token: gAAAAABi8MrDyMHr79UK1dEIwykTufDixsBqA148gLDt1XDS6ODrAY-XEh2Qxtf2UG6V-Cs3NnNBmgZFzWQiBzrFZR67svVvakoPrQaVpvs8d2pK6BW73i6j5d6N6bymBUzHY87SP54elLtXqHAVnF784nJDEDWlFKCtWbfv0hVPuQiVdu1UUDA Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Domain-Id: None Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Domain-Name: None Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Identity-Status: Confirmed Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Is-Admin-Project: True Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Domain-Id: default Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Domain-Name: Default Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Project-Name: admin Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Role: member,admin,reader Aug 08 08:35:15.792785 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Roles: member,admin,reader Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/785791bda4044663bfe6cd25439a8358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Tenant: admin Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Tenant-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-Tenant-Name: admin Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User: admin Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Domain-Id: default Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Domain-Name: Default Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Id: 63f02a13b768446ca706d7594e04d3fc Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: X-User-Name: admin Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: method: > Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: exception: Flavor 451 could not be found. Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: action_args: {'id': '451'} Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:35:15.794124 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:15.794950 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: ERROR nova.api.openstack.wsgi Aug 08 08:35:15.796298 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-90dcc1d9-bac4-4cbf-b6a4-4aa0e340cc2f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110144) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:35:15.798217 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-90dcc1d9-bac4-4cbf-b6a4-4aa0e340cc2f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388870 Aug 08 08:35:15.798217 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 08:35:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 08:35:15.804690 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-07fb5e89-6419-478a-8bad-309605be3298 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:15.819369 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-07fb5e89-6419-478a-8bad-309605be3298 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018253 Aug 08 08:35:15.819891 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 08:35:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:35:15.829634 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:15.845458 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019878 Aug 08 08:35:15.845991 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Aug 8 08:35:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:35:15.854914 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-f5aa937c-8ee2-4ca7-b4cb-dc093c8a2deb admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:15.860117 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.wsgi [None req-f5aa937c-8ee2-4ca7-b4cb-dc093c8a2deb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-f5aa937c-8ee2-4ca7-b4cb-dc093c8a2deb admin admin] Request method failure captured: Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Accept: application/json Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Accept-Encoding: gzip, deflate Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Connection: keep-alive Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Content-Length: 0 Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Host: 10.222.0.33 Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Openstack-Api-Version: compute 2.90 Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Openstack-System-Scope: None Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: User-Agent: python-novaclient Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Auth-Token: gAAAAABi8MrDyMHr79UK1dEIwykTufDixsBqA148gLDt1XDS6ODrAY-XEh2Qxtf2UG6V-Cs3NnNBmgZFzWQiBzrFZR67svVvakoPrQaVpvs8d2pK6BW73i6j5d6N6bymBUzHY87SP54elLtXqHAVnF784nJDEDWlFKCtWbfv0hVPuQiVdu1UUDA Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Domain-Id: None Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Domain-Name: None Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Identity-Status: Confirmed Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Is-Admin-Project: True Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Domain-Id: default Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Domain-Name: Default Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Project-Name: admin Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Role: member,admin,reader Aug 08 08:35:15.861595 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Roles: member,admin,reader Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/785791bda4044663bfe6cd25439a8358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/785791bda4044663bfe6cd25439a8358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Tenant: admin Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Tenant-Id: 785791bda4044663bfe6cd25439a8358 Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-Tenant-Name: admin Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User: admin Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Domain-Id: default Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Domain-Name: Default Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Id: 63f02a13b768446ca706d7594e04d3fc Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: X-User-Name: admin Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: method: > Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: exception: Flavor 451 could not be found. Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: action_args: {'id': '451'} Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:35:15.863102 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:15.864056 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: ERROR nova.api.openstack.wsgi Aug 08 08:35:15.865448 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-f5aa937c-8ee2-4ca7-b4cb-dc093c8a2deb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110145) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:35:15.866687 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-f5aa937c-8ee2-4ca7-b4cb-dc093c8a2deb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011401 Aug 08 08:35:15.866687 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 08:35:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 08:35:16.839021 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:16.840034 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 08 08:35:16.840434 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:35:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:35:17.356447 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-60453139-6d5c-42cd-8b88-d1b20e3f7cd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:35:17.428917 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-60453139-6d5c-42cd-8b88-d1b20e3f7cd8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.451573 Aug 08 08:35:17.429621 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Aug 8 08:35:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:35:18.393417 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:18.394423 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 08 08:35:18.394819 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:35:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:35:18.916382 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-a0ae0536-afcf-430f-b17f-9dbb17089674 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:35:19.005139 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-a0ae0536-afcf-430f-b17f-9dbb17089674 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.472118 Aug 08 08:35:19.005709 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Aug 8 08:35:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:35:19.991282 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:19.992314 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 08 08:35:19.992710 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:35:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:35:20.522603 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-34bda6d8-44dc-4add-934f-4649df7acc2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:35:20.634696 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-34bda6d8-44dc-4add-934f-4649df7acc2d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.500049 Aug 08 08:35:20.635305 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Aug 8 08:35:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:35:21.601595 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:21.602609 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 08 08:35:21.603006 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:35:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:35:22.118870 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-cd9d04e8-3da7-4f1f-ba6c-9b0ab90a720c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:35:22.198788 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-cd9d04e8-3da7-4f1f-ba6c-9b0ab90a720c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.458814 Aug 08 08:35:22.199341 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Aug 8 08:35:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:35:23.166376 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:23.167397 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 08 08:35:23.167801 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:35:23.693823 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-160cb39f-f95e-4f07-aa3f-15d9bd90533c admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:35:23.714510 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-160cb39f-f95e-4f07-aa3f-15d9bd90533c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408439 Aug 08 08:35:23.715060 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Mon Aug 8 08:35:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:36:15.042004 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:36:15.043042 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-b7d7042e-4244-4b58-aea5-676ed538c229 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 08 08:36:15.043435 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 931 bytes} [Mon Aug 8 08:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:36:15.054686 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:36:15.432822 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-b8892c69-e76b-4bfa-81e7-7869f3c8d5d0 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:36:15.453621 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-b8892c69-e76b-4bfa-81e7-7869f3c8d5d0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403304 Aug 08 08:36:15.454225 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1292 bytes} [Mon Aug 8 08:36:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:36:15.478101 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-6970c4d7-f863-483b-b214-94749da2b6a5 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:36:15.481498 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG dbcounter [-] [110144] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:36:15.486981 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-6970c4d7-f863-483b-b214-94749da2b6a5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012459 Aug 08 08:36:15.487497 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1283 bytes} [Mon Aug 8 08:36:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:36:15.499152 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-f16690b3-a105-4ad0-bc1a-dfe3fdc20bfa admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:36:15.506822 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-f16690b3-a105-4ad0-bc1a-dfe3fdc20bfa admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011412 Aug 08 08:36:15.507344 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1286 bytes} [Mon Aug 8 08:36:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:36:15.518689 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-1b191744-57f6-4582-a7ab-63e3c4f3a9c6 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:36:15.526391 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-1b191744-57f6-4582-a7ab-63e3c4f3a9c6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011232 Aug 08 08:36:15.526910 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1286 bytes} [Mon Aug 8 08:36:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:36:15.538998 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-ee1c5e12-695a-41d6-953e-f525de6b7034 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:36:15.547194 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-ee1c5e12-695a-41d6-953e-f525de6b7034 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011721 Aug 08 08:36:15.547713 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1283 bytes} [Mon Aug 8 08:36:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:39:32.997519 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-1b191744-57f6-4582-a7ab-63e3c4f3a9c6 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:39:32.998618 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-1b191744-57f6-4582-a7ab-63e3c4f3a9c6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 08 08:39:32.999015 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:39:33.141073 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writing DB stats nova_api:SELECT=6 {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:39:33.296098 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-c69d488b-048c-47c7-8fb2-4b481e0306cc admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:39:33.298501 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 08:39:33.298501 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: warnings.warn(msg) Aug 08 08:39:33.300243 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-c69d488b-048c-47c7-8fb2-4b481e0306cc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:39:33.300725 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-c69d488b-048c-47c7-8fb2-4b481e0306cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:39:33.301175 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-c69d488b-048c-47c7-8fb2-4b481e0306cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:39:33.301909 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-c69d488b-048c-47c7-8fb2-4b481e0306cc admin admin] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:39:33.302355 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-c69d488b-048c-47c7-8fb2-4b481e0306cc admin admin] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:39:33.302770 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-c69d488b-048c-47c7-8fb2-4b481e0306cc admin admin] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:39:33.335280 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-c69d488b-048c-47c7-8fb2-4b481e0306cc admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.195629 Aug 08 08:39:33.335838 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 08:39:33 2022] GET /compute/v2.1/os-services => generated 794 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:39:34.161057 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-1b191744-57f6-4582-a7ab-63e3c4f3a9c6 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:39:34.162094 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-1b191744-57f6-4582-a7ab-63e3c4f3a9c6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 08 08:39:34.162489 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:39:34.356120 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-cb43b3e3-0340-4c2b-a620-7bc1b903dbf1 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:39:34.358572 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 08:39:34.358572 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: warnings.warn(msg) Aug 08 08:39:34.359690 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-cb43b3e3-0340-4c2b-a620-7bc1b903dbf1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:39:34.360166 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-cb43b3e3-0340-4c2b-a620-7bc1b903dbf1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:39:34.360597 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-cb43b3e3-0340-4c2b-a620-7bc1b903dbf1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:39:34.361351 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-cb43b3e3-0340-4c2b-a620-7bc1b903dbf1 admin admin] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:39:34.361802 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-cb43b3e3-0340-4c2b-a620-7bc1b903dbf1 admin admin] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:39:34.362225 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-cb43b3e3-0340-4c2b-a620-7bc1b903dbf1 admin admin] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:39:34.381447 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-cb43b3e3-0340-4c2b-a620-7bc1b903dbf1 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077260 Aug 08 08:39:34.381935 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 08:39:34 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:39:45.610110 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-1b191744-57f6-4582-a7ab-63e3c4f3a9c6 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:39:45.611528 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-1b191744-57f6-4582-a7ab-63e3c4f3a9c6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001860 Aug 08 08:39:45.611921 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:39:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:39:45.754544 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writing DB stats nova_cell0:SELECT=4 {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:39:45.755191 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writing DB stats nova_cell1:SELECT=4 {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:39:45.755798 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG dbcounter [-] [110145] Writing DB stats nova_api:SELECT=8 {{(pid=110145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:39:45.802548 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-fabc26ea-7cd7-4a64-a819-a76cb8499e57 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:39:45.804881 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 08:39:45.804881 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: warnings.warn(msg) Aug 08 08:39:45.806021 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-fabc26ea-7cd7-4a64-a819-a76cb8499e57 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:39:45.806498 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-fabc26ea-7cd7-4a64-a819-a76cb8499e57 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:39:45.806996 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-fabc26ea-7cd7-4a64-a819-a76cb8499e57 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:39:45.807641 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-fabc26ea-7cd7-4a64-a819-a76cb8499e57 admin admin] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:39:45.808116 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-fabc26ea-7cd7-4a64-a819-a76cb8499e57 admin admin] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:39:45.808534 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-fabc26ea-7cd7-4a64-a819-a76cb8499e57 admin admin] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:39:45.834459 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-fabc26ea-7cd7-4a64-a819-a76cb8499e57 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084441 Aug 08 08:39:45.835043 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 08:39:45 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:39:46.652502 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: DEBUG nova.api.openstack.wsgi [None req-1b191744-57f6-4582-a7ab-63e3c4f3a9c6 admin admin] Calling method '>' {{(pid=110144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:39:46.653567 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: INFO nova.api.openstack.requestlog [None req-1b191744-57f6-4582-a7ab-63e3c4f3a9c6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 08 08:39:46.653955 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: [pid: 110144|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Aug 8 08:39:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:39:46.844288 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG nova.api.openstack.wsgi [None req-a2e62bfb-d34d-4c30-9118-f4bea5cbf338 admin admin] Calling method '>' {{(pid=110145) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:39:46.846767 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 08:39:46.846767 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: warnings.warn(msg) Aug 08 08:39:46.847871 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-a2e62bfb-d34d-4c30-9118-f4bea5cbf338 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:39:46.848341 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-a2e62bfb-d34d-4c30-9118-f4bea5cbf338 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:39:46.848767 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-a2e62bfb-d34d-4c30-9118-f4bea5cbf338 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:39:46.849506 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-a2e62bfb-d34d-4c30-9118-f4bea5cbf338 admin admin] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:39:46.849953 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-a2e62bfb-d34d-4c30-9118-f4bea5cbf338 admin admin] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:39:46.850369 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: DEBUG oslo_concurrency.lockutils [None req-a2e62bfb-d34d-4c30-9118-f4bea5cbf338 admin admin] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110145) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:39:46.873187 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: INFO nova.api.openstack.requestlog [None req-a2e62bfb-d34d-4c30-9118-f4bea5cbf338 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080716 Aug 08 08:39:46.873732 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: [pid: 110145|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Aug 8 08:39:46 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:40:44.426621 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: Mon Aug 8 08:40:44 2022 - graceful shutdown triggered... Aug 08 08:40:44.427103 dv-cinder-836973-17-iscsi devstack@n-api.service[110144]: Gracefully killing worker 1 (pid: 110144)... Aug 08 08:40:44.426728 dv-cinder-836973-17-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 08 08:40:44.427913 dv-cinder-836973-17-iscsi devstack@n-api.service[110145]: Gracefully killing worker 2 (pid: 110145)... Aug 08 08:40:45.427736 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: worker 1 buried after 1 seconds Aug 08 08:40:45.428160 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: worker 2 buried after 1 seconds Aug 08 08:40:45.428160 dv-cinder-836973-17-iscsi devstack@n-api.service[110143]: goodbye to uWSGI. Aug 08 08:40:45.429360 dv-cinder-836973-17-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 08 08:40:45.429908 dv-cinder-836973-17-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 08 08:40:45.432755 dv-cinder-836973-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 08:40:45.445438 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 08:40:45.447432 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 08:40:45 2022] *** Aug 08 08:40:45.447598 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 08:40:45.447598 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 08:40:45.447598 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: nodename: dv-cinder-836973-17-iscsi Aug 08 08:40:45.447598 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: machine: x86_64 Aug 08 08:40:45.447598 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: clock source: unix Aug 08 08:40:45.447598 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: pcre jit disabled Aug 08 08:40:45.447598 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: detected number of CPU cores: 4 Aug 08 08:40:45.447598 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: current working directory: / Aug 08 08:40:45.447598 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: detected binary path: /usr/bin/uwsgi-core Aug 08 08:40:45.447598 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: your processes number limit is 47680 Aug 08 08:40:45.448269 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: your memory page size is 4096 bytes Aug 08 08:40:45.448269 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: detected max file descriptor number: 2048 Aug 08 08:40:45.448269 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: lock engine: pthread robust mutexes Aug 08 08:40:45.448269 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: thunder lock: enabled Aug 08 08:40:45.448269 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 08:40:45.448269 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 08:40:45.490937 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: Python main interpreter initialized at 0x555f9a9159c0 Aug 08 08:40:45.490937 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: python threads support enabled Aug 08 08:40:45.490937 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: your server socket listen backlog is limited to 100 connections Aug 08 08:40:45.490937 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: your mercy for graceful operations on workers is 90 seconds Aug 08 08:40:45.491412 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 08:40:45.491412 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: *** Operational MODE: preforking *** Aug 08 08:40:45.491659 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: *** uWSGI is running in multiple interpreter mode *** Aug 08 08:40:45.491659 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: spawned uWSGI master process (pid: 124655) Aug 08 08:40:45.491862 dv-cinder-836973-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 08:40:45.494976 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: spawned uWSGI worker 1 (pid: 124672, cores: 1) Aug 08 08:40:45.495537 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: spawned uWSGI worker 2 (pid: 124673, cores: 1) Aug 08 08:40:45.497851 dv-cinder-836973-17-iscsi devstack@n-api.service[124655]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 08:40:46.168955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 08:40:46.171418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 08:40:47.330816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 08:40:47.330816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: from cryptography.utils import int_from_bytes Aug 08 08:40:47.331453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 08:40:47.331453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: from cryptography.utils import int_from_bytes Aug 08 08:40:47.333275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 08:40:47.333275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: from cryptography.utils import int_from_bytes Aug 08 08:40:47.333724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 08:40:47.333724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: from cryptography.utils import int_from_bytes Aug 08 08:40:49.638212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 08:40:49.638776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 08:40:49.638991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 08:40:49.639379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 08:40:49.639621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 08:40:49.640014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.640410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.640923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.641289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.641631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.641950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.642278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.642601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.642934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.643201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.643526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.643857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-17-iscsi {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.644210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.644496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.644811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.645132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.645465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.645791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.646099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.646605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.647360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.647662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.648079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.648433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.648746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.649063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.649421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.649746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.650071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.650396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.650789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-17-iscsi {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.651117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.651428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.651747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.652163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.652480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.652796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.653121 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.653493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.653819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.654147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.654472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.654797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.655123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.655433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.655749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.656616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.656936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.657281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.657601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.657854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.658172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.658503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.658829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.659157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.659415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.659669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.659991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.660339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.660630 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.660939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.661278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.661590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.661900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.662212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.662523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.662835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.663156 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.663475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.663807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.664119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.664442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.664850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.665105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.665442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.665787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.666146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.666423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.666792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.667065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.667385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.667690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.668003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.668127 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 08:40:49.668585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.668664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 08:40:49.668749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.668845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 08:40:49.668928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.669207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.669305 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 08:40:49.669501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 08:40:49.669694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.669842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.669933 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.670117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.670271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.670414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.670588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.670738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.670880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.671028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.671171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.671325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.671475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.671751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.672116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.672305 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.672450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.672574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.672694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.672929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.673049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.673182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.676902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.677257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.677694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.677886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-17-iscsi {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.678195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.678443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.678652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.678808 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.678961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.679124 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.679267 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.679421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.679590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.679737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.679880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.680067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.680253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.680397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.680553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.680553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.680834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.681017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.681182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.681343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.681494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.681640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.681796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.681939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.682120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.682302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.682457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.682608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.682767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.682930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.683108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.683256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.683399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.683625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.683812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.683970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.684159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.684356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.684356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.684672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-17-iscsi {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.684832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.684974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.685135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.685354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.685507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.685662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.685811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.685963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.686107 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.686287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.686443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.686950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.687587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.688167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.688331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.688331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.688685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.688840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.689576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.689746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.689891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.690043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.690204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.690406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.690549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.690701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.690851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.691022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.691174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.691324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.691477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.691621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.691763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.691919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.692067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.692254 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.692401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.692585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.692738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.692738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.693038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.693223 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.693372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.693522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.693671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.693671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.693952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.694095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.694285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.694477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.694631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.694777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.694929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.695084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.695233 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.695387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.695539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.698484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.698658 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.698811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.698974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.699131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.699283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.699443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.699641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.699794 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.700708 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.700880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.701027 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.701218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.701369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.701369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.701655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.701813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.701965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.702109 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.702394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.702574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.704686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.704865 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.705016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.705191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.705361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.705361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.705650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.705650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.705940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.706084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.706226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.706387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.706546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.706546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.706836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.706836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.707215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.707215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.707499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.707642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.707791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.707942 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.708126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.708401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.708577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.708730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.708873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.709017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.709217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.709457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.709630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.709782 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.709934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.709934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.710270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.710543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.711579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.711751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.711904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.712049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.712199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.712352 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.712503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.712647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.712798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.712942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.713093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.713279 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.713439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.713628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.713901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.714058 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.714188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.714308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.714419 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.714537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.714648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.714765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.714924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.715050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.715162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.715286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.715398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.715509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.715669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.715789 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.715900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.716018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.716129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.716254 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.716382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.716493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.716617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.716740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.716861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.716979 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.717167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.720064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.720221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.720377 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.720574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.720731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.720923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.721730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.721888 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.722033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.722187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.722348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.722498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.722636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.722784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.722924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.723077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.723222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.723370 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.723515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.723693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.723877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.724027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.724176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.724326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.724553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.724703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.724877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.725061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.725229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.725368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.725517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.725655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.725831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.725968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.726103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.726238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.726384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.726521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.726673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.726856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.727005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.727141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.727328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.727484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.727635 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.727769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.727958 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.728105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.728297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.728454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.728609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.728747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.728885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.729021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.729171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.729326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.729664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 08:40:49.729817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.729989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.730133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.730270 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.730422 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.730569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.730706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.730852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.730998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.731235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.731918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.732140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.732284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.732433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.732581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.732736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.732883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.733030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.733207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.733207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.733387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.733387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.733555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.733639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.733732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.733822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.733942 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.734071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.734308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.734401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.734401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.734545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.734626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.734699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.734807 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.734889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.734961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.735806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.736111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.736231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.736313 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.736385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.736385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.736526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.736599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.736675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.736752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.736833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.736945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.737036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.737117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.737272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.737362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.737485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.737581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.737741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.737838 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.737925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.738044 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.738136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.738221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.738319 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.738411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.738502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.738586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.738664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.738750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.738822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.738900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.739068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.739142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.739212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.739490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.739574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.739646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.739752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.739833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.739906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.739992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.740148 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.740233 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.740307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.740469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.740558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.740641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.740715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.740792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.740870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.740948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.741033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.741114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.741712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.742002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.745513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.745660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.745853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.746002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.746139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.746312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.746450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.746593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.746741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.746879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.747022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.747171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.747352 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.747497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.747646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.747867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.747867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.748616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.748710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.748806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.748892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.748983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.749073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.749182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.749270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.749367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.749464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.750088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.750185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.750269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.750383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.750485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.750580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.750668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.750746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.750840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.750926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.751022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.751114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.751206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.751297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.751940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.752140 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.752288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.752383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.752468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.752551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.752741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.752850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.752945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.753952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.754704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.754821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.754909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755511 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755858 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.755941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.756143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.756245 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.756330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.756414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.756496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.756580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.756676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.756903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.756995 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.757086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.757192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.757279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.757279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.757510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.757598 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.757598 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.757766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.757957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.758051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.758136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.758270 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.758367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.758367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.758541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.758633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.758755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.758859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.758859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759564 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.759995 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.760124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.760124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.760124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.760124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.760447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.760541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.760541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.760541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.760771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.760868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.760953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.761036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.761036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.761036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.761036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.761366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.761451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.761451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.761451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.761451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.762420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.762525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.762525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.762525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.762945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.763648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764109 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764613 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.764698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.765129 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.765533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.765533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.765533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.765829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.766056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.766056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.766251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.766410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.766532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.766787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.767006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.767106 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.767386 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.767610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.767717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.767998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.768180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.768305 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.768633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.768766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.768950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.769293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.769402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.769603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.769887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.769980 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.770210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.770466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.770571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.770813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.771050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.771143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.771445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.771656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.771898 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.772310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.772407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.772519 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.772686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.772833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.772927 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.773256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.773449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.773550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.773856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.774081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.774192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.774454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.774643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.774761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.775082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.775193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.775389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.775668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.775766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.775985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.776246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.776359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.776620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.776842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.776934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.777298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.777466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.777602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.777911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.778074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.778232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.778546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.778656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.778858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.779171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.779270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.779878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.779972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.780059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.780059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.780376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.780475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.780681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.781553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.781695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.782024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.782160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.782590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.782689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.782795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.782795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.783091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.783204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.783418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.783727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.783828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.784039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.784324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.784430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.784652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.784921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.785013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.785287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.785547 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.785641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.785903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.786140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.786231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.786517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.786734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.786825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.787123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.787300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.787433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.787744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.787876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.788052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.788380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.788472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.788694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.789020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.789133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.789340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.789578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.789673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.789944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.790167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.790269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.790665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.790773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.790976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.791268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.791373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.791579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.791866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.791957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.792199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.792628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.792738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.792834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.793019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.793204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.793551 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.793675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.793951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.794164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.794264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.794638 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.794754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.794881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.795186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.795282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.795501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.795744 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.795835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.796122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.796249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.796477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.796782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.797000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.797243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.797559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.797655 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.797876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.797977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.798206 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.798307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.798522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.798631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.798839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.798933 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.799198 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.799370 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.799522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.799652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.799837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.799968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.800164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.800275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.800497 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.800590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.800816 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.800917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.801172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.801286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.801483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.801576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.801802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.801894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.802136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.802371 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.802478 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.802796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.802889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.802974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.803072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.803163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.803394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.803489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.803685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.803785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.804002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.804101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.804325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.804415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.804642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.804746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.804963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.805064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.805308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.805415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.805631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.805738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.805953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.806045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.806281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.806373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.806637 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.806911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.807016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.807199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.807298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.807528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.807647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.807831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.807943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.808135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.808236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.808459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.808552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.808765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.808867 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.809079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.809194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.809419 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.809529 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.809728 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.809834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.810033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.810137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.810336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.810428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.810660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.810755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.810965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.811066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.811288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.811379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.811594 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.811684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.811907 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.812005 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.812277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.812404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.812588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.812824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.812909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.813097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.813949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.814041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.814116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.814195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.814277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.814359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.814438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.814517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.814589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.814667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.814752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.814954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.815050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.815286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.815384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.815608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.815698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.815919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.816007 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.816227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.816309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.816535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.816618 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.816886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.816975 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.818257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.818377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.818470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.818546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.818625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.818720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.818805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.818898 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.818985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.819068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.819157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.819242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.819332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.819428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.819514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.819597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.819738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.819832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.820047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.820153 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.820350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.820447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.820657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.820750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.820964 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.821063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.821309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.821498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.821673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.821838 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.821993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.822144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.822407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.822534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.822649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.822744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.822843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.822936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.823260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.823391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.823569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.823717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.823866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.824006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.824152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.824294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.824465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.824601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.824754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.824900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.825049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.825202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.825303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.825409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.825537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.825729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.825845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.826048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.826168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.826370 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.826471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.826691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.826819 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.827004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.827104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.827326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.827430 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.827646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.828277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.828499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.828611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.828866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.829203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.829301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.829505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.829655 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.829814 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.829914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.830128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.830218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.830437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.830549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.830752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.830871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.831068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.831173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.831374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.831485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.831687 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.831796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.831992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.832084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.832303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.832395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.832612 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.832711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.832924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.833023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.833328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.833446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.833578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.833761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.833907 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.834052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.834203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.834352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.834499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.834639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.834784 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.834934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.835075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.835221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.835355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.835502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.835671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.835810 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.835985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.836126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.836294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.836444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.836601 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.836763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.836949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.837078 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.837298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.837405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.837636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.837741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.837946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.838038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.838292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.838400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.838589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.838689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.838908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.839008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.839345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.839533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.839705 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.839842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.839990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.840131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.840271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.840419 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.840559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.840695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.840841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.840988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.841136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.841387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.841528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.841684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.841824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.841964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.842111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.842264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.842411 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.842565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.842705 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.842893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.843030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.843215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.843559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.843559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.843858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.844000 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.844449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.844611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.844754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.844898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.845065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.845242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.845402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.845502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.845718 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.845823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.846029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.846128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.846343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.846441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.846657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.846754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.846964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.847052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.847273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.847369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.847585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.847677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.847898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.848127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.848243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.848486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.848585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.848810 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.848910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.849118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.849229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.849452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.849553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.849759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.849859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.850076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.850176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.850388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.850486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.850715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.850828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.851025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.851146 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.851343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.851462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.851655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.851756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.851962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.852073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.852271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.852389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.852586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.852709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.852900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.853027 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.853231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.853361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.853627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.853785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.853883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.854102 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.854195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.854420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.854511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.854735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.854836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.855046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.855137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.855354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.855456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.855658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.855746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.855966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.856064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.856271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.856375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.856577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.856663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.856885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.856984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.857211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.857376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.857526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.857625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.857848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.857969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.858147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.858299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.858460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.858570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.858773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.858867 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.859632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.859789 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.859961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.860191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.860327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.860514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.860663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.860845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.860982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.861193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.861291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.861530 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.861641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.861843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.861942 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.862163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.862256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.862481 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.862586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.862810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.862903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.863140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.863345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.863447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.863729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.863841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.864009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.864110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.864344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.864446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.864679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.864780 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.864990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.865090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.865327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.865441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.865640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.865740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.865968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.866060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.866282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.866384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.866596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.866694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.866909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.867007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.867224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.867324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.867536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.867629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.867849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.868133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.868239 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.868333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.868458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.868557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.868768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.868868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.869077 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.869189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.869416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.869567 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.869726 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.869826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.870036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.870140 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.870343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.870435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.870650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.870750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.870976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.871068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.871284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.871383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.871602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.871701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.871914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.872004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.872230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.872320 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.872545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.872650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.872852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.872942 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.873199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.873309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.873495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.873595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.873831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.873938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.874145 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.874255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.874454 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.874592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.874851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.875065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.875365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.875465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.875693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.875792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.876016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.876112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.876341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.876435 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.876937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.877074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.877194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.877298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.877395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.877494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.877652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.877770 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.877978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.878078 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.878295 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.878409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.878625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.878717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.878954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.879048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.879271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.879372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.879581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.879680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.879891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.879983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.880198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.880296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.880507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.880599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.880813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.880903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.881122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.881258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.881457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.881551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.881763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.881854 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.882070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.882171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.882383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.882474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.882690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.882783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.882996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.883087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.883301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.883390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.883603 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.883706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.883914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.884023 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.884219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.884326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.884525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.884627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.884835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.884935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.885165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.885260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.885474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.885581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.885781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.885880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.886093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.886193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.886399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.886513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.886702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.886796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.887004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.887103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.887310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.887405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.887613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.887711 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.887948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.888037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.888287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.888404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.888602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.888691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.888927 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.889191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.889306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.889507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.889601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.889831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.889929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.890656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.890852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.891052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.891165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.891372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.891474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.891686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.891788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.892023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.892122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.892338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.892437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.892655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.892748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.892970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.893061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.893307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.893400 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.893622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.893715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.894008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.894192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.894282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.894423 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.894569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.894711 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.894881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.895030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.895211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.895312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.895534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.895675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.895859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.896002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.896180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.896322 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.896494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.896643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.896815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.896949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.897126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.897241 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.897470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.897575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.897780 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.897878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.898094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.898183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.898407 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.898506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.898726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.898829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.899035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.899126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.899347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.899446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.899664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.899766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.899977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.900074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.900304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.900395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.900633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.900756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.900946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.901044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.901290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.901443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.901614 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.901775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.901938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.902074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.902263 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.902469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.902620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.902793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.902937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.903134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.903281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.903465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.903615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.903799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.903950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.904168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 08:40:49.904313 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.904437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.904772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.905087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.905430 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.905749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.906641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.906968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.907303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.907623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.907937 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.908269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.908586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.909187 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.909552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.911623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.911623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.911623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.911623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.911623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.911623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.912288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.912288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.912456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.912696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.913008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.913347 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.913668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.913984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.914298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.914615 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.914924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.915262 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.915577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.915892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.916202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.916585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.916892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.917204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.917482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.917794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.918113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.918424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.918943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.919110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.919392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.919709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.920029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.920341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.920680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.920995 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.921385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.921762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.922177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.922516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.922834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.923182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.923544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.923865 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.924478 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.924823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.925163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.925527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.925866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.926182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.926496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.926818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.927155 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.927474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.927793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.928111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.928428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.928746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.929132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.929405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.929722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.930084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.930401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.930718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.931032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.931350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.931666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.931993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.932354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.932689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.933016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.933364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.933692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.934011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.934330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.934650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.934965 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.935288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.935629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.935951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.936263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.936714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.937035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.937557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.937739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.938085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.938417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.938750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.939070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.939507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.939755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.940062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.940411 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.940749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.941082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.943421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.943421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.943421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.943421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.943421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.943421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.943421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.944152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.944152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.944152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.944443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.944755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.945068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.945407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.945719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.946031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.946343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.946660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.946971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.947281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.947630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.947940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.948251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.948561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.948873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.949215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.949554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.949900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.950224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.950551 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.950872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.951201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.951517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.951881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.952203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.952530 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.953444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.953788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.954190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.954526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.955000 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.955166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.955483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.955801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.956144 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.956479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.956800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.957134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.957484 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.957817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.958138 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.958587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.958822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.959139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.959456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.959773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.960090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.960406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.960728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.961043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.961385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.961709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.962029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.962366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.962700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.963017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.963350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.963685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.964046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.964366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.964757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.965057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.965410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.965730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.966042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 08:40:49.966294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 08:40:50.056398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO dbcounter [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Registered counter for database nova_api Aug 08 08:40:50.076582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_db.sqlalchemy.engines [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:40:50.084099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writer thread running {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:40:50.117251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO dbcounter [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Registered counter for database nova_api Aug 08 08:40:50.136886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_db.sqlalchemy.engines [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:40:50.139671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.context [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),567bf3f4-f382-4f0b-ae3e-26600132734b(cell1) {{(pid=124673) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 08:40:50.144337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writer thread running {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:40:50.144474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:40:50.144919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:40:50.146554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:40:50.147296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:40:50.147752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:40:50.149796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:40:50.151795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO dbcounter [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Registered counter for database nova_cell0 Aug 08 08:40:50.156470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO dbcounter [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Registered counter for database nova_cell1 Aug 08 08:40:50.163902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_db.sqlalchemy.engines [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:40:50.165574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_db.sqlalchemy.engines [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:40:50.171105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writer thread running {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:40:50.173679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writer thread running {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:40:50.201132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.context [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),567bf3f4-f382-4f0b-ae3e-26600132734b(cell1) {{(pid=124672) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 08:40:50.206193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:40:50.206366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:40:50.208133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:40:50.208898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:40:50.209394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:40:50.211448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:40:50.213502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO dbcounter [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Registered counter for database nova_cell0 Aug 08 08:40:50.217583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO dbcounter [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Registered counter for database nova_cell1 Aug 08 08:40:50.225117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_db.sqlalchemy.engines [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:40:50.227018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_db.sqlalchemy.engines [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:40:50.233030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writer thread running {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:40:50.235466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writer thread running {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:40:50.317478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO dbcounter [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Registered counter for database nova_cell0 Aug 08 08:40:50.325713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_db.sqlalchemy.engines [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:40:50.330589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writer thread running {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:40:50.380761 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO dbcounter [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Registered counter for database nova_cell0 Aug 08 08:40:50.387900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_db.sqlalchemy.engines [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 08:40:50.393322 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writer thread running {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 08:40:50.652493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: WARNING keystonemiddleware.auth_token [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 08:40:50.660639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: WARNING keystonemiddleware.auth_token [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 08:40:50.721675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: WARNING keystonemiddleware.auth_token [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 08:40:50.729041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: WARNING keystonemiddleware.auth_token [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 08:40:51.005051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: WARNING keystonemiddleware.auth_token [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 08:40:51.011309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: WARNING keystonemiddleware.auth_token [None req-e77b9bc7-9848-4e32-ba14-cc2635dafb17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 08:40:51.018535 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555f9a9159c0 pid: 124673 (default app) Aug 08 08:40:51.075884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: WARNING keystonemiddleware.auth_token [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 08:40:51.082636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: WARNING keystonemiddleware.auth_token [None req-328a427a-94c2-49e5-b996-d4ee6f963ec3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 08:40:51.088736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555f9a9159c0 pid: 124672 (default app) Aug 08 08:41:27.232985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=3 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:41:27.235609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=3 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:41:27.236498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=3 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:41:27.237875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=3 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:41:28.139445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6d06e00e-5abe-4cc6-8c8d-3211f0992e5a tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Action: 'create', calling method: .version_select at 0x7f4797b90e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1096702200"}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:41:30.047043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6d06e00e-5abe-4cc6-8c8d-3211f0992e5a tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.831518 Aug 08 08:41:30.052671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Aug 8 08:41:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2835 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 08:41:30.362752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-176ed986-000e-4568-bccd-76e030fa4d3e tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797c73940>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:30.398735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=3 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:41:30.399905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=3 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:41:30.401394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=3 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:41:30.402498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=3 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:41:31.198917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-176ed986-000e-4568-bccd-76e030fa4d3e tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d" status: 200 len: 345 microversion: 2.1 time: 1.136110 Aug 08 08:41:31.199499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1/2] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:41:30 2022] GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d => generated 345 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:41:32.213871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-24228321-4079-4a27-adf1-a49834c4f8b6 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a8bca0>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:32.322373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-24228321-4079-4a27-adf1-a49834c4f8b6 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d" status: 200 len: 346 microversion: 2.1 time: 0.113230 Aug 08 08:41:32.331133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:41:32 2022] GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d => generated 346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:41:32.337636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-aa427c8d-c10c-4b19-8a48-c6182611e1cd tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Action: 'create', calling method: .version_select at 0x7f4797ac4c10>, body: {"snapshot": {"volume_id": "dc521dd5-dad4-44f8-b021-fda9d8416c8d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1697168777"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:41:33.063310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-aa427c8d-c10c-4b19-8a48-c6182611e1cd tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.730654 Aug 08 08:41:33.064347 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 2/4] 10.222.0.33 () {60 vars in 1162 bytes} [Mon Aug 8 08:41:32 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:41:33.076483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-003acdcc-a3e9-4f1b-b655-b11c0fd81bc8 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a293a0>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:33.212749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-003acdcc-a3e9-4f1b-b655-b11c0fd81bc8 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478" status: 200 len: 287 microversion: 2.1 time: 0.140484 Aug 08 08:41:33.213527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 3/5] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 08:41:33 2022] GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 => generated 287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:41:33.228621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-84ceaaf5-72c0-424e-905c-8ff9ca484d89 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a0f9d0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:33.321093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-84ceaaf5-72c0-424e-905c-8ff9ca484d89 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.098376 Aug 08 08:41:33.321889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 3/6] 10.222.0.33 () {58 vars in 1140 bytes} [Mon Aug 8 08:41:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:41:33.333835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-90f62b8c-1621-42f0-aa9f-c79c2bf34e3b tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a29af0>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:33.395117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-90f62b8c-1621-42f0-aa9f-c79c2bf34e3b tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478" status: 200 len: 287 microversion: 2.1 time: 0.064382 Aug 08 08:41:33.395749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 08:41:33 2022] GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:41:34.411837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-76a1f0d7-5e6f-4fd6-a0db-f1e4ed4cf4bf tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797bfed30>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:34.477591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-76a1f0d7-5e6f-4fd6-a0db-f1e4ed4cf4bf tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478" status: 200 len: 287 microversion: 2.1 time: 0.072139 Aug 08 08:41:34.481913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 08:41:34 2022] GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:41:35.496090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-935492f0-85db-4e57-ab43-ff5386d05cb0 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a8bd30>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:35.625125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-935492f0-85db-4e57-ab43-ff5386d05cb0 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478" status: 200 len: 287 microversion: 2.1 time: 0.134112 Aug 08 08:41:35.626052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 5/9] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 08:41:35 2022] GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 => generated 287 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:41:36.638793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d72f9823-6f8b-468a-8626-311451678285 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a2c040>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:36.725011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d72f9823-6f8b-468a-8626-311451678285 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478" status: 200 len: 288 microversion: 2.1 time: 0.090174 Aug 08 08:41:36.726231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 5/10] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 08:41:36 2022] GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 => generated 288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:41:36.747366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7056104f-99c3-49b5-9fee-8f7d870ae76b tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a29a60>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:36.943871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7056104f-99c3-49b5-9fee-8f7d870ae76b tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478" status: 202 len: 0 microversion: 2.1 time: 0.201746 Aug 08 08:41:36.944754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 6/11] 10.222.0.33 () {58 vars in 1254 bytes} [Mon Aug 8 08:41:36 2022] DELETE /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:41:36.960664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6f0987f6-75c5-4374-a10f-fc90e4f36098 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a2c700>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:37.034104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6f0987f6-75c5-4374-a10f-fc90e4f36098 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478" status: 200 len: 287 microversion: 2.1 time: 0.082953 Aug 08 08:41:37.036019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 08:41:36 2022] GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:41:38.051608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f98e222f-c2b1-4b88-9ed6-560a7ff2f2c7 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a29310>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:38.380989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f98e222f-c2b1-4b88-9ed6-560a7ff2f2c7 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478" status: 200 len: 287 microversion: 2.1 time: 0.337674 Aug 08 08:41:38.387087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 08:41:38 2022] GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 => generated 287 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:41:38.611305 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6ca5af24-d9c6-4de4-b536-a1ca9366da11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Action: 'create', calling method: .version_select at 0x7f479839d040>, body: {"keypair": {"name": "tempest-keypair-544979144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdspv0JyG5xYXyDQydEv3Y7FRdYsT9wcaM18xShrL7J2WxWjJQpOCHwtkqOqllGua3XbbAZX7gtssPjHJ9hOHitxNeNR1O1MZ1rB9khkc1v9KlhkOvdInJ4WIR66drrrw=="}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:41:38.687689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-6ca5af24-d9c6-4de4-b536-a1ca9366da11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Getting quotas for project 2841a629bc1f4885a356218c2d0721b7. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:41:38.697251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-6ca5af24-d9c6-4de4-b536-a1ca9366da11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Getting quotas for user b3e5a78c3b6c48d9a4aed7d36fd54736 and project 2841a629bc1f4885a356218c2d0721b7. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:41:38.831093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6ca5af24-d9c6-4de4-b536-a1ca9366da11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.428169 Aug 08 08:41:38.831093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 7/14] 10.222.0.33 () {62 vars in 1200 bytes} [Mon Aug 8 08:41:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 430 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 08:41:39.395389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f0d397e2-7633-4ffc-b534-5612a4d37bce tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a291f0>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:39.444604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f0d397e2-7633-4ffc-b534-5612a4d37bce tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478" status: 200 len: 287 microversion: 2.1 time: 0.053812 Aug 08 08:41:39.445402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 8/15] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 08:41:39 2022] GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:41:40.461272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6c2e776a-676e-46d2-b2ef-ea6fc6221722 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f47971a7310>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:40.610049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-6c2e776a-676e-46d2-b2ef-ea6fc6221722 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] HTTP exception thrown: Snapshot bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 could not be found. Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6c2e776a-676e-46d2-b2ef-ea6fc6221722 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Request method failure captured: Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 HTTP/1.1 Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8Mw31y8JH1V9LBfc7Q0hFMqsq7fBW3E6yBC_MZt_sLPSiKPhrrWlUthmI75c0Xho_Vuv4OyDLYZmr7WoiqnX0KHAyUKv_5XIQeksSu3zFm5P8ZKi5dMYlOJSFgyKD5YJsOpaYBdLXvQlThuDGaBJRKeJXHbCXBDkqLK2D-g3sV22WLY Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 0758667b3cf74cce904ee7f18a7784fa Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:41:40.619151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 0758667b3cf74cce904ee7f18a7784fa Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-VolumesSnapshotsTestJSON-1197683982-project Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 05eb49c5c8834bbc866e2e636c76d7a4 Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1197683982-project Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Snapshot bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 could not be found. Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478'} Aug 08 08:41:40.620438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 could not be found. (HTTP 404) (Request-ID: req-dae9efc9-9038-4302-a82a-3f38ac734a67) Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:40.621232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 08:41:40.622250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 could not be found. Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 08 08:41:40.623300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:41:40.625323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 could not be found. Aug 08 08:41:40.625323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:40.625323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:40.625323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:40.625323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:40.625323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:41:40.625323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:41:40.625323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:41:40.625323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:41:40.625323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 could not be found. Aug 08 08:41:40.625323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:40.629092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6c2e776a-676e-46d2-b2ef-ea6fc6221722 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Returning 404 to user: Snapshot bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:41:40.629092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6c2e776a-676e-46d2-b2ef-ea6fc6221722 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478" status: 404 len: 111 microversion: 2.1 time: 0.172667 Aug 08 08:41:40.629992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1251 bytes} [Mon Aug 8 08:41:40 2022] GET /compute/v2.1/os-snapshots/bc9e76c5-aa0c-4299-9c1c-20ccc1c7f478 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:41:40.636759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-63b2aee4-b099-4cd1-ae8b-4003db69748a tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a298b0>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:40.968364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-63b2aee4-b099-4cd1-ae8b-4003db69748a tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d" status: 202 len: 0 microversion: 2.1 time: 0.330161 Aug 08 08:41:40.968364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 9/17] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 08:41:40 2022] DELETE /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:41:40.972825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9140a30b-768b-488c-a310-38445e8ea285 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f479710e5e0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:41.099028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9140a30b-768b-488c-a310-38445e8ea285 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d" status: 200 len: 345 microversion: 2.1 time: 0.130624 Aug 08 08:41:41.100033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 9/18] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:41:40 2022] GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d => generated 345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:41:42.114534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f3121933-1d54-48fc-929e-dd7824538b9d tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797a8ba60>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:42.160151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-f3121933-1d54-48fc-929e-dd7824538b9d tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] HTTP exception thrown: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f3121933-1d54-48fc-929e-dd7824538b9d tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Request method failure captured: Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d HTTP/1.1 Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8Mw31y8JH1V9LBfc7Q0hFMqsq7fBW3E6yBC_MZt_sLPSiKPhrrWlUthmI75c0Xho_Vuv4OyDLYZmr7WoiqnX0KHAyUKv_5XIQeksSu3zFm5P8ZKi5dMYlOJSFgyKD5YJsOpaYBdLXvQlThuDGaBJRKeJXHbCXBDkqLK2D-g3sV22WLY Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 0758667b3cf74cce904ee7f18a7784fa Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:41:42.175203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 0758667b3cf74cce904ee7f18a7784fa Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-VolumesSnapshotsTestJSON-1197683982-project Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 05eb49c5c8834bbc866e2e636c76d7a4 Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1197683982-project Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': 'dc521dd5-dad4-44f8-b021-fda9d8416c8d'} Aug 08 08:41:42.176520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. (HTTP 404) (Request-ID: req-9b6a0284-b439-4374-a2fe-3f13fcb4f601) Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:42.177506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 08:41:42.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 08:41:42.179611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f3121933-1d54-48fc-929e-dd7824538b9d tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Returning 404 to user: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:41:42.180661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f3121933-1d54-48fc-929e-dd7824538b9d tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d" status: 404 len: 109 microversion: 2.1 time: 0.070187 Aug 08 08:41:42.181640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 10/19] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:41:42 2022] GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:41:42.195064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f995f57e-4ff3-4eac-872e-bbcd9b4aba9c tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f479710e0d0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:42.241162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-f995f57e-4ff3-4eac-872e-bbcd9b4aba9c tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] HTTP exception thrown: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f995f57e-4ff3-4eac-872e-bbcd9b4aba9c tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Request method failure captured: Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: DELETE /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d HTTP/1.1 Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8Mw31y8JH1V9LBfc7Q0hFMqsq7fBW3E6yBC_MZt_sLPSiKPhrrWlUthmI75c0Xho_Vuv4OyDLYZmr7WoiqnX0KHAyUKv_5XIQeksSu3zFm5P8ZKi5dMYlOJSFgyKD5YJsOpaYBdLXvQlThuDGaBJRKeJXHbCXBDkqLK2D-g3sV22WLY Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 0758667b3cf74cce904ee7f18a7784fa Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:41:42.243489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 0758667b3cf74cce904ee7f18a7784fa Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-VolumesSnapshotsTestJSON-1197683982-project Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 05eb49c5c8834bbc866e2e636c76d7a4 Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1197683982-project Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'dc521dd5-dad4-44f8-b021-fda9d8416c8d'} Aug 08 08:41:42.254096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. (HTTP 404) (Request-ID: req-7f595842-1717-45d2-8376-90fb511d8e26) Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:42.255012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 08:41:42.256006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 08:41:42.257025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f995f57e-4ff3-4eac-872e-bbcd9b4aba9c tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Returning 404 to user: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f995f57e-4ff3-4eac-872e-bbcd9b4aba9c tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d" status: 404 len: 109 microversion: 2.1 time: 0.053837 Aug 08 08:41:42.258740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 10/20] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 08:41:42 2022] DELETE /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:41:42.262348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-97582ca6-7a42-48db-ad80-f14851173af0 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Calling method '.version_select at 0x7f4797998550>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:42.323221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-97582ca6-7a42-48db-ad80-f14851173af0 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] HTTP exception thrown: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-97582ca6-7a42-48db-ad80-f14851173af0 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Request method failure captured: Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d HTTP/1.1 Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8Mw31y8JH1V9LBfc7Q0hFMqsq7fBW3E6yBC_MZt_sLPSiKPhrrWlUthmI75c0Xho_Vuv4OyDLYZmr7WoiqnX0KHAyUKv_5XIQeksSu3zFm5P8ZKi5dMYlOJSFgyKD5YJsOpaYBdLXvQlThuDGaBJRKeJXHbCXBDkqLK2D-g3sV22WLY Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 0758667b3cf74cce904ee7f18a7784fa Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:41:42.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0758667b3cf74cce904ee7f18a7784fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 0758667b3cf74cce904ee7f18a7784fa Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1197683982 Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-VolumesSnapshotsTestJSON-1197683982-project Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 05eb49c5c8834bbc866e2e636c76d7a4 Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1197683982-project Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': 'dc521dd5-dad4-44f8-b021-fda9d8416c8d'} Aug 08 08:41:42.329731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. (HTTP 404) (Request-ID: req-cbaae874-bc17-4db0-a052-33109860f6ce) Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:42.330337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 08:41:42.331268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 08:41:42.332257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-97582ca6-7a42-48db-ad80-f14851173af0 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] Returning 404 to user: Volume dc521dd5-dad4-44f8-b021-fda9d8416c8d could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:41:42.333139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-97582ca6-7a42-48db-ad80-f14851173af0 tempest-VolumesSnapshotsTestJSON-1197683982 tempest-VolumesSnapshotsTestJSON-1197683982-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d" status: 404 len: 109 microversion: 2.1 time: 0.073969 Aug 08 08:41:42.340543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 11/21] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:41:42 2022] GET /compute/v2.1/os-volumes/dc521dd5-dad4-44f8-b021-fda9d8416c8d => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:41:42.369803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-160156156", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "networks": [{"uuid": "4083bfb6-f11a-43fb-9704-367407235be7"}]}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:41:42.577389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] validate_networks() for [('4083bfb6-f11a-43fb-9704-367407235be7', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:41:44.711883 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:41:44.713052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:41:44.713567 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:41:44.713991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:41:44.714440 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:41:44.727122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:44.731590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:44.731590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:44.731590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:44.731590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:44.732002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:44.761562 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Getting quotas for project cee46083a26948a9a4aba2068f5c816c. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:41:44.767114 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Getting quotas for user 489aa74b7ab34d5789416739b8751473 and project cee46083a26948a9a4aba2068f5c816c. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:41:44.780334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:41:44.783769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:41:44.975836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9d22773a-a378-43b9-a17f-fa458d8620a7 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.698419 Aug 08 08:41:44.997791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-aed3af3f-463e-4947-aefd-98ae10bb99a6 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:44.998631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-aed3af3f-463e-4947-aefd-98ae10bb99a6 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:45.004736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 11/22] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:41:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 08:41:45.227757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-aed3af3f-463e-4947-aefd-98ae10bb99a6 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:45.259126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-aed3af3f-463e-4947-aefd-98ae10bb99a6 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1214 microversion: 2.1 time: 0.270541 Aug 08 08:41:45.279499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 12/23] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:44 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1214 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:41:46.292537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e564ed08-bfce-4591-9ba9-3eb0483edfc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:46.293184 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e564ed08-bfce-4591-9ba9-3eb0483edfc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:46.540056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e564ed08-bfce-4591-9ba9-3eb0483edfc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:46.562632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e564ed08-bfce-4591-9ba9-3eb0483edfc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1214 microversion: 2.1 time: 0.273900 Aug 08 08:41:46.566477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 12/24] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:46 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1214 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:41:47.584220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c1ac5559-446a-4da9-a6df-633a40a78e2e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:47.584828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c1ac5559-446a-4da9-a6df-633a40a78e2e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:47.727806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c1ac5559-446a-4da9-a6df-633a40a78e2e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:47.744216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c1ac5559-446a-4da9-a6df-633a40a78e2e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1214 microversion: 2.1 time: 0.163734 Aug 08 08:41:47.745211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 13/25] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:47 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:41:48.172249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-950049074", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:41:48.245372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-75693e5d-7403-42b0-ba4c-302200560cb8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Action: 'create', calling method: .version_select at 0x7f4797961430>, body: {"keypair": {"name": "tempest-keypair-364068907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAawYZEnlWRAnoh7bauI1qcMHCdh8xQbHp884wVkYD6wAtYljyZM/PGCbkPCzgXwkwj6pyRKdAdWFSkCYYlgK4r7UcsyaWgMnOmNScMc6Bdnh5SU7BiI/Dl9SGS3ZgPpKQ=="}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:41:48.273875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] validate_networks() for [('cceb7cf5-55a5-4f06-9402-fd48dc2229c9', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:41:48.415112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-75693e5d-7403-42b0-ba4c-302200560cb8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Getting quotas for project 734d6a79fd5845f19569b2c2825fb38c. Resources: {'key_pairs'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:41:48.438539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-75693e5d-7403-42b0-ba4c-302200560cb8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Getting quotas for user 81d6a9d89e394e63ba5c8182a12b4142 and project 734d6a79fd5845f19569b2c2825fb38c. Resources: {'key_pairs'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:41:48.654851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-75693e5d-7403-42b0-ba4c-302200560cb8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.755278 Aug 08 08:41:48.660574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 14/26] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 08:41:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:41:48.666984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-862624237", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39fe2d0c-de1b-4433-9585-22bf5be0307a"}], "security_groups": [{"name": "tempest-securitygroup--1931374726"}], "key_name": "tempest-keypair-544979144", "user_data": "}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:41:49.048115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.network.neutron [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] validate_networks() for [('39fe2d0c-de1b-4433-9585-22bf5be0307a', None, None, None, None, None)] {{(pid=124673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:41:49.428008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:41:49.430432 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:41:49.431074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:41:49.431690 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:41:49.432247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:41:49.494809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:49.496697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:49.500353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:49.501230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:49.501722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:49.502219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:49.558959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Getting quotas for project 2a4e5c5a950c4047b15749aace25f46d. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:41:49.572563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Getting quotas for user 00e07188d3df4d958ce83085b7bb141a and project 2a4e5c5a950c4047b15749aace25f46d. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:41:49.618101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:41:49.620330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:41:49.765475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9e69f334-f388-4873-abdf-80a65e06d28e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.023451 Aug 08 08:41:49.769421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 13/27] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:41:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:41:49.785625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-912271b9-3537-41ac-8501-700372d943c1 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:49.786369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-912271b9-3537-41ac-8501-700372d943c1 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:49.799890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-912271b9-3537-41ac-8501-700372d943c1 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:49.806089 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-912271b9-3537-41ac-8501-700372d943c1 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:49.810033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-912271b9-3537-41ac-8501-700372d943c1 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:49.813648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-912271b9-3537-41ac-8501-700372d943c1 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:49.815501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-912271b9-3537-41ac-8501-700372d943c1 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:49.815971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-912271b9-3537-41ac-8501-700372d943c1 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:50.591566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-912271b9-3537-41ac-8501-700372d943c1 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:50.628906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-912271b9-3537-41ac-8501-700372d943c1 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1274 microversion: 2.1 time: 0.857531 Aug 08 08:41:50.629550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 14/28] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:49 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1274 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:41:51.305832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f02f2ba7-5101-4799-9426-57eb278a535d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: .version_select at 0x7f4796003c10>, body: {"keypair": {"name": "tempest-keypair-585694645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX4M0oBklCJPVVLl6OoI2j9igZezHCCcSMwAH76QJN4xPz4/lrMaOEyJ3wLGAttGv3CjCrhKOpsdGZlUdNB+jCKjSG97Rh4NL/FiAd9UeiUgx5U+IP/kOJ8bAkjEoaPhA=="}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:41:51.378080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-f02f2ba7-5101-4799-9426-57eb278a535d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:41:51.397099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-f02f2ba7-5101-4799-9426-57eb278a535d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for user 32dcdc2e24e44a07ade44d1da330a77e and project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:41:51.517516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Flavor limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:41:51.518942 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Image limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:41:51.520145 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Flavor pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:41:51.520956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Image pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:41:51.522440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:41:51.558400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:51.559738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:51.562090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:51.564131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:51.565778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:51.566490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:51.593932 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f02f2ba7-5101-4799-9426-57eb278a535d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.962875 Aug 08 08:41:51.596873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 15/29] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 08:41:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:41:51.601523 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-18909de9-e855-42bc-a88b-88f011e07c9a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:51.602165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-18909de9-e855-42bc-a88b-88f011e07c9a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:51.655851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Getting quotas for project 2841a629bc1f4885a356218c2d0721b7. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:41:51.679577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Getting quotas for user b3e5a78c3b6c48d9a4aed7d36fd54736 and project 2841a629bc1f4885a356218c2d0721b7. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:41:51.713749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Going to run 1 instances... {{(pid=124673) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:41:51.718939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:41:51.975244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3913b13e-fada-41b8-b96e-ab01d2b8b9fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.314662 Aug 08 08:41:51.976192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 15/30] 10.222.0.33 () {62 vars in 1188 bytes} [Mon Aug 8 08:41:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 3317 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 08:41:51.997280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-afa0882c-bb7a-4b3c-a804-7b56028832ac tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:51.998135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-afa0882c-bb7a-4b3c-a804-7b56028832ac tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:52.011783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-18909de9-e855-42bc-a88b-88f011e07c9a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:52.026700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afa0882c-bb7a-4b3c-a804-7b56028832ac tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:52.032614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afa0882c-bb7a-4b3c-a804-7b56028832ac tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:52.033798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afa0882c-bb7a-4b3c-a804-7b56028832ac tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:52.034816 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-18909de9-e855-42bc-a88b-88f011e07c9a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1221 microversion: 2.1 time: 0.433794 Aug 08 08:41:52.035844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afa0882c-bb7a-4b3c-a804-7b56028832ac tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:52.049534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afa0882c-bb7a-4b3c-a804-7b56028832ac tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:52.049765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 16/31] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:51 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1221 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:41:52.060318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afa0882c-bb7a-4b3c-a804-7b56028832ac tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:52.067699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-379c731a-2b90-41e7-97e1-15de9430f3f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:52.067699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-379c731a-2b90-41e7-97e1-15de9430f3f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:52.372260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-379c731a-2b90-41e7-97e1-15de9430f3f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:52.392379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-379c731a-2b90-41e7-97e1-15de9430f3f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:52.405591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-379c731a-2b90-41e7-97e1-15de9430f3f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:52.431150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-379c731a-2b90-41e7-97e1-15de9430f3f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1280 microversion: 2.20 time: 0.380598 Aug 08 08:41:52.438662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 17/32] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:41:52 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1280 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:41:52.513443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2029557414", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:41:52.722144 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] validate_networks() for [('cceb7cf5-55a5-4f06-9402-fd48dc2229c9', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:41:52.746819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-afa0882c-bb7a-4b3c-a804-7b56028832ac tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:52.776051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-afa0882c-bb7a-4b3c-a804-7b56028832ac tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1272 microversion: 2.1 time: 0.797750 Aug 08 08:41:52.779500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 16/33] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:51 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1272 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:41:53.455965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-66709fe6-5a2e-4333-8cdf-7ba0f80f042c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:53.456964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-66709fe6-5a2e-4333-8cdf-7ba0f80f042c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:53.840219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-66709fe6-5a2e-4333-8cdf-7ba0f80f042c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:53.854943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-66709fe6-5a2e-4333-8cdf-7ba0f80f042c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:53.869880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-66709fe6-5a2e-4333-8cdf-7ba0f80f042c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:53.873209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-66709fe6-5a2e-4333-8cdf-7ba0f80f042c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1280 microversion: 2.20 time: 0.419822 Aug 08 08:41:53.879913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 17/34] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:41:53 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1280 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:41:53.896945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bdd526de-3818-461b-8bfe-e5acaf772e15 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:53.899212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bdd526de-3818-461b-8bfe-e5acaf772e15 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:53.934158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bdd526de-3818-461b-8bfe-e5acaf772e15 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:53.939363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bdd526de-3818-461b-8bfe-e5acaf772e15 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:53.940186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bdd526de-3818-461b-8bfe-e5acaf772e15 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:53.942357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bdd526de-3818-461b-8bfe-e5acaf772e15 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:53.944197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bdd526de-3818-461b-8bfe-e5acaf772e15 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:53.946813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bdd526de-3818-461b-8bfe-e5acaf772e15 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:54.175212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bdd526de-3818-461b-8bfe-e5acaf772e15 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:54.184945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bdd526de-3818-461b-8bfe-e5acaf772e15 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1272 microversion: 2.1 time: 0.303547 Aug 08 08:41:54.189308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 18/35] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:53 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:41:54.900140 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:54.901440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:54.916946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:54.917715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:54.918331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:54.919187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:54.919793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:54.920389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:55.055186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:55.070500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:55.082397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:55.083902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-01ae27ef-67ed-41f5-a9b5-ead239406da7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1276 microversion: 2.20 time: 0.187884 Aug 08 08:41:55.088359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 19/36] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:41:54 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:41:55.385745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:41:55.385745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:41:55.385745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:41:55.385745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:41:55.385745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:41:55.387201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:55.387201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:55.387201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:55.387201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:55.388298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:55.388298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:55.389731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-06b22b6e-6f62-4acd-8744-36f6c7248012 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:55.389731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-06b22b6e-6f62-4acd-8744-36f6c7248012 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:55.389731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-06b22b6e-6f62-4acd-8744-36f6c7248012 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:55.389731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-06b22b6e-6f62-4acd-8744-36f6c7248012 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:55.390551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-06b22b6e-6f62-4acd-8744-36f6c7248012 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:55.390551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-06b22b6e-6f62-4acd-8744-36f6c7248012 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:55.390551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-06b22b6e-6f62-4acd-8744-36f6c7248012 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:55.390551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-06b22b6e-6f62-4acd-8744-36f6c7248012 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:55.391015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Getting quotas for project 2a4e5c5a950c4047b15749aace25f46d. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:41:55.391015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Getting quotas for user 00e07188d3df4d958ce83085b7bb141a and project 2a4e5c5a950c4047b15749aace25f46d. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:41:55.391015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:41:55.391015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:41:55.391332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-06b22b6e-6f62-4acd-8744-36f6c7248012 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:55.403558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-06b22b6e-6f62-4acd-8744-36f6c7248012 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1272 microversion: 2.1 time: 0.194097 Aug 08 08:41:55.405881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 20/37] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:55 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:41:55.646837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-04af034b-e44d-43c3-9dcc-07a4ffa555ce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.151591 Aug 08 08:41:55.649943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 18/38] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:41:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 3159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 08:41:55.666441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3c618a85-eabe-4687-b186-454776e1e6fa tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:55.667130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3c618a85-eabe-4687-b186-454776e1e6fa tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:55.904479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3c618a85-eabe-4687-b186-454776e1e6fa tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:55.934566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3c618a85-eabe-4687-b186-454776e1e6fa tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1222 microversion: 2.1 time: 0.272045 Aug 08 08:41:55.935931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 21/39] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:55 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1222 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:41:56.125777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:56.130879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:56.142847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:56.143457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:56.143893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:56.149076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:56.160765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:56.167433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:56.224169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1373250097", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ad159e5-3ad2-4e99-b7fd-ee716dcb6c9e"}], "security_groups": [{"name": "tempest-securitygroup--512329670"}], "key_name": "tempest-keypair-364068907", "user_data": "}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:41:56.587672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:56.612413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:56.634308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:56.635509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-30259f19-1c54-4dd1-8419-082fc82be7ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1332 microversion: 2.20 time: 0.513808 Aug 08 08:41:56.646340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 19/40] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:41:56 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1332 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:41:56.683359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9117829a-e8da-49ef-927e-60bd8595ace2 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:56.687531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9117829a-e8da-49ef-927e-60bd8595ace2 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:56.745512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9117829a-e8da-49ef-927e-60bd8595ace2 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:56.746028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9117829a-e8da-49ef-927e-60bd8595ace2 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:56.747800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9117829a-e8da-49ef-927e-60bd8595ace2 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:56.750740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9117829a-e8da-49ef-927e-60bd8595ace2 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:56.751290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9117829a-e8da-49ef-927e-60bd8595ace2 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:56.754961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9117829a-e8da-49ef-927e-60bd8595ace2 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:58.270732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9117829a-e8da-49ef-927e-60bd8595ace2 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:58.279675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9117829a-e8da-49ef-927e-60bd8595ace2 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 1.613814 Aug 08 08:41:58.280522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 20/41] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:56 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:41:58.297297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0b1df1ae-8dd9-43e9-8eea-e0249bc63c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:58.298243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0b1df1ae-8dd9-43e9-8eea-e0249bc63c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:58.309875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b1df1ae-8dd9-43e9-8eea-e0249bc63c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:58.311061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b1df1ae-8dd9-43e9-8eea-e0249bc63c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:58.316536 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b1df1ae-8dd9-43e9-8eea-e0249bc63c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:58.317676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b1df1ae-8dd9-43e9-8eea-e0249bc63c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:58.318354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b1df1ae-8dd9-43e9-8eea-e0249bc63c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:58.318998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b1df1ae-8dd9-43e9-8eea-e0249bc63c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:58.337057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.network.neutron [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] validate_networks() for [('6ad159e5-3ad2-4e99-b7fd-ee716dcb6c9e', None, None, None, None, None)] {{(pid=124673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:41:58.602157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0b1df1ae-8dd9-43e9-8eea-e0249bc63c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:58.626046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0b1df1ae-8dd9-43e9-8eea-e0249bc63c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1218 microversion: 2.1 time: 0.339396 Aug 08 08:41:58.628320 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 21/42] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:58 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1218 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:41:58.647216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:58.648264 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:58.663318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:58.664091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:58.666729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:58.669304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:58.669972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:58.671179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:58.801775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:58.811535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:58.819451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:58.820934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-37a49acd-619f-4515-a63f-4537bb033d62 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1338 microversion: 2.20 time: 0.193333 Aug 08 08:41:58.838288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 22/43] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:41:58 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:41:59.306166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d575d5c6-3e64-462f-bfe8-03ee5fcaeade tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:59.306778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d575d5c6-3e64-462f-bfe8-03ee5fcaeade tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:59.326434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d575d5c6-3e64-462f-bfe8-03ee5fcaeade tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:59.333973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d575d5c6-3e64-462f-bfe8-03ee5fcaeade tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:59.334670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d575d5c6-3e64-462f-bfe8-03ee5fcaeade tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:59.335634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d575d5c6-3e64-462f-bfe8-03ee5fcaeade tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:59.343022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d575d5c6-3e64-462f-bfe8-03ee5fcaeade tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:59.343572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d575d5c6-3e64-462f-bfe8-03ee5fcaeade tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:59.888429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d575d5c6-3e64-462f-bfe8-03ee5fcaeade tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:41:59.898105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d575d5c6-3e64-462f-bfe8-03ee5fcaeade tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.600763 Aug 08 08:41:59.910491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 23/44] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:59 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:41:59.928991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-740f0f94-30e6-41a5-bc40-1c0f0c5963f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:41:59.946301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-740f0f94-30e6-41a5-bc40-1c0f0c5963f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:41:59.961510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-740f0f94-30e6-41a5-bc40-1c0f0c5963f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:59.962274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-740f0f94-30e6-41a5-bc40-1c0f0c5963f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:59.965989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-740f0f94-30e6-41a5-bc40-1c0f0c5963f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:41:59.967119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-740f0f94-30e6-41a5-bc40-1c0f0c5963f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:41:59.968354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-740f0f94-30e6-41a5-bc40-1c0f0c5963f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:41:59.970865 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-740f0f94-30e6-41a5-bc40-1c0f0c5963f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:00.235470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-740f0f94-30e6-41a5-bc40-1c0f0c5963f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:00.246049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-740f0f94-30e6-41a5-bc40-1c0f0c5963f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1292 microversion: 2.1 time: 0.326006 Aug 08 08:42:00.255190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 24/45] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:41:59 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1292 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:00.261516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:00.262255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:00.266604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:00.285917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:00.286812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:00.287530 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:00.289032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:00.289775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:00.290404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:00.475822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Flavor limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:42:00.476357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Image limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:42:00.476950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Flavor pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:42:00.478662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Image pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:42:00.479193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:42:00.496797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:00.504708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:00.513380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:00.514165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:00.515840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:00.517602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:00.525924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:00.536625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:00.538830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:00.540308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6ff08a55-92f1-45c7-a700-1da98084e3ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1338 microversion: 2.20 time: 0.282704 Aug 08 08:42:00.563699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 25/46] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:00 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1338 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:00.593742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Getting quotas for project 734d6a79fd5845f19569b2c2825fb38c. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:42:00.597641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Getting quotas for user 81d6a9d89e394e63ba5c8182a12b4142 and project 734d6a79fd5845f19569b2c2825fb38c. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:42:00.628888 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Going to run 1 instances... {{(pid=124673) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:42:00.631265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:42:00.838406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d1e9e556-0414-46cb-8327-079c331a72b2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.618974 Aug 08 08:42:00.839533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 22/47] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:41:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 4621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:42:00.851959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b290a210-550f-4b6a-8890-d372a6890f96 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:00.852687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b290a210-550f-4b6a-8890-d372a6890f96 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:00.927085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2e860bd8-cacf-4cb6-bcd5-275534a4b46c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:00.929306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2e860bd8-cacf-4cb6-bcd5-275534a4b46c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:00.948181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e860bd8-cacf-4cb6-bcd5-275534a4b46c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:00.949023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e860bd8-cacf-4cb6-bcd5-275534a4b46c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:00.949689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e860bd8-cacf-4cb6-bcd5-275534a4b46c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:00.950583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e860bd8-cacf-4cb6-bcd5-275534a4b46c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:00.951277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e860bd8-cacf-4cb6-bcd5-275534a4b46c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:00.952552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e860bd8-cacf-4cb6-bcd5-275534a4b46c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:01.202119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b290a210-550f-4b6a-8890-d372a6890f96 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:01.209287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=33 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:01.215754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b290a210-550f-4b6a-8890-d372a6890f96 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1237 microversion: 2.1 time: 0.364227 Aug 08 08:42:01.215754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 26/48] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:00 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1237 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:01.269642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-162d1bdb-0e5d-4646-9e4b-7442f26e630e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:01.270312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-162d1bdb-0e5d-4646-9e4b-7442f26e630e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:01.284803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162d1bdb-0e5d-4646-9e4b-7442f26e630e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:01.285343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162d1bdb-0e5d-4646-9e4b-7442f26e630e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:01.289126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162d1bdb-0e5d-4646-9e4b-7442f26e630e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:01.290014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162d1bdb-0e5d-4646-9e4b-7442f26e630e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:01.290488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162d1bdb-0e5d-4646-9e4b-7442f26e630e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:01.295300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162d1bdb-0e5d-4646-9e4b-7442f26e630e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:01.909611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-162d1bdb-0e5d-4646-9e4b-7442f26e630e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:01.935776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-162d1bdb-0e5d-4646-9e4b-7442f26e630e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1280 microversion: 2.1 time: 0.671580 Aug 08 08:42:01.942341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 27/49] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:01 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1280 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:01.950389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:01.951810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:01.980984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:01.982487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:01.986421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:01.986421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:01.986421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:01.986421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:02.048088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2e860bd8-cacf-4cb6-bcd5-275534a4b46c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:02.070228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2e860bd8-cacf-4cb6-bcd5-275534a4b46c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 1.146764 Aug 08 08:42:02.070228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 23/50] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:00 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:02.279057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:02.301569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:02.308222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:02.312423 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1ea38b23-89d4-4863-9714-f90130c67fca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1338 microversion: 2.20 time: 0.367364 Aug 08 08:42:02.352718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 28/51] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:01 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1338 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:02.379474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1758308d-08d4-419b-81bf-3d86a9cb8fb0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:02.382414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1758308d-08d4-419b-81bf-3d86a9cb8fb0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:02.527299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1758308d-08d4-419b-81bf-3d86a9cb8fb0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:02.544819 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1758308d-08d4-419b-81bf-3d86a9cb8fb0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1237 microversion: 2.1 time: 0.187790 Aug 08 08:42:02.547620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 29/52] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:02 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1237 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:02.568020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-414fc741-61ca-4c05-a4c5-dbe3049be2c8 req-2a5d7989-82e5-4b71-a2af-82eb129e6b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c8af4b-cc42-4abc-9451-141a3b8d7f0a", "tag": "18ac550c-5a89-4fc0-8a55-4e35711b1e3c"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:02.582302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-672822104", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fbd2a5d-fa4b-468d-80da-6dad72f31b93"}], "security_groups": [{"name": "tempest-securitygroup--1281869034"}], "key_name": "tempest-keypair-585694645", "user_data": "}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:02.612740 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-414fc741-61ca-4c05-a4c5-dbe3049be2c8 req-2a5d7989-82e5-4b71-a2af-82eb129e6b1d service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:02.621038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-414fc741-61ca-4c05-a4c5-dbe3049be2c8 req-2a5d7989-82e5-4b71-a2af-82eb129e6b1d service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:02.623337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-414fc741-61ca-4c05-a4c5-dbe3049be2c8 req-2a5d7989-82e5-4b71-a2af-82eb129e6b1d service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:02.708604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-414fc741-61ca-4c05-a4c5-dbe3049be2c8 req-2a5d7989-82e5-4b71-a2af-82eb129e6b1d service nova] Creating event network-changed:18ac550c-5a89-4fc0-8a55-4e35711b1e3c for instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a on hv-cinder-83697 Aug 08 08:42:02.709472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-414fc741-61ca-4c05-a4c5-dbe3049be2c8 req-2a5d7989-82e5-4b71-a2af-82eb129e6b1d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 08:42:02.710996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-414fc741-61ca-4c05-a4c5-dbe3049be2c8 req-2a5d7989-82e5-4b71-a2af-82eb129e6b1d service nova] Acquired lock "compute-rpcapi-router" {{(pid=124673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 08:42:02.716141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22bb660-bcdb-46ee-9869-d9423708fd6d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:02.716141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22bb660-bcdb-46ee-9869-d9423708fd6d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:02.716141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22bb660-bcdb-46ee-9869-d9423708fd6d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:02.718790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22bb660-bcdb-46ee-9869-d9423708fd6d None None] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:02.720524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22bb660-bcdb-46ee-9869-d9423708fd6d None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:02.721273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22bb660-bcdb-46ee-9869-d9423708fd6d None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:02.755242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.compute.rpcapi [None req-d22bb660-bcdb-46ee-9869-d9423708fd6d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 08:42:02.756630 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22bb660-bcdb-46ee-9869-d9423708fd6d None None] Releasing lock "compute-rpcapi-router" {{(pid=124673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 08:42:02.792277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d22bb660-bcdb-46ee-9869-d9423708fd6d None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.721017 Aug 08 08:42:02.793214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 24/53] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:02.940840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] validate_networks() for [('0fbd2a5d-fa4b-468d-80da-6dad72f31b93', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:42:02.968194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1e2e0a65-2e5b-47a8-b2be-486621680791 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:02.969261 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1e2e0a65-2e5b-47a8-b2be-486621680791 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:02.977602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2e0a65-2e5b-47a8-b2be-486621680791 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:02.978492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2e0a65-2e5b-47a8-b2be-486621680791 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:02.979146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2e0a65-2e5b-47a8-b2be-486621680791 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:02.981111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2e0a65-2e5b-47a8-b2be-486621680791 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:02.981870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2e0a65-2e5b-47a8-b2be-486621680791 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:02.982563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2e0a65-2e5b-47a8-b2be-486621680791 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:03.071988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1e2e0a65-2e5b-47a8-b2be-486621680791 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:03.086275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1e2e0a65-2e5b-47a8-b2be-486621680791 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1280 microversion: 2.1 time: 0.127170 Aug 08 08:42:03.090588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 25/54] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:02 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1280 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:03.105453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b598c7e7-72bf-456f-9631-4c63b3976157 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:03.108802 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b598c7e7-72bf-456f-9631-4c63b3976157 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:03.118607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b598c7e7-72bf-456f-9631-4c63b3976157 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:03.119471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b598c7e7-72bf-456f-9631-4c63b3976157 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:03.120142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b598c7e7-72bf-456f-9631-4c63b3976157 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:03.121216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b598c7e7-72bf-456f-9631-4c63b3976157 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:03.122021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b598c7e7-72bf-456f-9631-4c63b3976157 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:03.123538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b598c7e7-72bf-456f-9631-4c63b3976157 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:03.369054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b598c7e7-72bf-456f-9631-4c63b3976157 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:03.379731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b598c7e7-72bf-456f-9631-4c63b3976157 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.287632 Aug 08 08:42:03.380556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 26/55] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:03 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:03.398275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:03.403016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:03.417986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:03.418713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:03.421353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:03.422299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:03.425638 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:03.426265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:03.623340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:42:03.632903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:42:03.632903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:42:03.632903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:42:03.632903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:42:03.643696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:03.644196 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:03.644708 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:03.645811 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:03.651684 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:03.652228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:03.693411 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:42:03.699788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for user 32dcdc2e24e44a07ade44d1da330a77e and project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:42:03.736425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:42:03.738795 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:42:03.847933 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:03.856740 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:03.876660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:03.881571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-75c7159c-47e0-46a2-9cc2-7bb759cc945c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.499725 Aug 08 08:42:03.883666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 27/56] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:03 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:03.893429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cb1abc1e-6b12-409d-8abd-a97eb8686933 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:03.896290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cb1abc1e-6b12-409d-8abd-a97eb8686933 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:03.910242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb1abc1e-6b12-409d-8abd-a97eb8686933 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:03.910242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb1abc1e-6b12-409d-8abd-a97eb8686933 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:03.910242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb1abc1e-6b12-409d-8abd-a97eb8686933 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:03.911640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb1abc1e-6b12-409d-8abd-a97eb8686933 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:03.912236 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb1abc1e-6b12-409d-8abd-a97eb8686933 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:03.912936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb1abc1e-6b12-409d-8abd-a97eb8686933 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:03.959447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c05eeacb-fd9d-409d-ad98-a5e4fa0872e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.409367 Aug 08 08:42:03.960110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 30/57] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:42:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:42:03.979745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-00122fc6-8053-4fed-b6a8-1c383db655f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:03.980664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-00122fc6-8053-4fed-b6a8-1c383db655f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:04.112111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cb1abc1e-6b12-409d-8abd-a97eb8686933 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:04.115808 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-00122fc6-8053-4fed-b6a8-1c383db655f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:04.123354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cb1abc1e-6b12-409d-8abd-a97eb8686933 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1241 microversion: 2.1 time: 0.235710 Aug 08 08:42:04.125130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-00122fc6-8053-4fed-b6a8-1c383db655f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1240 microversion: 2.1 time: 0.154885 Aug 08 08:42:04.126743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 31/58] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:03 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1240 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:04.129469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 28/59] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:03 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1241 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:04.141260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d60b77bf-9b06-47fd-9fba-a785def8f897 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:04.145628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d60b77bf-9b06-47fd-9fba-a785def8f897 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:04.158864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d60b77bf-9b06-47fd-9fba-a785def8f897 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:04.159670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d60b77bf-9b06-47fd-9fba-a785def8f897 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:04.161252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d60b77bf-9b06-47fd-9fba-a785def8f897 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:04.162268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d60b77bf-9b06-47fd-9fba-a785def8f897 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:04.163016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d60b77bf-9b06-47fd-9fba-a785def8f897 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:04.164031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d60b77bf-9b06-47fd-9fba-a785def8f897 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:04.364315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d60b77bf-9b06-47fd-9fba-a785def8f897 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:04.373348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d60b77bf-9b06-47fd-9fba-a785def8f897 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.245104 Aug 08 08:42:04.374041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 32/60] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:04 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:04.403938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-07e6f54c-aa15-45e5-9e66-b65b3b911708 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:04.406038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-07e6f54c-aa15-45e5-9e66-b65b3b911708 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:04.418594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07e6f54c-aa15-45e5-9e66-b65b3b911708 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:04.423793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07e6f54c-aa15-45e5-9e66-b65b3b911708 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:04.423793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07e6f54c-aa15-45e5-9e66-b65b3b911708 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:04.423793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07e6f54c-aa15-45e5-9e66-b65b3b911708 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:04.423793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07e6f54c-aa15-45e5-9e66-b65b3b911708 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:04.424771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07e6f54c-aa15-45e5-9e66-b65b3b911708 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:04.613692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-07e6f54c-aa15-45e5-9e66-b65b3b911708 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:04.637315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-07e6f54c-aa15-45e5-9e66-b65b3b911708 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.237117 Aug 08 08:42:04.642448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 29/61] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:04 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:04.848571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-2f40aee7-ddd8-4ff1-8135-fabdc3236ae3 req-048128f1-8831-4660-85ee-bc815ba0c47d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ec8f653-4fc1-4f77-a832-768f73782b17", "tag": "a272eb6d-b0c0-4037-a16a-be5cad0542fd"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:04.866175 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2f40aee7-ddd8-4ff1-8135-fabdc3236ae3 req-048128f1-8831-4660-85ee-bc815ba0c47d service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:04.866880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2f40aee7-ddd8-4ff1-8135-fabdc3236ae3 req-048128f1-8831-4660-85ee-bc815ba0c47d service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:04.867659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2f40aee7-ddd8-4ff1-8135-fabdc3236ae3 req-048128f1-8831-4660-85ee-bc815ba0c47d service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:04.893789 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-2f40aee7-ddd8-4ff1-8135-fabdc3236ae3 req-048128f1-8831-4660-85ee-bc815ba0c47d service nova] Creating event network-changed:a272eb6d-b0c0-4037-a16a-be5cad0542fd for instance 1ec8f653-4fc1-4f77-a832-768f73782b17 on hv-cinder-83697 Aug 08 08:42:04.894533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2f40aee7-ddd8-4ff1-8135-fabdc3236ae3 req-048128f1-8831-4660-85ee-bc815ba0c47d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124672) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 08:42:04.895513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2f40aee7-ddd8-4ff1-8135-fabdc3236ae3 req-048128f1-8831-4660-85ee-bc815ba0c47d service nova] Acquired lock "compute-rpcapi-router" {{(pid=124672) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 08:42:04.896716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e295ecf9-1d2c-4be5-a269-258da1b4de4c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:04.897257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e295ecf9-1d2c-4be5-a269-258da1b4de4c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:04.901108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e295ecf9-1d2c-4be5-a269-258da1b4de4c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:04.901108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e295ecf9-1d2c-4be5-a269-258da1b4de4c None None] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:04.901108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e295ecf9-1d2c-4be5-a269-258da1b4de4c None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:04.901108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e295ecf9-1d2c-4be5-a269-258da1b4de4c None None] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:04.913044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.compute.rpcapi [None req-e295ecf9-1d2c-4be5-a269-258da1b4de4c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 08:42:04.914313 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e295ecf9-1d2c-4be5-a269-258da1b4de4c None None] Releasing lock "compute-rpcapi-router" {{(pid=124672) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 08:42:04.915428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:04.918379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:04.933410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:04.939259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:04.939925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:04.941089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:04.941800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:04.943392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:04.963055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e295ecf9-1d2c-4be5-a269-258da1b4de4c None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118713 Aug 08 08:42:04.970464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 33/62] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:05.150497 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-feff5b07-5837-48ca-abf2-191d7c308bc6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:05.151212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-feff5b07-5837-48ca-abf2-191d7c308bc6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:05.220690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:05.233734 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:05.233734 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:05.233734 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3665212e-8ad7-472a-976d-6fbdba1a64da tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.325931 Aug 08 08:42:05.252020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 30/63] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:04 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:05.275259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bcbaff25-7672-463c-98c0-2e3b2f83e532 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:05.275798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bcbaff25-7672-463c-98c0-2e3b2f83e532 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:05.282912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcbaff25-7672-463c-98c0-2e3b2f83e532 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:05.283622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcbaff25-7672-463c-98c0-2e3b2f83e532 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:05.284343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcbaff25-7672-463c-98c0-2e3b2f83e532 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:05.285244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcbaff25-7672-463c-98c0-2e3b2f83e532 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:05.285894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcbaff25-7672-463c-98c0-2e3b2f83e532 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:05.286552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcbaff25-7672-463c-98c0-2e3b2f83e532 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:05.348830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-feff5b07-5837-48ca-abf2-191d7c308bc6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:05.357714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-feff5b07-5837-48ca-abf2-191d7c308bc6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1240 microversion: 2.1 time: 0.212300 Aug 08 08:42:05.361190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 34/64] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:05 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1240 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:05.398713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f7e4e675-8fb3-4a29-b5cb-e5b79d10ca8a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:05.400137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f7e4e675-8fb3-4a29-b5cb-e5b79d10ca8a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:05.412315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bcbaff25-7672-463c-98c0-2e3b2f83e532 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:05.424242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bcbaff25-7672-463c-98c0-2e3b2f83e532 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1241 microversion: 2.1 time: 0.155520 Aug 08 08:42:05.426993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 31/65] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:05 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1241 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:05.462094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7e4e675-8fb3-4a29-b5cb-e5b79d10ca8a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:05.462708 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7e4e675-8fb3-4a29-b5cb-e5b79d10ca8a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:05.470707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7e4e675-8fb3-4a29-b5cb-e5b79d10ca8a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:05.471565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7e4e675-8fb3-4a29-b5cb-e5b79d10ca8a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:05.483169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7e4e675-8fb3-4a29-b5cb-e5b79d10ca8a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:05.483169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7e4e675-8fb3-4a29-b5cb-e5b79d10ca8a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:05.665941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c8500305-15e6-435a-92ca-aeabbd03397c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:05.666554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c8500305-15e6-435a-92ca-aeabbd03397c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:05.679838 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8500305-15e6-435a-92ca-aeabbd03397c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:05.680573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8500305-15e6-435a-92ca-aeabbd03397c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:05.681258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8500305-15e6-435a-92ca-aeabbd03397c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:05.682103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8500305-15e6-435a-92ca-aeabbd03397c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:05.682701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8500305-15e6-435a-92ca-aeabbd03397c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:05.685435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8500305-15e6-435a-92ca-aeabbd03397c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:05.720953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f7e4e675-8fb3-4a29-b5cb-e5b79d10ca8a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:05.731401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f7e4e675-8fb3-4a29-b5cb-e5b79d10ca8a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.336745 Aug 08 08:42:05.747341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 35/66] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:05 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:05.894566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c8500305-15e6-435a-92ca-aeabbd03397c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:05.903210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c8500305-15e6-435a-92ca-aeabbd03397c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.241396 Aug 08 08:42:05.905597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 32/67] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:05 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:06.287285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:06.287940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:06.305769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:06.305769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:06.305769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:06.306485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:06.307106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:06.307678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:06.381581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-09c7a575-b871-4680-bfc9-f6ddc6f93d08 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:06.382184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-09c7a575-b871-4680-bfc9-f6ddc6f93d08 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:06.415046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09c7a575-b871-4680-bfc9-f6ddc6f93d08 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:06.424111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09c7a575-b871-4680-bfc9-f6ddc6f93d08 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:06.425519 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09c7a575-b871-4680-bfc9-f6ddc6f93d08 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:06.430870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09c7a575-b871-4680-bfc9-f6ddc6f93d08 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:06.433470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09c7a575-b871-4680-bfc9-f6ddc6f93d08 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:06.437817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09c7a575-b871-4680-bfc9-f6ddc6f93d08 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:06.706038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-09c7a575-b871-4680-bfc9-f6ddc6f93d08 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:06.736836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-09c7a575-b871-4680-bfc9-f6ddc6f93d08 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1236 microversion: 2.1 time: 0.345155 Aug 08 08:42:06.742945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 33/68] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:06 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1236 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:06.763440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-aa53f907-4614-4093-9ad2-05c16483dd93 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:06.772505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-aa53f907-4614-4093-9ad2-05c16483dd93 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:06.796572 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa53f907-4614-4093-9ad2-05c16483dd93 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:06.797652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa53f907-4614-4093-9ad2-05c16483dd93 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:06.798913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa53f907-4614-4093-9ad2-05c16483dd93 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:06.800245 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa53f907-4614-4093-9ad2-05c16483dd93 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:06.801078 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa53f907-4614-4093-9ad2-05c16483dd93 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:06.801819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa53f907-4614-4093-9ad2-05c16483dd93 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:06.914355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:06.925229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:06.933301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:06.933301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e3c7ad3a-56ad-448b-99b8-6d7aa5576d75 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.653134 Aug 08 08:42:06.933301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 36/69] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:06 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:06.948606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6248ae57-c1c5-472d-8a38-96d5c8618fad tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:06.963625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6248ae57-c1c5-472d-8a38-96d5c8618fad tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:06.973031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6248ae57-c1c5-472d-8a38-96d5c8618fad tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:06.973583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6248ae57-c1c5-472d-8a38-96d5c8618fad tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:06.974020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6248ae57-c1c5-472d-8a38-96d5c8618fad tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:06.978123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6248ae57-c1c5-472d-8a38-96d5c8618fad tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:06.979747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6248ae57-c1c5-472d-8a38-96d5c8618fad tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:06.980422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6248ae57-c1c5-472d-8a38-96d5c8618fad tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:07.087161 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-aa53f907-4614-4093-9ad2-05c16483dd93 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:07.103185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-aa53f907-4614-4093-9ad2-05c16483dd93 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1233 microversion: 2.1 time: 0.350445 Aug 08 08:42:07.106649 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 34/70] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:06 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1233 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:07.125521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9c13f72f-5048-4592-8a9f-a4c87cc435e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:07.126147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9c13f72f-5048-4592-8a9f-a4c87cc435e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:07.153088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c13f72f-5048-4592-8a9f-a4c87cc435e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:07.153626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c13f72f-5048-4592-8a9f-a4c87cc435e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:07.154069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c13f72f-5048-4592-8a9f-a4c87cc435e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:07.154776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c13f72f-5048-4592-8a9f-a4c87cc435e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:07.160179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c13f72f-5048-4592-8a9f-a4c87cc435e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:07.162386 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c13f72f-5048-4592-8a9f-a4c87cc435e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:07.190143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:08.049051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6248ae57-c1c5-472d-8a38-96d5c8618fad tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:08.059060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6248ae57-c1c5-472d-8a38-96d5c8618fad tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 1.124672 Aug 08 08:42:08.059581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9c13f72f-5048-4592-8a9f-a4c87cc435e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:08.088699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 37/71] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:06 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:08.093830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9c13f72f-5048-4592-8a9f-a4c87cc435e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.980654 Aug 08 08:42:08.101265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 35/72] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:07 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:08.119764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:08.120616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:08.127846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:08.128156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-381fb4ef-c541-4a2b-85f3-b6c243314ede tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:08.129818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:08.130485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:08.130717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-381fb4ef-c541-4a2b-85f3-b6c243314ede tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:08.131381 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:08.132531 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:08.133275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:08.133866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:08.151355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381fb4ef-c541-4a2b-85f3-b6c243314ede tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:08.153815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381fb4ef-c541-4a2b-85f3-b6c243314ede tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:08.153815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381fb4ef-c541-4a2b-85f3-b6c243314ede tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:08.153815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381fb4ef-c541-4a2b-85f3-b6c243314ede tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:08.161917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381fb4ef-c541-4a2b-85f3-b6c243314ede tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:08.163698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381fb4ef-c541-4a2b-85f3-b6c243314ede tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:08.213180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:08.368789 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-381fb4ef-c541-4a2b-85f3-b6c243314ede tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:08.381859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-381fb4ef-c541-4a2b-85f3-b6c243314ede tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1300 microversion: 2.1 time: 0.290304 Aug 08 08:42:08.384771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 38/73] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:08 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1300 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:08.414993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cf21c6aa-a55a-42ce-8f2b-7d7c011b2928 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:08.417379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cf21c6aa-a55a-42ce-8f2b-7d7c011b2928 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:08.454791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf21c6aa-a55a-42ce-8f2b-7d7c011b2928 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:08.457783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf21c6aa-a55a-42ce-8f2b-7d7c011b2928 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:08.461061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf21c6aa-a55a-42ce-8f2b-7d7c011b2928 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:08.461061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf21c6aa-a55a-42ce-8f2b-7d7c011b2928 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:08.461061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf21c6aa-a55a-42ce-8f2b-7d7c011b2928 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:08.461061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf21c6aa-a55a-42ce-8f2b-7d7c011b2928 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:08.700091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cf21c6aa-a55a-42ce-8f2b-7d7c011b2928 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:08.721505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cf21c6aa-a55a-42ce-8f2b-7d7c011b2928 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1289 microversion: 2.1 time: 0.335501 Aug 08 08:42:08.722812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:08.725734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 39/74] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:08 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1289 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:08.740025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:08.746116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:08.750595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-27bac9b2-148b-460a-9634-e493ced73762 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.644572 Aug 08 08:42:08.753268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 36/75] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:08 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:08.843318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-8921c130-d505-4303-a19f-22260189b68b req-22ea982a-3dd7-4d96-8a5d-ec4c04c2e516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7125c9bf-f883-4fde-b50a-031fadb4cac1", "tag": "dec57a28-51ce-4c11-9486-8775c1cdfc54"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:08.881566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-8921c130-d505-4303-a19f-22260189b68b req-22ea982a-3dd7-4d96-8a5d-ec4c04c2e516 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:08.884097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-8921c130-d505-4303-a19f-22260189b68b req-22ea982a-3dd7-4d96-8a5d-ec4c04c2e516 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:08.884695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-8921c130-d505-4303-a19f-22260189b68b req-22ea982a-3dd7-4d96-8a5d-ec4c04c2e516 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:08.935451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-8921c130-d505-4303-a19f-22260189b68b req-22ea982a-3dd7-4d96-8a5d-ec4c04c2e516 service nova] Creating event network-changed:dec57a28-51ce-4c11-9486-8775c1cdfc54 for instance 7125c9bf-f883-4fde-b50a-031fadb4cac1 on hv-cinder-83697 Aug 08 08:42:08.952782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-8921c130-d505-4303-a19f-22260189b68b req-22ea982a-3dd7-4d96-8a5d-ec4c04c2e516 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126255 Aug 08 08:42:08.954016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 40/76] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:42:09.098480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-edcf0c9b-ffcf-423e-8b95-6bace471b4d7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:09.100265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-edcf0c9b-ffcf-423e-8b95-6bace471b4d7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:09.123217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b252e47d-94fc-4542-94f5-c9f3d52c9f91 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:09.125605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b252e47d-94fc-4542-94f5-c9f3d52c9f91 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:09.143266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b252e47d-94fc-4542-94f5-c9f3d52c9f91 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:09.144015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b252e47d-94fc-4542-94f5-c9f3d52c9f91 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:09.144616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b252e47d-94fc-4542-94f5-c9f3d52c9f91 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:09.145588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b252e47d-94fc-4542-94f5-c9f3d52c9f91 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:09.146196 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b252e47d-94fc-4542-94f5-c9f3d52c9f91 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:09.146836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b252e47d-94fc-4542-94f5-c9f3d52c9f91 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:09.157914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-edcf0c9b-ffcf-423e-8b95-6bace471b4d7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:09.158883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-edcf0c9b-ffcf-423e-8b95-6bace471b4d7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:09.159509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-edcf0c9b-ffcf-423e-8b95-6bace471b4d7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:09.160900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-edcf0c9b-ffcf-423e-8b95-6bace471b4d7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:09.161399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-edcf0c9b-ffcf-423e-8b95-6bace471b4d7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:09.161834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-edcf0c9b-ffcf-423e-8b95-6bace471b4d7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:09.587028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b252e47d-94fc-4542-94f5-c9f3d52c9f91 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:09.597296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b252e47d-94fc-4542-94f5-c9f3d52c9f91 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.478070 Aug 08 08:42:09.621303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 41/77] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:09 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:09.630149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-97c42eee-82d5-4b1d-869b-12f400db14ff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:09.657860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-97c42eee-82d5-4b1d-869b-12f400db14ff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:09.657860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97c42eee-82d5-4b1d-869b-12f400db14ff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:09.657860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97c42eee-82d5-4b1d-869b-12f400db14ff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:09.657860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97c42eee-82d5-4b1d-869b-12f400db14ff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:09.658694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97c42eee-82d5-4b1d-869b-12f400db14ff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:09.658694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97c42eee-82d5-4b1d-869b-12f400db14ff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:09.658694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97c42eee-82d5-4b1d-869b-12f400db14ff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:09.916359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-97c42eee-82d5-4b1d-869b-12f400db14ff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:09.920214 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-97c42eee-82d5-4b1d-869b-12f400db14ff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1298 microversion: 2.1 time: 0.297807 Aug 08 08:42:09.922037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 42/78] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:09 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1298 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:09.928631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ca14a7dc-8d8f-4500-86eb-81b6a69ea27f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:09.935300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ca14a7dc-8d8f-4500-86eb-81b6a69ea27f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:09.939013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca14a7dc-8d8f-4500-86eb-81b6a69ea27f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:09.939926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca14a7dc-8d8f-4500-86eb-81b6a69ea27f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:09.942631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca14a7dc-8d8f-4500-86eb-81b6a69ea27f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:09.943677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca14a7dc-8d8f-4500-86eb-81b6a69ea27f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:09.944610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca14a7dc-8d8f-4500-86eb-81b6a69ea27f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:09.945336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca14a7dc-8d8f-4500-86eb-81b6a69ea27f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:09.984957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-edcf0c9b-ffcf-423e-8b95-6bace471b4d7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:09.993683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-edcf0c9b-ffcf-423e-8b95-6bace471b4d7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.912692 Aug 08 08:42:09.995336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 37/79] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:09 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:10.000631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:10.001559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:10.009714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:10.010509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:10.011192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:10.012128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:10.012793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:10.013706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:10.084631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ca14a7dc-8d8f-4500-86eb-81b6a69ea27f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:10.092893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ca14a7dc-8d8f-4500-86eb-81b6a69ea27f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1295 microversion: 2.1 time: 0.169346 Aug 08 08:42:10.096260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 43/80] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:09 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1295 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:10.161548 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-64bebcb2-64d4-4482-97f8-8bcd3640ffea req-71bd98a7-4f66-4e67-8038-e33535304c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa423dc-c608-40ed-a783-faf7a48d13c1", "tag": "22c96d99-e75c-4e18-bb06-3b7e1fc4519b"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:10.181720 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-64bebcb2-64d4-4482-97f8-8bcd3640ffea req-71bd98a7-4f66-4e67-8038-e33535304c7c service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:10.187517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-64bebcb2-64d4-4482-97f8-8bcd3640ffea req-71bd98a7-4f66-4e67-8038-e33535304c7c service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:10.187517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-64bebcb2-64d4-4482-97f8-8bcd3640ffea req-71bd98a7-4f66-4e67-8038-e33535304c7c service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:10.203041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-64bebcb2-64d4-4482-97f8-8bcd3640ffea req-71bd98a7-4f66-4e67-8038-e33535304c7c service nova] Creating event network-changed:22c96d99-e75c-4e18-bb06-3b7e1fc4519b for instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 on hv-cinder-83697 Aug 08 08:42:10.209464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-64bebcb2-64d4-4482-97f8-8bcd3640ffea req-71bd98a7-4f66-4e67-8038-e33535304c7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114514 Aug 08 08:42:10.210596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 44/81] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:10.306224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:10.315347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:10.316842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:10.317981 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-aebcabbc-5445-4ce9-a11e-c5c6fd12d2fd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.321469 Aug 08 08:42:10.318537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 38/82] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:09 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:10.620732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b1b6642b-14e5-4bc7-b0b4-f14dfac377a8 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:10.621537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b1b6642b-14e5-4bc7-b0b4-f14dfac377a8 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:10.634266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1b6642b-14e5-4bc7-b0b4-f14dfac377a8 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:10.635887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1b6642b-14e5-4bc7-b0b4-f14dfac377a8 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:10.636480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1b6642b-14e5-4bc7-b0b4-f14dfac377a8 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:10.637532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1b6642b-14e5-4bc7-b0b4-f14dfac377a8 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:10.638463 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1b6642b-14e5-4bc7-b0b4-f14dfac377a8 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:10.639128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1b6642b-14e5-4bc7-b0b4-f14dfac377a8 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:10.898063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b1b6642b-14e5-4bc7-b0b4-f14dfac377a8 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:10.906024 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b1b6642b-14e5-4bc7-b0b4-f14dfac377a8 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.289991 Aug 08 08:42:10.906602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 45/83] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:10 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:10.945577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-58c1ef8a-407b-4835-a20f-c724444a899a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:10.946829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-58c1ef8a-407b-4835-a20f-c724444a899a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:10.949546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=24 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:10.955288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-58c1ef8a-407b-4835-a20f-c724444a899a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:10.956133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-58c1ef8a-407b-4835-a20f-c724444a899a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:10.956831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-58c1ef8a-407b-4835-a20f-c724444a899a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:10.959469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-58c1ef8a-407b-4835-a20f-c724444a899a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:10.959949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-58c1ef8a-407b-4835-a20f-c724444a899a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:10.960724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-58c1ef8a-407b-4835-a20f-c724444a899a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:11.018020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-772e6439-de56-46f6-8eb9-4330c7719fc3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:11.018726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-772e6439-de56-46f6-8eb9-4330c7719fc3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:11.032566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-772e6439-de56-46f6-8eb9-4330c7719fc3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:11.033339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-772e6439-de56-46f6-8eb9-4330c7719fc3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:11.034072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-772e6439-de56-46f6-8eb9-4330c7719fc3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:11.034956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-772e6439-de56-46f6-8eb9-4330c7719fc3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:11.035552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-772e6439-de56-46f6-8eb9-4330c7719fc3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:11.036651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-772e6439-de56-46f6-8eb9-4330c7719fc3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:11.312185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-58c1ef8a-407b-4835-a20f-c724444a899a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:11.331585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-58c1ef8a-407b-4835-a20f-c724444a899a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.391129 Aug 08 08:42:11.332089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 39/84] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:10 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:11.337452 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-beff964f-f666-43b7-9551-c39e362d8aca tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:11.338144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-beff964f-f666-43b7-9551-c39e362d8aca tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:11.349060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-beff964f-f666-43b7-9551-c39e362d8aca tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:11.355873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-beff964f-f666-43b7-9551-c39e362d8aca tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:11.355873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-beff964f-f666-43b7-9551-c39e362d8aca tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:11.355873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-beff964f-f666-43b7-9551-c39e362d8aca tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:11.355873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-beff964f-f666-43b7-9551-c39e362d8aca tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:11.356383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-beff964f-f666-43b7-9551-c39e362d8aca tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:11.509098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-772e6439-de56-46f6-8eb9-4330c7719fc3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:11.522196 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-772e6439-de56-46f6-8eb9-4330c7719fc3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.509196 Aug 08 08:42:11.522979 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 46/85] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:11 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:11.529867 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:11.532266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:11.546822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:11.547975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:11.549062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:11.550275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:11.551474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:11.552063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:11.624883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-beff964f-f666-43b7-9551-c39e362d8aca tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:11.634337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-beff964f-f666-43b7-9551-c39e362d8aca tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.301000 Aug 08 08:42:11.635029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 40/86] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:11 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:11.709902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:11.735413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:11.736948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:11.746311 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b1fad1c8-3838-4a08-8efe-454e70058348 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.221609 Aug 08 08:42:11.746896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 47/87] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:11 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:11.929377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0e2143d1-5830-4c0b-95e7-44f16186b9e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:11.929992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0e2143d1-5830-4c0b-95e7-44f16186b9e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:11.935909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2143d1-5830-4c0b-95e7-44f16186b9e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:11.937136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2143d1-5830-4c0b-95e7-44f16186b9e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:11.937605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2143d1-5830-4c0b-95e7-44f16186b9e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:11.938298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2143d1-5830-4c0b-95e7-44f16186b9e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:11.938759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2143d1-5830-4c0b-95e7-44f16186b9e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:11.939188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2143d1-5830-4c0b-95e7-44f16186b9e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:12.227491 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0e2143d1-5830-4c0b-95e7-44f16186b9e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:12.235566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0e2143d1-5830-4c0b-95e7-44f16186b9e3 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.310490 Aug 08 08:42:12.236245 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 41/88] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:11 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:12.356064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0c611c37-7249-4bd2-9228-1c54ef77f053 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:12.356692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0c611c37-7249-4bd2-9228-1c54ef77f053 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:12.363273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c611c37-7249-4bd2-9228-1c54ef77f053 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:12.363764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c611c37-7249-4bd2-9228-1c54ef77f053 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:12.364194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c611c37-7249-4bd2-9228-1c54ef77f053 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:12.364903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c611c37-7249-4bd2-9228-1c54ef77f053 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:12.365402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c611c37-7249-4bd2-9228-1c54ef77f053 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:12.365832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c611c37-7249-4bd2-9228-1c54ef77f053 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:12.542986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fd04f18e-c2a5-46ec-9d3c-7013c94a7d86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:12.544774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fd04f18e-c2a5-46ec-9d3c-7013c94a7d86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:12.551957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd04f18e-c2a5-46ec-9d3c-7013c94a7d86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:12.553296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd04f18e-c2a5-46ec-9d3c-7013c94a7d86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:12.553296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd04f18e-c2a5-46ec-9d3c-7013c94a7d86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:12.555070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd04f18e-c2a5-46ec-9d3c-7013c94a7d86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:12.555769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd04f18e-c2a5-46ec-9d3c-7013c94a7d86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:12.556438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd04f18e-c2a5-46ec-9d3c-7013c94a7d86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:12.738750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=6 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:12.856825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0c611c37-7249-4bd2-9228-1c54ef77f053 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:12.867272 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fd04f18e-c2a5-46ec-9d3c-7013c94a7d86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:12.874850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0c611c37-7249-4bd2-9228-1c54ef77f053 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.520376 Aug 08 08:42:12.876790 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 48/89] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:12 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:12.881729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fd04f18e-c2a5-46ec-9d3c-7013c94a7d86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.342201 Aug 08 08:42:12.884022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 42/90] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:12 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:12.901421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:12.903549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-201b5c12-5b7e-4958-b228-be53aef9c356 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:12.903693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:12.904554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-201b5c12-5b7e-4958-b228-be53aef9c356 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:12.914162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-201b5c12-5b7e-4958-b228-be53aef9c356 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:12.914992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-201b5c12-5b7e-4958-b228-be53aef9c356 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:12.916333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:12.917047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-201b5c12-5b7e-4958-b228-be53aef9c356 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:12.918221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:12.918673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-201b5c12-5b7e-4958-b228-be53aef9c356 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:12.919358 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-201b5c12-5b7e-4958-b228-be53aef9c356 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:12.920032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-201b5c12-5b7e-4958-b228-be53aef9c356 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:12.923526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:12.925199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:12.927070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:12.929664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:13.276881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-201b5c12-5b7e-4958-b228-be53aef9c356 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:13.285182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-201b5c12-5b7e-4958-b228-be53aef9c356 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.405207 Aug 08 08:42:13.286249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 49/91] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:12 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:13.290533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:13.301661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:13.301661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:13.302230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7751a677-b264-4ef7-a7f3-c05300de175b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.417007 Aug 08 08:42:13.306579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3509d90e-0e4b-4a96-aeb0-9cb45c4c9050 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:13.307636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3509d90e-0e4b-4a96-aeb0-9cb45c4c9050 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:13.322396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 43/92] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:12 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:13.331789 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3509d90e-0e4b-4a96-aeb0-9cb45c4c9050 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:13.332431 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3509d90e-0e4b-4a96-aeb0-9cb45c4c9050 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:13.332872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3509d90e-0e4b-4a96-aeb0-9cb45c4c9050 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:13.340892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3509d90e-0e4b-4a96-aeb0-9cb45c4c9050 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:13.340892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3509d90e-0e4b-4a96-aeb0-9cb45c4c9050 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:13.340892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3509d90e-0e4b-4a96-aeb0-9cb45c4c9050 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:13.480964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-dfd53696-636c-49bb-8efd-f8342c4e4bd5 req-7baa4442-bb5d-4459-a51c-e0e121791d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8117a4bb-5bfc-41a1-a874-72c1266a8955", "tag": "45742616-a27a-4ad1-8004-5461bd902cbb"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:13.496574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-dfd53696-636c-49bb-8efd-f8342c4e4bd5 req-7baa4442-bb5d-4459-a51c-e0e121791d04 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:13.497068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-dfd53696-636c-49bb-8efd-f8342c4e4bd5 req-7baa4442-bb5d-4459-a51c-e0e121791d04 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:13.497525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-dfd53696-636c-49bb-8efd-f8342c4e4bd5 req-7baa4442-bb5d-4459-a51c-e0e121791d04 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:13.509588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-dfd53696-636c-49bb-8efd-f8342c4e4bd5 req-7baa4442-bb5d-4459-a51c-e0e121791d04 service nova] Creating event network-changed:45742616-a27a-4ad1-8004-5461bd902cbb for instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 on hv-cinder-83697 Aug 08 08:42:13.516273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-dfd53696-636c-49bb-8efd-f8342c4e4bd5 req-7baa4442-bb5d-4459-a51c-e0e121791d04 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038720 Aug 08 08:42:13.517192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 44/93] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:42:13.573815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3509d90e-0e4b-4a96-aeb0-9cb45c4c9050 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:13.582681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-bfbcc678-26c8-467f-8091-db36128a27f8 req-fd9946bc-1554-4031-ba2a-d22447830324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fff4ce16-ea8e-4710-accb-cd6e5a31960a", "tag": "0ff18534-8066-4dea-9370-fd1122cb8da2"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:13.588191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3509d90e-0e4b-4a96-aeb0-9cb45c4c9050 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.300731 Aug 08 08:42:13.589100 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 50/94] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:13 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:13.608391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-bfbcc678-26c8-467f-8091-db36128a27f8 req-fd9946bc-1554-4031-ba2a-d22447830324 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:13.609467 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-bfbcc678-26c8-467f-8091-db36128a27f8 req-fd9946bc-1554-4031-ba2a-d22447830324 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:13.610317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-bfbcc678-26c8-467f-8091-db36128a27f8 req-fd9946bc-1554-4031-ba2a-d22447830324 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:13.638589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-bfbcc678-26c8-467f-8091-db36128a27f8 req-fd9946bc-1554-4031-ba2a-d22447830324 service nova] Creating event network-changed:0ff18534-8066-4dea-9370-fd1122cb8da2 for instance fff4ce16-ea8e-4710-accb-cd6e5a31960a on hv-cinder-83697 Aug 08 08:42:13.643864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-bfbcc678-26c8-467f-8091-db36128a27f8 req-fd9946bc-1554-4031-ba2a-d22447830324 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068397 Aug 08 08:42:13.644465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 45/95] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:42:13.896233 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ef6fe7d2-4291-4514-afb2-ff07858eee81 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:13.896885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ef6fe7d2-4291-4514-afb2-ff07858eee81 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:13.903204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6fe7d2-4291-4514-afb2-ff07858eee81 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:13.903698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6fe7d2-4291-4514-afb2-ff07858eee81 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:13.904145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6fe7d2-4291-4514-afb2-ff07858eee81 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:13.905411 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6fe7d2-4291-4514-afb2-ff07858eee81 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:13.906001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6fe7d2-4291-4514-afb2-ff07858eee81 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:13.906519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6fe7d2-4291-4514-afb2-ff07858eee81 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:13.910010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ed19e754-4ada-404c-9b89-e99042f9af60 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:13.913165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ed19e754-4ada-404c-9b89-e99042f9af60 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:13.920000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed19e754-4ada-404c-9b89-e99042f9af60 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:13.921796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed19e754-4ada-404c-9b89-e99042f9af60 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:13.924115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed19e754-4ada-404c-9b89-e99042f9af60 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:13.925122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed19e754-4ada-404c-9b89-e99042f9af60 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:13.926692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed19e754-4ada-404c-9b89-e99042f9af60 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:13.927200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed19e754-4ada-404c-9b89-e99042f9af60 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:14.104278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ef6fe7d2-4291-4514-afb2-ff07858eee81 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:14.112591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ef6fe7d2-4291-4514-afb2-ff07858eee81 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.220096 Aug 08 08:42:14.113186 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 51/96] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:13 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:14.116594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ed19e754-4ada-404c-9b89-e99042f9af60 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:14.125760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ed19e754-4ada-404c-9b89-e99042f9af60 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.223453 Aug 08 08:42:14.128839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 46/97] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:13 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:14.311691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d178834d-13b1-465c-b4f3-dcb7f53b2c83 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:14.312339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d178834d-13b1-465c-b4f3-dcb7f53b2c83 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:14.318339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d178834d-13b1-465c-b4f3-dcb7f53b2c83 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:14.318832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d178834d-13b1-465c-b4f3-dcb7f53b2c83 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:14.319278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d178834d-13b1-465c-b4f3-dcb7f53b2c83 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:14.319992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d178834d-13b1-465c-b4f3-dcb7f53b2c83 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:14.320455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d178834d-13b1-465c-b4f3-dcb7f53b2c83 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:14.320890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d178834d-13b1-465c-b4f3-dcb7f53b2c83 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:14.333717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:14.334324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:14.340227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:14.340717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:14.341189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:14.341997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:14.342477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:14.342983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:14.520637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d178834d-13b1-465c-b4f3-dcb7f53b2c83 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:14.528062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d178834d-13b1-465c-b4f3-dcb7f53b2c83 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.220670 Aug 08 08:42:14.528638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 52/98] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:14 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:14.536035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:14.544356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:14.546485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:14.547678 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ba2b0507-1824-457b-9a8c-220a08a930b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.218029 Aug 08 08:42:14.548310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 47/99] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:14 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:14.609575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-11857919-2fcc-4ebd-bbf7-e2b991572cc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:14.610195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-11857919-2fcc-4ebd-bbf7-e2b991572cc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:14.616070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11857919-2fcc-4ebd-bbf7-e2b991572cc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:14.616585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11857919-2fcc-4ebd-bbf7-e2b991572cc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:14.617028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11857919-2fcc-4ebd-bbf7-e2b991572cc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:14.617754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11857919-2fcc-4ebd-bbf7-e2b991572cc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:14.618217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11857919-2fcc-4ebd-bbf7-e2b991572cc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:14.618656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11857919-2fcc-4ebd-bbf7-e2b991572cc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:14.753169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-11857919-2fcc-4ebd-bbf7-e2b991572cc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:14.761587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-11857919-2fcc-4ebd-bbf7-e2b991572cc5 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.156033 Aug 08 08:42:14.762162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 53/100] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:14 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:15.133629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c6a6927e-6ee8-43e0-b40d-4b72f8ccf249 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:15.151332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c6a6927e-6ee8-43e0-b40d-4b72f8ccf249 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:15.151332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6a6927e-6ee8-43e0-b40d-4b72f8ccf249 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:15.151332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6a6927e-6ee8-43e0-b40d-4b72f8ccf249 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:15.151332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6a6927e-6ee8-43e0-b40d-4b72f8ccf249 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:15.151657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6a6927e-6ee8-43e0-b40d-4b72f8ccf249 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:15.151657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6a6927e-6ee8-43e0-b40d-4b72f8ccf249 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:15.151657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6a6927e-6ee8-43e0-b40d-4b72f8ccf249 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:15.151830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1321d97b-04cc-4a7d-a6e1-869147324883 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:15.151830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1321d97b-04cc-4a7d-a6e1-869147324883 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:15.151830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=10 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:15.155067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1321d97b-04cc-4a7d-a6e1-869147324883 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:15.155853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1321d97b-04cc-4a7d-a6e1-869147324883 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:15.156008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1321d97b-04cc-4a7d-a6e1-869147324883 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:15.156969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1321d97b-04cc-4a7d-a6e1-869147324883 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:15.157653 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1321d97b-04cc-4a7d-a6e1-869147324883 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:15.158246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1321d97b-04cc-4a7d-a6e1-869147324883 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:15.354850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=13 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:15.381275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c6a6927e-6ee8-43e0-b40d-4b72f8ccf249 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:15.385987 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1321d97b-04cc-4a7d-a6e1-869147324883 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:15.388565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c6a6927e-6ee8-43e0-b40d-4b72f8ccf249 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.258761 Aug 08 08:42:15.389173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 48/101] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:15 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:15.399034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1321d97b-04cc-4a7d-a6e1-869147324883 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.251396 Aug 08 08:42:15.399034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 54/102] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:15 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:15.562948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5bbf9c10-5227-4102-9b26-0339d6126eac tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:15.563556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5bbf9c10-5227-4102-9b26-0339d6126eac tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:15.569737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bbf9c10-5227-4102-9b26-0339d6126eac tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:15.570224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bbf9c10-5227-4102-9b26-0339d6126eac tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:15.570445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:15.570654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bbf9c10-5227-4102-9b26-0339d6126eac tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:15.571053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:15.571339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bbf9c10-5227-4102-9b26-0339d6126eac tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:15.571784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bbf9c10-5227-4102-9b26-0339d6126eac tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:15.572210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bbf9c10-5227-4102-9b26-0339d6126eac tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:15.576856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:15.577380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:15.577813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:15.578493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:15.578946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:15.579367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:15.801351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5bbf9c10-5227-4102-9b26-0339d6126eac tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:15.805299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:15.809002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5bbf9c10-5227-4102-9b26-0339d6126eac tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.256517 Aug 08 08:42:15.809605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 49/103] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:15 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:15.813840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:15.814054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b26d81e9-4233-42b5-96a9-5073914443fc tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:15.814820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b26d81e9-4233-42b5-96a9-5073914443fc tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:15.815359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:15.816467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bf34e752-d708-4a19-b413-b08beaba9bf8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.249829 Aug 08 08:42:15.817013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 55/104] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:15 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:42:15.821318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b26d81e9-4233-42b5-96a9-5073914443fc tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:15.821797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b26d81e9-4233-42b5-96a9-5073914443fc tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:15.822228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b26d81e9-4233-42b5-96a9-5073914443fc tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:15.822911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b26d81e9-4233-42b5-96a9-5073914443fc tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:15.823362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b26d81e9-4233-42b5-96a9-5073914443fc tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:15.823789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b26d81e9-4233-42b5-96a9-5073914443fc tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:15.966450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b26d81e9-4233-42b5-96a9-5073914443fc tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:15.975107 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b26d81e9-4233-42b5-96a9-5073914443fc tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.164467 Aug 08 08:42:15.975597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 50/105] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:15 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:16.420202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-12f0705b-d676-4e6e-8878-a3986b1be6ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:16.423143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-12f0705b-d676-4e6e-8878-a3986b1be6ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:16.425816 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7084a8be-40be-4b33-9e5a-7acef94a7507 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:16.427475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7084a8be-40be-4b33-9e5a-7acef94a7507 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:16.440473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7084a8be-40be-4b33-9e5a-7acef94a7507 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:16.441721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7084a8be-40be-4b33-9e5a-7acef94a7507 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:16.442811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12f0705b-d676-4e6e-8878-a3986b1be6ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:16.443511 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7084a8be-40be-4b33-9e5a-7acef94a7507 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:16.443692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12f0705b-d676-4e6e-8878-a3986b1be6ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:16.444581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12f0705b-d676-4e6e-8878-a3986b1be6ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:16.445571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7084a8be-40be-4b33-9e5a-7acef94a7507 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:16.446858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12f0705b-d676-4e6e-8878-a3986b1be6ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:16.451250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7084a8be-40be-4b33-9e5a-7acef94a7507 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:16.451250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7084a8be-40be-4b33-9e5a-7acef94a7507 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:16.451483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12f0705b-d676-4e6e-8878-a3986b1be6ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:16.451483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12f0705b-d676-4e6e-8878-a3986b1be6ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:16.489693 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:17.224212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-12f0705b-d676-4e6e-8878-a3986b1be6ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:17.225784 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7084a8be-40be-4b33-9e5a-7acef94a7507 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:17.232526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-12f0705b-d676-4e6e-8878-a3986b1be6ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.820664 Aug 08 08:42:17.233557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7084a8be-40be-4b33-9e5a-7acef94a7507 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.823234 Aug 08 08:42:17.234082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 51/106] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:16 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:17.238579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c6475a7d-7eda-4929-914d-c3add3933018 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:17.242112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c6475a7d-7eda-4929-914d-c3add3933018 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:17.245442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 56/107] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:16 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:17.245686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6475a7d-7eda-4929-914d-c3add3933018 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:17.246331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6475a7d-7eda-4929-914d-c3add3933018 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:17.246772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6475a7d-7eda-4929-914d-c3add3933018 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:17.247463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6475a7d-7eda-4929-914d-c3add3933018 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:17.247923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6475a7d-7eda-4929-914d-c3add3933018 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:17.248356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6475a7d-7eda-4929-914d-c3add3933018 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:17.250752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:17.251518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:17.257418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:17.257908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:17.261001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:17.261001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:17.261001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:17.261001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:17.450917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c6475a7d-7eda-4929-914d-c3add3933018 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:17.461406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c6475a7d-7eda-4929-914d-c3add3933018 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.226272 Aug 08 08:42:17.462444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 52/108] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:17 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:17.470790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-76bdcbd3-9b9e-40cf-99a3-724db17bad64 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:17.470790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-76bdcbd3-9b9e-40cf-99a3-724db17bad64 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:17.475351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76bdcbd3-9b9e-40cf-99a3-724db17bad64 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:17.475911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76bdcbd3-9b9e-40cf-99a3-724db17bad64 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:17.476414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76bdcbd3-9b9e-40cf-99a3-724db17bad64 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:17.477204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76bdcbd3-9b9e-40cf-99a3-724db17bad64 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:17.477422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:17.477899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76bdcbd3-9b9e-40cf-99a3-724db17bad64 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:17.478283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76bdcbd3-9b9e-40cf-99a3-724db17bad64 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:17.482707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:17.487933 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:17.489473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:17.490776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f030b526-0dfd-495b-b42c-1cca49c35e6b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.244413 Aug 08 08:42:17.491346 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 57/109] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:17 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:17.610452 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-76bdcbd3-9b9e-40cf-99a3-724db17bad64 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:17.618038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-76bdcbd3-9b9e-40cf-99a3-724db17bad64 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.154499 Aug 08 08:42:17.618612 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 53/110] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:17 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:18.260501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f7e65f47-fca7-4455-ad2b-1c727fcc1cc9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:18.261427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f7e65f47-fca7-4455-ad2b-1c727fcc1cc9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:18.261728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e2dcb91c-819f-4d6a-9ea1-4f3f97ebdfa2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:18.262481 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e2dcb91c-819f-4d6a-9ea1-4f3f97ebdfa2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:18.281922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2dcb91c-819f-4d6a-9ea1-4f3f97ebdfa2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:18.282340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2dcb91c-819f-4d6a-9ea1-4f3f97ebdfa2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:18.282866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2dcb91c-819f-4d6a-9ea1-4f3f97ebdfa2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:18.287506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7e65f47-fca7-4455-ad2b-1c727fcc1cc9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:18.288191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7e65f47-fca7-4455-ad2b-1c727fcc1cc9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:18.288902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7e65f47-fca7-4455-ad2b-1c727fcc1cc9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:18.289372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2dcb91c-819f-4d6a-9ea1-4f3f97ebdfa2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:18.290039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2dcb91c-819f-4d6a-9ea1-4f3f97ebdfa2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:18.293932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7e65f47-fca7-4455-ad2b-1c727fcc1cc9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:18.294345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2dcb91c-819f-4d6a-9ea1-4f3f97ebdfa2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:18.295511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7e65f47-fca7-4455-ad2b-1c727fcc1cc9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:18.296709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7e65f47-fca7-4455-ad2b-1c727fcc1cc9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:18.798534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f7e65f47-fca7-4455-ad2b-1c727fcc1cc9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:18.830935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f7e65f47-fca7-4455-ad2b-1c727fcc1cc9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.575875 Aug 08 08:42:18.837328 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 54/111] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:18 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:18.847905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-24a7f969-4901-4e4e-82d2-8c93f28cf6a8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:18.851693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-24a7f969-4901-4e4e-82d2-8c93f28cf6a8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:18.869524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e2dcb91c-819f-4d6a-9ea1-4f3f97ebdfa2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:18.870844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-24a7f969-4901-4e4e-82d2-8c93f28cf6a8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:18.882187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-24a7f969-4901-4e4e-82d2-8c93f28cf6a8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:18.882706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-24a7f969-4901-4e4e-82d2-8c93f28cf6a8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:18.883599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-24a7f969-4901-4e4e-82d2-8c93f28cf6a8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:18.884085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-24a7f969-4901-4e4e-82d2-8c93f28cf6a8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:18.884565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-24a7f969-4901-4e4e-82d2-8c93f28cf6a8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:18.890149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e2dcb91c-819f-4d6a-9ea1-4f3f97ebdfa2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.633586 Aug 08 08:42:18.891330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 58/112] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:18 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:18.903916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:18.904541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:18.922344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:18.922838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:18.928210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:18.932220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:18.932989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:18.933476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:19.147694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-24a7f969-4901-4e4e-82d2-8c93f28cf6a8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:19.157786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-24a7f969-4901-4e4e-82d2-8c93f28cf6a8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.320066 Aug 08 08:42:19.158971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 55/113] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:18 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:19.185663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b544c66f-1bef-41b4-8909-a2b47dcb5edd tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:19.187394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b544c66f-1bef-41b4-8909-a2b47dcb5edd tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:19.202326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b544c66f-1bef-41b4-8909-a2b47dcb5edd tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:19.208524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b544c66f-1bef-41b4-8909-a2b47dcb5edd tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:19.209623 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b544c66f-1bef-41b4-8909-a2b47dcb5edd tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:19.211647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b544c66f-1bef-41b4-8909-a2b47dcb5edd tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:19.212845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b544c66f-1bef-41b4-8909-a2b47dcb5edd tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:19.213878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b544c66f-1bef-41b4-8909-a2b47dcb5edd tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:19.216672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:19.227887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:19.229610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:19.230746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-35f5f587-f223-4c17-a648-33c77faa4014 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.337779 Aug 08 08:42:19.231315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 59/114] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:18 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:19.303219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-b27a6e5e-c840-4743-bea9-e308ae05341e req-6e0ffd0a-3f3a-4db8-af6d-0da6164bfab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c8af4b-cc42-4abc-9451-141a3b8d7f0a", "name": "network-vif-plugged", "status": "completed", "tag": "18ac550c-5a89-4fc0-8a55-4e35711b1e3c"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:19.314752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-b27a6e5e-c840-4743-bea9-e308ae05341e req-6e0ffd0a-3f3a-4db8-af6d-0da6164bfab3 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:19.319950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-b27a6e5e-c840-4743-bea9-e308ae05341e req-6e0ffd0a-3f3a-4db8-af6d-0da6164bfab3 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:19.319950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-b27a6e5e-c840-4743-bea9-e308ae05341e req-6e0ffd0a-3f3a-4db8-af6d-0da6164bfab3 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:19.335876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-b27a6e5e-c840-4743-bea9-e308ae05341e req-6e0ffd0a-3f3a-4db8-af6d-0da6164bfab3 service nova] Creating event network-vif-plugged:18ac550c-5a89-4fc0-8a55-4e35711b1e3c for instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a on hv-cinder-83697 Aug 08 08:42:19.342387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-b27a6e5e-c840-4743-bea9-e308ae05341e req-6e0ffd0a-3f3a-4db8-af6d-0da6164bfab3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109639 Aug 08 08:42:19.343234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 60/115] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:19.419992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b544c66f-1bef-41b4-8909-a2b47dcb5edd tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:19.426540 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b544c66f-1bef-41b4-8909-a2b47dcb5edd tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.251944 Aug 08 08:42:19.427329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 56/116] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:19 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:19.874856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-01bcd0b8-a36a-4ead-8346-7c84d1d2559d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:19.875675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-01bcd0b8-a36a-4ead-8346-7c84d1d2559d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:19.883528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-01bcd0b8-a36a-4ead-8346-7c84d1d2559d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:19.884017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-01bcd0b8-a36a-4ead-8346-7c84d1d2559d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:19.884453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-01bcd0b8-a36a-4ead-8346-7c84d1d2559d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:19.885167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-01bcd0b8-a36a-4ead-8346-7c84d1d2559d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:19.885763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-01bcd0b8-a36a-4ead-8346-7c84d1d2559d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:19.900034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-01bcd0b8-a36a-4ead-8346-7c84d1d2559d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:19.911410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-50f9bc72-5ded-46a3-801c-4e70cb212efd tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:19.912042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-50f9bc72-5ded-46a3-801c-4e70cb212efd tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:19.937955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50f9bc72-5ded-46a3-801c-4e70cb212efd tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:19.940473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50f9bc72-5ded-46a3-801c-4e70cb212efd tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:19.942232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50f9bc72-5ded-46a3-801c-4e70cb212efd tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:19.943146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50f9bc72-5ded-46a3-801c-4e70cb212efd tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:19.943604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50f9bc72-5ded-46a3-801c-4e70cb212efd tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:19.946681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50f9bc72-5ded-46a3-801c-4e70cb212efd tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:20.306480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-01bcd0b8-a36a-4ead-8346-7c84d1d2559d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:20.318765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-01bcd0b8-a36a-4ead-8346-7c84d1d2559d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.460607 Aug 08 08:42:20.319430 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 61/117] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:19 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:20.345415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8fb4d264-0113-4584-928f-e484c6407a0a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:20.346037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8fb4d264-0113-4584-928f-e484c6407a0a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:20.366986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fb4d264-0113-4584-928f-e484c6407a0a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:20.367560 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fb4d264-0113-4584-928f-e484c6407a0a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:20.367962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fb4d264-0113-4584-928f-e484c6407a0a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:20.368785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fb4d264-0113-4584-928f-e484c6407a0a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:20.369249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fb4d264-0113-4584-928f-e484c6407a0a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:20.370095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fb4d264-0113-4584-928f-e484c6407a0a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:20.380061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-50f9bc72-5ded-46a3-801c-4e70cb212efd tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:20.390656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-50f9bc72-5ded-46a3-801c-4e70cb212efd tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.481174 Aug 08 08:42:20.394808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 57/118] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:19 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:20.396823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:20.397461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:20.404392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:20.408241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:20.408897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:20.411106 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:20.411731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:20.412306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:20.713043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:20.717883 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8fb4d264-0113-4584-928f-e484c6407a0a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:20.726575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8fb4d264-0113-4584-928f-e484c6407a0a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.389038 Aug 08 08:42:20.726825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:20.727992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 62/119] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:20 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:20.728373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:20.729541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c2c774ba-7fc8-4747-98a7-f66e287361f5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.337293 Aug 08 08:42:20.730396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 58/120] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:20 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:20.734580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f9919b9d-3446-4ba1-b506-e5f46dc9ec44 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:20.735506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f9919b9d-3446-4ba1-b506-e5f46dc9ec44 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:20.742485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:20.744205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9919b9d-3446-4ba1-b506-e5f46dc9ec44 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:20.744876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9919b9d-3446-4ba1-b506-e5f46dc9ec44 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:20.745503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9919b9d-3446-4ba1-b506-e5f46dc9ec44 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:20.746361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9919b9d-3446-4ba1-b506-e5f46dc9ec44 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:20.746975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9919b9d-3446-4ba1-b506-e5f46dc9ec44 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:20.750202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9919b9d-3446-4ba1-b506-e5f46dc9ec44 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:20.922073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f9919b9d-3446-4ba1-b506-e5f46dc9ec44 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:20.932152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f9919b9d-3446-4ba1-b506-e5f46dc9ec44 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.200905 Aug 08 08:42:20.934329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 63/121] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:20 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:21.344318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a39589c1-fdef-4efd-80b9-144a9ddf155b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:21.345560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a39589c1-fdef-4efd-80b9-144a9ddf155b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:21.352015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a39589c1-fdef-4efd-80b9-144a9ddf155b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:21.352511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a39589c1-fdef-4efd-80b9-144a9ddf155b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:21.353132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a39589c1-fdef-4efd-80b9-144a9ddf155b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:21.353868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a39589c1-fdef-4efd-80b9-144a9ddf155b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:21.354333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a39589c1-fdef-4efd-80b9-144a9ddf155b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:21.354764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a39589c1-fdef-4efd-80b9-144a9ddf155b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:21.368824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-930c7161-0781-4385-b7e8-2cd029d44097 req-9a8a327b-80dd-4921-a491-fcae86240c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa423dc-c608-40ed-a783-faf7a48d13c1", "name": "network-vif-plugged", "status": "completed", "tag": "22c96d99-e75c-4e18-bb06-3b7e1fc4519b"}, {"server_uuid": "1ec8f653-4fc1-4f77-a832-768f73782b17", "name": "network-vif-plugged", "status": "completed", "tag": "a272eb6d-b0c0-4037-a16a-be5cad0542fd"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:21.387112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-930c7161-0781-4385-b7e8-2cd029d44097 req-9a8a327b-80dd-4921-a491-fcae86240c70 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:21.387805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-930c7161-0781-4385-b7e8-2cd029d44097 req-9a8a327b-80dd-4921-a491-fcae86240c70 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:21.388809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-930c7161-0781-4385-b7e8-2cd029d44097 req-9a8a327b-80dd-4921-a491-fcae86240c70 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:21.403424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-930c7161-0781-4385-b7e8-2cd029d44097 req-9a8a327b-80dd-4921-a491-fcae86240c70 service nova] Creating event network-vif-plugged:22c96d99-e75c-4e18-bb06-3b7e1fc4519b for instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 on hv-cinder-83697 Aug 08 08:42:21.403933 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-930c7161-0781-4385-b7e8-2cd029d44097 req-9a8a327b-80dd-4921-a491-fcae86240c70 service nova] Creating event network-vif-plugged:a272eb6d-b0c0-4037-a16a-be5cad0542fd for instance 1ec8f653-4fc1-4f77-a832-768f73782b17 on hv-cinder-83697 Aug 08 08:42:21.427018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-930c7161-0781-4385-b7e8-2cd029d44097 req-9a8a327b-80dd-4921-a491-fcae86240c70 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064626 Aug 08 08:42:21.442146 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 64/122] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:21.460190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d547d761-0cfa-48b8-9532-3b2338a7f302 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:21.460902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d547d761-0cfa-48b8-9532-3b2338a7f302 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:21.469407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d547d761-0cfa-48b8-9532-3b2338a7f302 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:21.469903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d547d761-0cfa-48b8-9532-3b2338a7f302 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:21.470613 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d547d761-0cfa-48b8-9532-3b2338a7f302 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:21.471315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d547d761-0cfa-48b8-9532-3b2338a7f302 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:21.471774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d547d761-0cfa-48b8-9532-3b2338a7f302 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:21.475597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d547d761-0cfa-48b8-9532-3b2338a7f302 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:21.824137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a39589c1-fdef-4efd-80b9-144a9ddf155b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:21.832904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a39589c1-fdef-4efd-80b9-144a9ddf155b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.492965 Aug 08 08:42:21.833640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 59/123] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:21 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:21.838879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2d62124b-5e19-440b-b500-e5cb2cc3adb2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:21.839653 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2d62124b-5e19-440b-b500-e5cb2cc3adb2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:21.850995 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d62124b-5e19-440b-b500-e5cb2cc3adb2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:21.851608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d62124b-5e19-440b-b500-e5cb2cc3adb2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:21.852219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d62124b-5e19-440b-b500-e5cb2cc3adb2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:21.852977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d62124b-5e19-440b-b500-e5cb2cc3adb2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:21.853517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d62124b-5e19-440b-b500-e5cb2cc3adb2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:21.854024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d62124b-5e19-440b-b500-e5cb2cc3adb2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:21.872169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d547d761-0cfa-48b8-9532-3b2338a7f302 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:21.881037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d547d761-0cfa-48b8-9532-3b2338a7f302 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.436833 Aug 08 08:42:21.882004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 65/124] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:21 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:21.886739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:21.887878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:21.893923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:21.894571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:21.895167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:21.895866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:21.896323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:21.896749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:22.266808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2d62124b-5e19-440b-b500-e5cb2cc3adb2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:22.276139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2d62124b-5e19-440b-b500-e5cb2cc3adb2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.441194 Aug 08 08:42:22.276701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 60/125] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:21 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:22.291319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-86206263-acc4-4308-a908-be5783d0b8df tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:22.292225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-86206263-acc4-4308-a908-be5783d0b8df tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:22.309284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86206263-acc4-4308-a908-be5783d0b8df tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:22.309988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86206263-acc4-4308-a908-be5783d0b8df tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:22.312906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86206263-acc4-4308-a908-be5783d0b8df tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:22.313910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86206263-acc4-4308-a908-be5783d0b8df tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:22.314533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86206263-acc4-4308-a908-be5783d0b8df tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:22.323777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86206263-acc4-4308-a908-be5783d0b8df tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:22.338840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:22.351986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:22.356908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:22.360344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-54aff638-d7c2-4d26-8393-355edcfe444c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.477216 Aug 08 08:42:22.361354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 66/126] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:21 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:22.515120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-86206263-acc4-4308-a908-be5783d0b8df tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:22.522613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-86206263-acc4-4308-a908-be5783d0b8df tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1314 microversion: 2.1 time: 0.242852 Aug 08 08:42:22.523181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 61/127] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:22 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:22.854378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-af6620fc-f558-406e-af90-cad98bb96021 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:22.854992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-af6620fc-f558-406e-af90-cad98bb96021 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:22.861637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af6620fc-f558-406e-af90-cad98bb96021 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:22.862131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af6620fc-f558-406e-af90-cad98bb96021 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:22.862579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af6620fc-f558-406e-af90-cad98bb96021 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:22.863300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af6620fc-f558-406e-af90-cad98bb96021 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:22.863779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af6620fc-f558-406e-af90-cad98bb96021 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:22.864391 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af6620fc-f558-406e-af90-cad98bb96021 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:22.905997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-73312b85-4a15-4b88-a944-152b27c0b41c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:22.906800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-73312b85-4a15-4b88-a944-152b27c0b41c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:22.913295 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73312b85-4a15-4b88-a944-152b27c0b41c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:22.914088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73312b85-4a15-4b88-a944-152b27c0b41c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:22.914655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73312b85-4a15-4b88-a944-152b27c0b41c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:22.915805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73312b85-4a15-4b88-a944-152b27c0b41c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:22.916976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73312b85-4a15-4b88-a944-152b27c0b41c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:22.917476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73312b85-4a15-4b88-a944-152b27c0b41c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:23.109510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-af6620fc-f558-406e-af90-cad98bb96021 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:23.121081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-af6620fc-f558-406e-af90-cad98bb96021 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.270441 Aug 08 08:42:23.123813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 67/128] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:22 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:23.142130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-73312b85-4a15-4b88-a944-152b27c0b41c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:23.149659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-73312b85-4a15-4b88-a944-152b27c0b41c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.247845 Aug 08 08:42:23.150256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 62/129] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:22 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:23.296703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-86138970-73ce-436a-879f-81c4890fefe7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:23.297259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-86138970-73ce-436a-879f-81c4890fefe7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:23.303098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86138970-73ce-436a-879f-81c4890fefe7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:23.309291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86138970-73ce-436a-879f-81c4890fefe7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:23.309291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86138970-73ce-436a-879f-81c4890fefe7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:23.309291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86138970-73ce-436a-879f-81c4890fefe7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:23.309291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86138970-73ce-436a-879f-81c4890fefe7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:23.309611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86138970-73ce-436a-879f-81c4890fefe7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:23.386502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:23.387117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:23.402265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:23.402764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:23.403263 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:23.403897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:23.404356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:23.405545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:23.446488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-86138970-73ce-436a-879f-81c4890fefe7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:23.456098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-86138970-73ce-436a-879f-81c4890fefe7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.163843 Aug 08 08:42:23.456676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 68/130] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:23 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:23.461544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-80074ab1-b3a0-44eb-a538-dc1fedc6d4cf req-e8f2c405-fc02-48a5-a57a-19237e6eb535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7125c9bf-f883-4fde-b50a-031fadb4cac1", "name": "network-vif-plugged", "status": "completed", "tag": "dec57a28-51ce-4c11-9486-8775c1cdfc54"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:23.471986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-80074ab1-b3a0-44eb-a538-dc1fedc6d4cf req-e8f2c405-fc02-48a5-a57a-19237e6eb535 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:23.472880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-80074ab1-b3a0-44eb-a538-dc1fedc6d4cf req-e8f2c405-fc02-48a5-a57a-19237e6eb535 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:23.473354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-80074ab1-b3a0-44eb-a538-dc1fedc6d4cf req-e8f2c405-fc02-48a5-a57a-19237e6eb535 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:23.485771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-80074ab1-b3a0-44eb-a538-dc1fedc6d4cf req-e8f2c405-fc02-48a5-a57a-19237e6eb535 service nova] Creating event network-vif-plugged:dec57a28-51ce-4c11-9486-8775c1cdfc54 for instance 7125c9bf-f883-4fde-b50a-031fadb4cac1 on hv-cinder-83697 Aug 08 08:42:23.490862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-80074ab1-b3a0-44eb-a538-dc1fedc6d4cf req-e8f2c405-fc02-48a5-a57a-19237e6eb535 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032992 Aug 08 08:42:23.491631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 69/131] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:23.544630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-27340935-1189-4539-9609-637088cdb354 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:23.546826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-27340935-1189-4539-9609-637088cdb354 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:23.553443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27340935-1189-4539-9609-637088cdb354 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:23.554034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27340935-1189-4539-9609-637088cdb354 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:23.554361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27340935-1189-4539-9609-637088cdb354 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:23.555058 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27340935-1189-4539-9609-637088cdb354 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:23.555515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27340935-1189-4539-9609-637088cdb354 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:23.555938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27340935-1189-4539-9609-637088cdb354 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:23.573480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:23.583136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:23.584995 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:23.587038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7f4ffc41-b44f-4d26-b596-cae5e12f8115 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1406 microversion: 2.20 time: 0.206421 Aug 08 08:42:23.601561 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 63/132] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:23 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:23.736744 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-27340935-1189-4539-9609-637088cdb354 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:23.744152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-27340935-1189-4539-9609-637088cdb354 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1500 microversion: 2.1 time: 0.203901 Aug 08 08:42:23.762540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 70/133] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:23 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1500 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:24.150962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-649c2458-6e4c-4c59-939c-5104c21fa75a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:24.151553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-649c2458-6e4c-4c59-939c-5104c21fa75a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:24.158709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-649c2458-6e4c-4c59-939c-5104c21fa75a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:24.159285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-649c2458-6e4c-4c59-939c-5104c21fa75a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:24.159781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-649c2458-6e4c-4c59-939c-5104c21fa75a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:24.160563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-649c2458-6e4c-4c59-939c-5104c21fa75a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:24.161021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-649c2458-6e4c-4c59-939c-5104c21fa75a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:24.161515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-649c2458-6e4c-4c59-939c-5104c21fa75a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:24.171749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4fd0645c-5fce-4c82-9e41-46ef1ef1195c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:24.172484 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4fd0645c-5fce-4c82-9e41-46ef1ef1195c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:24.179016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fd0645c-5fce-4c82-9e41-46ef1ef1195c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:24.179517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fd0645c-5fce-4c82-9e41-46ef1ef1195c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:24.179959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fd0645c-5fce-4c82-9e41-46ef1ef1195c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:24.180670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fd0645c-5fce-4c82-9e41-46ef1ef1195c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:24.181327 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fd0645c-5fce-4c82-9e41-46ef1ef1195c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:24.181920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fd0645c-5fce-4c82-9e41-46ef1ef1195c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:24.499870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-649c2458-6e4c-4c59-939c-5104c21fa75a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:24.502715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4fd0645c-5fce-4c82-9e41-46ef1ef1195c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:24.513934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-649c2458-6e4c-4c59-939c-5104c21fa75a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.366481 Aug 08 08:42:24.514643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 64/134] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:24 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:24.529299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4fd0645c-5fce-4c82-9e41-46ef1ef1195c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.348160 Aug 08 08:42:24.529299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 71/135] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:24 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:24.529824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-770aee01-1fbc-4bf0-b847-71c213485686 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:24.529824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-770aee01-1fbc-4bf0-b847-71c213485686 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:24.548154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770aee01-1fbc-4bf0-b847-71c213485686 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:24.549850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770aee01-1fbc-4bf0-b847-71c213485686 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:24.551418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770aee01-1fbc-4bf0-b847-71c213485686 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:24.552192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770aee01-1fbc-4bf0-b847-71c213485686 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:24.552661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770aee01-1fbc-4bf0-b847-71c213485686 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:24.553167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770aee01-1fbc-4bf0-b847-71c213485686 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:24.613680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:24.615021 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:24.624644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:24.625253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:24.626038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:24.626953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:24.633671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:24.634804 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:24.843063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-770aee01-1fbc-4bf0-b847-71c213485686 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:24.865784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-770aee01-1fbc-4bf0-b847-71c213485686 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.349686 Aug 08 08:42:24.871382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 65/136] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:24 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:24.883782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:24.895627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:24.897294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:24.901579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-994111dc-2116-4ba9-b255-440758c16c5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1597 microversion: 2.20 time: 0.289712 Aug 08 08:42:24.901579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 72/137] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:42:24 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1597 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:42:24.929226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f1a3d761-d232-4b14-894b-248c2aedc30e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:24.929904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f1a3d761-d232-4b14-894b-248c2aedc30e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:24.938282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1a3d761-d232-4b14-894b-248c2aedc30e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:24.938778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1a3d761-d232-4b14-894b-248c2aedc30e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:24.939702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1a3d761-d232-4b14-894b-248c2aedc30e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:24.940689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1a3d761-d232-4b14-894b-248c2aedc30e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:24.941413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1a3d761-d232-4b14-894b-248c2aedc30e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:24.942112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1a3d761-d232-4b14-894b-248c2aedc30e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:25.082628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f1a3d761-d232-4b14-894b-248c2aedc30e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.158398 Aug 08 08:42:25.083303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 66/138] 10.222.0.33 () {60 vars in 1316 bytes} [Mon Aug 8 08:42:24 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:42:25.508792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-071ea611-9b22-458a-90ec-3d851e42ff2d req-ae6a11f9-d8ab-438c-ab7d-b04bf9cd5875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8117a4bb-5bfc-41a1-a874-72c1266a8955", "name": "network-vif-plugged", "status": "completed", "tag": "45742616-a27a-4ad1-8004-5461bd902cbb"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:25.519362 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-071ea611-9b22-458a-90ec-3d851e42ff2d req-ae6a11f9-d8ab-438c-ab7d-b04bf9cd5875 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:25.520157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-071ea611-9b22-458a-90ec-3d851e42ff2d req-ae6a11f9-d8ab-438c-ab7d-b04bf9cd5875 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:25.521233 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-071ea611-9b22-458a-90ec-3d851e42ff2d req-ae6a11f9-d8ab-438c-ab7d-b04bf9cd5875 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:25.535145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-071ea611-9b22-458a-90ec-3d851e42ff2d req-ae6a11f9-d8ab-438c-ab7d-b04bf9cd5875 service nova] Creating event network-vif-plugged:45742616-a27a-4ad1-8004-5461bd902cbb for instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 on hv-cinder-83697 Aug 08 08:42:25.538902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-eb110697-122a-43a9-9d74-94b592734e6e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:25.540037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-eb110697-122a-43a9-9d74-94b592734e6e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:25.540345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-071ea611-9b22-458a-90ec-3d851e42ff2d req-ae6a11f9-d8ab-438c-ab7d-b04bf9cd5875 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035549 Aug 08 08:42:25.540974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 73/139] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:25.547988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb110697-122a-43a9-9d74-94b592734e6e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:25.548487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb110697-122a-43a9-9d74-94b592734e6e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:25.548934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb110697-122a-43a9-9d74-94b592734e6e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:25.549667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb110697-122a-43a9-9d74-94b592734e6e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:25.550123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb110697-122a-43a9-9d74-94b592734e6e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:25.550548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb110697-122a-43a9-9d74-94b592734e6e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:25.551080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-df21bc77-8144-417f-854f-f4f8cb5be50d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:25.551854 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-df21bc77-8144-417f-854f-f4f8cb5be50d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:25.568443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df21bc77-8144-417f-854f-f4f8cb5be50d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:25.569312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df21bc77-8144-417f-854f-f4f8cb5be50d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:25.569969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df21bc77-8144-417f-854f-f4f8cb5be50d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:25.571809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df21bc77-8144-417f-854f-f4f8cb5be50d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:25.571809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df21bc77-8144-417f-854f-f4f8cb5be50d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:25.572798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df21bc77-8144-417f-854f-f4f8cb5be50d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:25.815810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-df21bc77-8144-417f-854f-f4f8cb5be50d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:25.827895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-df21bc77-8144-417f-854f-f4f8cb5be50d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1322 microversion: 2.1 time: 0.281174 Aug 08 08:42:25.830815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-eb110697-122a-43a9-9d74-94b592734e6e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:25.838289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-eb110697-122a-43a9-9d74-94b592734e6e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.304906 Aug 08 08:42:25.848844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 67/140] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:25 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:25.857823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 74/141] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:25 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:25.857982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-85276d80-8bf7-43d0-a9c0-e43597cb3084 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dbe9be4-8ba9-409d-ba23-d38f04b77221"}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:25.857982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-85276d80-8bf7-43d0-a9c0-e43597cb3084 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:25.861821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85276d80-8bf7-43d0-a9c0-e43597cb3084 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:25.862464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85276d80-8bf7-43d0-a9c0-e43597cb3084 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:25.862904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85276d80-8bf7-43d0-a9c0-e43597cb3084 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:25.863602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85276d80-8bf7-43d0-a9c0-e43597cb3084 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:25.864051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85276d80-8bf7-43d0-a9c0-e43597cb3084 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:25.864474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85276d80-8bf7-43d0-a9c0-e43597cb3084 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:25.891509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-210b1c0e-e6aa-4496-9cf6-5f6428340863 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:25.892067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-210b1c0e-e6aa-4496-9cf6-5f6428340863 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:25.899455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-210b1c0e-e6aa-4496-9cf6-5f6428340863 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:25.900286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-210b1c0e-e6aa-4496-9cf6-5f6428340863 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:25.901356 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-210b1c0e-e6aa-4496-9cf6-5f6428340863 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:25.902524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-210b1c0e-e6aa-4496-9cf6-5f6428340863 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:25.903094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-210b1c0e-e6aa-4496-9cf6-5f6428340863 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:25.903796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-210b1c0e-e6aa-4496-9cf6-5f6428340863 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:26.112794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-210b1c0e-e6aa-4496-9cf6-5f6428340863 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:26.120535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:26.125725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-210b1c0e-e6aa-4496-9cf6-5f6428340863 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.239663 Aug 08 08:42:26.126509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 75/142] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:25 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:26.759573 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-c3ffc08c-b29b-40eb-a20d-7e8dd4f20c0f req-a886b506-7347-4729-ae1a-c7bf36f45dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa423dc-c608-40ed-a783-faf7a48d13c1", "tag": "22c96d99-e75c-4e18-bb06-3b7e1fc4519b"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:26.775116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-c3ffc08c-b29b-40eb-a20d-7e8dd4f20c0f req-a886b506-7347-4729-ae1a-c7bf36f45dc7 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:26.775590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-c3ffc08c-b29b-40eb-a20d-7e8dd4f20c0f req-a886b506-7347-4729-ae1a-c7bf36f45dc7 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:26.776022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-c3ffc08c-b29b-40eb-a20d-7e8dd4f20c0f req-a886b506-7347-4729-ae1a-c7bf36f45dc7 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:26.793067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-c3ffc08c-b29b-40eb-a20d-7e8dd4f20c0f req-a886b506-7347-4729-ae1a-c7bf36f45dc7 service nova] Creating event network-changed:22c96d99-e75c-4e18-bb06-3b7e1fc4519b for instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 on hv-cinder-83697 Aug 08 08:42:26.799276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-c3ffc08c-b29b-40eb-a20d-7e8dd4f20c0f req-a886b506-7347-4729-ae1a-c7bf36f45dc7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043503 Aug 08 08:42:26.800152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 76/143] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:26.851703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a78c8550-8bbf-4436-a7d2-0b1d91a083b7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:26.852702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a78c8550-8bbf-4436-a7d2-0b1d91a083b7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:26.860975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a78c8550-8bbf-4436-a7d2-0b1d91a083b7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:26.862032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a78c8550-8bbf-4436-a7d2-0b1d91a083b7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:26.862699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a78c8550-8bbf-4436-a7d2-0b1d91a083b7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:26.863683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a78c8550-8bbf-4436-a7d2-0b1d91a083b7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:26.864152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a78c8550-8bbf-4436-a7d2-0b1d91a083b7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:26.864582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a78c8550-8bbf-4436-a7d2-0b1d91a083b7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:27.009120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a78c8550-8bbf-4436-a7d2-0b1d91a083b7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:27.021328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a78c8550-8bbf-4436-a7d2-0b1d91a083b7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1516 microversion: 2.1 time: 0.173828 Aug 08 08:42:27.021931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 77/144] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:26 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:27.027360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4940e56a-ae7b-4b7e-bff6-365fd8c11216 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:27.028124 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4940e56a-ae7b-4b7e-bff6-365fd8c11216 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:27.035372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4940e56a-ae7b-4b7e-bff6-365fd8c11216 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:27.036062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4940e56a-ae7b-4b7e-bff6-365fd8c11216 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:27.036677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4940e56a-ae7b-4b7e-bff6-365fd8c11216 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:27.037618 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4940e56a-ae7b-4b7e-bff6-365fd8c11216 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:27.038224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4940e56a-ae7b-4b7e-bff6-365fd8c11216 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:27.038799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4940e56a-ae7b-4b7e-bff6-365fd8c11216 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:27.195623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4940e56a-ae7b-4b7e-bff6-365fd8c11216 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:27.204320 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4940e56a-ae7b-4b7e-bff6-365fd8c11216 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.180846 Aug 08 08:42:27.204903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 78/145] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:27 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:27.209949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0ad4ade4-1895-465b-b5d9-2e36a1c30c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:27.212235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0ad4ade4-1895-465b-b5d9-2e36a1c30c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:27.219827 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ad4ade4-1895-465b-b5d9-2e36a1c30c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:27.220313 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ad4ade4-1895-465b-b5d9-2e36a1c30c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:27.220748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ad4ade4-1895-465b-b5d9-2e36a1c30c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:27.221534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ad4ade4-1895-465b-b5d9-2e36a1c30c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:27.222318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ad4ade4-1895-465b-b5d9-2e36a1c30c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:27.223142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ad4ade4-1895-465b-b5d9-2e36a1c30c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:27.287589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-0ad4ade4-1895-465b-b5d9-2e36a1c30c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lazy-loading 'flavor' on Instance uuid 7125c9bf-f883-4fde-b50a-031fadb4cac1 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:42:27.715452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0ad4ade4-1895-465b-b5d9-2e36a1c30c62 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "POST /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1/action" status: 200 len: 32 microversion: 2.1 time: 0.509111 Aug 08 08:42:27.717938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 79/146] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:42:27 2022] POST /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1/action => generated 32 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 08:42:27.730773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4f51ed7f-ada1-44f1-88bd-86d06da64c2f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:27.731861 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4f51ed7f-ada1-44f1-88bd-86d06da64c2f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:27.741977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f51ed7f-ada1-44f1-88bd-86d06da64c2f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:27.742722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f51ed7f-ada1-44f1-88bd-86d06da64c2f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:27.743639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f51ed7f-ada1-44f1-88bd-86d06da64c2f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:27.744587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f51ed7f-ada1-44f1-88bd-86d06da64c2f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:27.745079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f51ed7f-ada1-44f1-88bd-86d06da64c2f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:27.745523 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f51ed7f-ada1-44f1-88bd-86d06da64c2f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:27.928947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4f51ed7f-ada1-44f1-88bd-86d06da64c2f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:27.937012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4f51ed7f-ada1-44f1-88bd-86d06da64c2f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1362 microversion: 2.1 time: 0.217493 Aug 08 08:42:27.937617 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 80/147] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:27 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:27.942121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-ed845df4-54d1-4bd2-8b28-be0623eed8b1 req-5186d3f3-dfe8-4d14-9e49-bbd9c6bece6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff4ce16-ea8e-4710-accb-cd6e5a31960a", "name": "network-vif-plugged", "status": "completed", "tag": "0ff18534-8066-4dea-9370-fd1122cb8da2"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:27.951704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-ed845df4-54d1-4bd2-8b28-be0623eed8b1 req-5186d3f3-dfe8-4d14-9e49-bbd9c6bece6b service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:27.952207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-ed845df4-54d1-4bd2-8b28-be0623eed8b1 req-5186d3f3-dfe8-4d14-9e49-bbd9c6bece6b service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:27.952643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-ed845df4-54d1-4bd2-8b28-be0623eed8b1 req-5186d3f3-dfe8-4d14-9e49-bbd9c6bece6b service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:27.964566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-ed845df4-54d1-4bd2-8b28-be0623eed8b1 req-5186d3f3-dfe8-4d14-9e49-bbd9c6bece6b service nova] Creating event network-vif-plugged:0ff18534-8066-4dea-9370-fd1122cb8da2 for instance fff4ce16-ea8e-4710-accb-cd6e5a31960a on hv-cinder-83697 Aug 08 08:42:27.970701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-ed845df4-54d1-4bd2-8b28-be0623eed8b1 req-5186d3f3-dfe8-4d14-9e49-bbd9c6bece6b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031734 Aug 08 08:42:27.971425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 81/148] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:27.977694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8af8ea7f-8061-4c75-9515-0246cefed94c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:27.978404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8af8ea7f-8061-4c75-9515-0246cefed94c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:27.985554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af8ea7f-8061-4c75-9515-0246cefed94c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:27.986043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af8ea7f-8061-4c75-9515-0246cefed94c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:27.986472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af8ea7f-8061-4c75-9515-0246cefed94c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:27.987202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af8ea7f-8061-4c75-9515-0246cefed94c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:27.987712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af8ea7f-8061-4c75-9515-0246cefed94c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:27.988136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af8ea7f-8061-4c75-9515-0246cefed94c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:28.023326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:28.134289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8af8ea7f-8061-4c75-9515-0246cefed94c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:28.137430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-85276d80-8bf7-43d0-a9c0-e43597cb3084 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "POST /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.296700 Aug 08 08:42:28.138205 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 68/149] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:42:25 2022] POST /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a/os-volume_attachments => generated 194 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:28.143878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8af8ea7f-8061-4c75-9515-0246cefed94c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.171242 Aug 08 08:42:28.144518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 82/150] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:27 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:28.227159 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a0aac09e-98b7-4bb5-8293-53a3fd68ec3a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:28.231467 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a0aac09e-98b7-4bb5-8293-53a3fd68ec3a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:28.240046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0aac09e-98b7-4bb5-8293-53a3fd68ec3a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:28.240928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0aac09e-98b7-4bb5-8293-53a3fd68ec3a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:28.242036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0aac09e-98b7-4bb5-8293-53a3fd68ec3a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:28.242993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0aac09e-98b7-4bb5-8293-53a3fd68ec3a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:28.243714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0aac09e-98b7-4bb5-8293-53a3fd68ec3a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:28.244426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0aac09e-98b7-4bb5-8293-53a3fd68ec3a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:28.518871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a0aac09e-98b7-4bb5-8293-53a3fd68ec3a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:28.526285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a0aac09e-98b7-4bb5-8293-53a3fd68ec3a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.303887 Aug 08 08:42:28.527046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 69/151] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:28 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:28.961842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1d2dadb4-a31e-4567-b844-851203f9897b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:28.962454 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1d2dadb4-a31e-4567-b844-851203f9897b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:28.969937 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d2dadb4-a31e-4567-b844-851203f9897b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:28.970437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d2dadb4-a31e-4567-b844-851203f9897b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:28.970882 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d2dadb4-a31e-4567-b844-851203f9897b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:28.971597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d2dadb4-a31e-4567-b844-851203f9897b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:28.972269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d2dadb4-a31e-4567-b844-851203f9897b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:28.972713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d2dadb4-a31e-4567-b844-851203f9897b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:29.114332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1d2dadb4-a31e-4567-b844-851203f9897b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:29.119310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1d2dadb4-a31e-4567-b844-851203f9897b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1549 microversion: 2.1 time: 0.161410 Aug 08 08:42:29.119913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 83/152] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:28 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:29.148413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f128d096-a44e-4252-a5e1-becb6d17818b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:29.149130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f128d096-a44e-4252-a5e1-becb6d17818b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:29.157314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f128d096-a44e-4252-a5e1-becb6d17818b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:29.157809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f128d096-a44e-4252-a5e1-becb6d17818b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:29.158293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f128d096-a44e-4252-a5e1-becb6d17818b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:29.159080 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f128d096-a44e-4252-a5e1-becb6d17818b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:29.159555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f128d096-a44e-4252-a5e1-becb6d17818b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:29.159983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f128d096-a44e-4252-a5e1-becb6d17818b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:29.165638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e79ff88f-1e80-4f1c-ade8-cbeb5a0a00d8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:29.166236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e79ff88f-1e80-4f1c-ade8-cbeb5a0a00d8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:29.172845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e79ff88f-1e80-4f1c-ade8-cbeb5a0a00d8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:29.173535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e79ff88f-1e80-4f1c-ade8-cbeb5a0a00d8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:29.174146 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e79ff88f-1e80-4f1c-ade8-cbeb5a0a00d8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:29.175000 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e79ff88f-1e80-4f1c-ade8-cbeb5a0a00d8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:29.175643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e79ff88f-1e80-4f1c-ade8-cbeb5a0a00d8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:29.176312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e79ff88f-1e80-4f1c-ade8-cbeb5a0a00d8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:29.307817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f128d096-a44e-4252-a5e1-becb6d17818b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163423 Aug 08 08:42:29.316269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 70/153] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 08:42:29 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:29.547639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-64f90aff-dfe2-41ac-8891-5984f92cd17c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:29.549043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-64f90aff-dfe2-41ac-8891-5984f92cd17c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:29.566070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f90aff-dfe2-41ac-8891-5984f92cd17c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:29.566570 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f90aff-dfe2-41ac-8891-5984f92cd17c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:29.567279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f90aff-dfe2-41ac-8891-5984f92cd17c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:29.574353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f90aff-dfe2-41ac-8891-5984f92cd17c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:29.575253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f90aff-dfe2-41ac-8891-5984f92cd17c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:29.576449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f90aff-dfe2-41ac-8891-5984f92cd17c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:29.621600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e79ff88f-1e80-4f1c-ade8-cbeb5a0a00d8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:29.633594 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e79ff88f-1e80-4f1c-ade8-cbeb5a0a00d8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.471949 Aug 08 08:42:29.634428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 84/154] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:29 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:29.801215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-64f90aff-dfe2-41ac-8891-5984f92cd17c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:29.812029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-64f90aff-dfe2-41ac-8891-5984f92cd17c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.268055 Aug 08 08:42:29.812828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 71/155] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:29 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:30.656649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3657fe69-67b1-4e94-87e4-af2f7d6ba253 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:30.666926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3657fe69-67b1-4e94-87e4-af2f7d6ba253 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:30.666926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3657fe69-67b1-4e94-87e4-af2f7d6ba253 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:30.666926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3657fe69-67b1-4e94-87e4-af2f7d6ba253 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:30.666926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3657fe69-67b1-4e94-87e4-af2f7d6ba253 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:30.667539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3657fe69-67b1-4e94-87e4-af2f7d6ba253 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:30.667539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3657fe69-67b1-4e94-87e4-af2f7d6ba253 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:30.667539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3657fe69-67b1-4e94-87e4-af2f7d6ba253 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:30.681282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-cb3e693b-9f8f-4502-a66a-9ea10a74b6f1 req-12b22e9d-1074-4c54-810c-6bada2d68066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8117a4bb-5bfc-41a1-a874-72c1266a8955", "tag": "45742616-a27a-4ad1-8004-5461bd902cbb"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:30.692379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-cb3e693b-9f8f-4502-a66a-9ea10a74b6f1 req-12b22e9d-1074-4c54-810c-6bada2d68066 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:30.693094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-cb3e693b-9f8f-4502-a66a-9ea10a74b6f1 req-12b22e9d-1074-4c54-810c-6bada2d68066 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:30.702329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-cb3e693b-9f8f-4502-a66a-9ea10a74b6f1 req-12b22e9d-1074-4c54-810c-6bada2d68066 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:30.707269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-cb3e693b-9f8f-4502-a66a-9ea10a74b6f1 req-12b22e9d-1074-4c54-810c-6bada2d68066 service nova] Creating event network-changed:45742616-a27a-4ad1-8004-5461bd902cbb for instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 on hv-cinder-83697 Aug 08 08:42:30.712731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-cb3e693b-9f8f-4502-a66a-9ea10a74b6f1 req-12b22e9d-1074-4c54-810c-6bada2d68066 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036270 Aug 08 08:42:30.713864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 72/156] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:30.835772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f3ed5b3b-fbd1-4a81-9df8-10eb30d0da36 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:30.837081 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f3ed5b3b-fbd1-4a81-9df8-10eb30d0da36 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:30.847148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3ed5b3b-fbd1-4a81-9df8-10eb30d0da36 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:30.848186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3ed5b3b-fbd1-4a81-9df8-10eb30d0da36 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:30.848758 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3ed5b3b-fbd1-4a81-9df8-10eb30d0da36 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:30.850294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3ed5b3b-fbd1-4a81-9df8-10eb30d0da36 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:30.850954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3ed5b3b-fbd1-4a81-9df8-10eb30d0da36 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:30.851696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3ed5b3b-fbd1-4a81-9df8-10eb30d0da36 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:30.880285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3657fe69-67b1-4e94-87e4-af2f7d6ba253 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:30.890673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3657fe69-67b1-4e94-87e4-af2f7d6ba253 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.238854 Aug 08 08:42:30.892413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 85/157] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:30 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:31.157086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f3ed5b3b-fbd1-4a81-9df8-10eb30d0da36 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:31.165232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f3ed5b3b-fbd1-4a81-9df8-10eb30d0da36 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1366 microversion: 2.1 time: 0.334808 Aug 08 08:42:31.167332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 73/158] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:30 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:31.913552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d073f791-7c54-41f5-8bd9-6eac74f98eae tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:31.913552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d073f791-7c54-41f5-8bd9-6eac74f98eae tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:31.919271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d073f791-7c54-41f5-8bd9-6eac74f98eae tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:31.919761 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d073f791-7c54-41f5-8bd9-6eac74f98eae tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:31.920242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d073f791-7c54-41f5-8bd9-6eac74f98eae tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:31.921481 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d073f791-7c54-41f5-8bd9-6eac74f98eae tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:31.921928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d073f791-7c54-41f5-8bd9-6eac74f98eae tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:31.922686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d073f791-7c54-41f5-8bd9-6eac74f98eae tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:32.120851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d073f791-7c54-41f5-8bd9-6eac74f98eae tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:32.129096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d073f791-7c54-41f5-8bd9-6eac74f98eae tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.220807 Aug 08 08:42:32.129894 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 86/159] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:31 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:32.188132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-424fb600-62ab-4169-bd8e-df00a3c40e14 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:32.188673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-424fb600-62ab-4169-bd8e-df00a3c40e14 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:32.195010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-424fb600-62ab-4169-bd8e-df00a3c40e14 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:32.195490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-424fb600-62ab-4169-bd8e-df00a3c40e14 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:32.195929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-424fb600-62ab-4169-bd8e-df00a3c40e14 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:32.196614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-424fb600-62ab-4169-bd8e-df00a3c40e14 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:32.197068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-424fb600-62ab-4169-bd8e-df00a3c40e14 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:32.197522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-424fb600-62ab-4169-bd8e-df00a3c40e14 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:32.360914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-424fb600-62ab-4169-bd8e-df00a3c40e14 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:32.368447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-424fb600-62ab-4169-bd8e-df00a3c40e14 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1557 microversion: 2.1 time: 0.184966 Aug 08 08:42:32.369017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 74/160] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:32 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1557 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:32.390973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-781317af-b018-411a-9c9b-98b0f4454162 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:32.391460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-781317af-b018-411a-9c9b-98b0f4454162 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:32.397468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-781317af-b018-411a-9c9b-98b0f4454162 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:32.397951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-781317af-b018-411a-9c9b-98b0f4454162 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:32.398386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-781317af-b018-411a-9c9b-98b0f4454162 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:32.399070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-781317af-b018-411a-9c9b-98b0f4454162 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:32.399522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-781317af-b018-411a-9c9b-98b0f4454162 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:32.400005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-781317af-b018-411a-9c9b-98b0f4454162 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:32.487208 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-781317af-b018-411a-9c9b-98b0f4454162 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100770 Aug 08 08:42:32.489167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 87/161] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 08:42:32 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:33.149478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d6a5fbaa-698a-4c4e-8eaa-35571f69dda1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:33.150124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d6a5fbaa-698a-4c4e-8eaa-35571f69dda1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:33.156098 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d6a5fbaa-698a-4c4e-8eaa-35571f69dda1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:33.156580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d6a5fbaa-698a-4c4e-8eaa-35571f69dda1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:33.157015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d6a5fbaa-698a-4c4e-8eaa-35571f69dda1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:33.157732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d6a5fbaa-698a-4c4e-8eaa-35571f69dda1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:33.158191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d6a5fbaa-698a-4c4e-8eaa-35571f69dda1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:33.158616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d6a5fbaa-698a-4c4e-8eaa-35571f69dda1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:33.598453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d6a5fbaa-698a-4c4e-8eaa-35571f69dda1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:33.606968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d6a5fbaa-698a-4c4e-8eaa-35571f69dda1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.461226 Aug 08 08:42:33.607618 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 75/162] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:33 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:34.026030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-417d239b-75c1-4153-b382-54172755871f req-dd7595c8-4b32-4be4-ae3f-770390f51e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fff4ce16-ea8e-4710-accb-cd6e5a31960a", "tag": "0ff18534-8066-4dea-9370-fd1122cb8da2"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:34.035879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-417d239b-75c1-4153-b382-54172755871f req-dd7595c8-4b32-4be4-ae3f-770390f51e06 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:34.036378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-417d239b-75c1-4153-b382-54172755871f req-dd7595c8-4b32-4be4-ae3f-770390f51e06 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:34.036831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-417d239b-75c1-4153-b382-54172755871f req-dd7595c8-4b32-4be4-ae3f-770390f51e06 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:34.048148 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-417d239b-75c1-4153-b382-54172755871f req-dd7595c8-4b32-4be4-ae3f-770390f51e06 service nova] Creating event network-changed:0ff18534-8066-4dea-9370-fd1122cb8da2 for instance fff4ce16-ea8e-4710-accb-cd6e5a31960a on hv-cinder-83697 Aug 08 08:42:34.055814 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-417d239b-75c1-4153-b382-54172755871f req-dd7595c8-4b32-4be4-ae3f-770390f51e06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033252 Aug 08 08:42:34.056700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 88/163] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:34.628248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-547d30c2-b815-4622-862d-b910e6eb46a9 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:34.629523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-547d30c2-b815-4622-862d-b910e6eb46a9 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:34.638381 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-547d30c2-b815-4622-862d-b910e6eb46a9 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:34.639619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-547d30c2-b815-4622-862d-b910e6eb46a9 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:34.640344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-547d30c2-b815-4622-862d-b910e6eb46a9 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:34.641479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-547d30c2-b815-4622-862d-b910e6eb46a9 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:34.642095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-547d30c2-b815-4622-862d-b910e6eb46a9 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:34.642664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-547d30c2-b815-4622-862d-b910e6eb46a9 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:34.815334 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-547d30c2-b815-4622-862d-b910e6eb46a9 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:34.823391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-547d30c2-b815-4622-862d-b910e6eb46a9 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.199371 Aug 08 08:42:34.824050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 76/164] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:34 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:35.845614 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5fdbb1ba-1ce8-4590-9f8b-e054beb56a61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:35.846339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5fdbb1ba-1ce8-4590-9f8b-e054beb56a61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:35.852799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5fdbb1ba-1ce8-4590-9f8b-e054beb56a61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:35.853612 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5fdbb1ba-1ce8-4590-9f8b-e054beb56a61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:35.855869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5fdbb1ba-1ce8-4590-9f8b-e054beb56a61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:35.856734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5fdbb1ba-1ce8-4590-9f8b-e054beb56a61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:35.857068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5fdbb1ba-1ce8-4590-9f8b-e054beb56a61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:35.857549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5fdbb1ba-1ce8-4590-9f8b-e054beb56a61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:35.998514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5fdbb1ba-1ce8-4590-9f8b-e054beb56a61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:36.006931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5fdbb1ba-1ce8-4590-9f8b-e054beb56a61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.165777 Aug 08 08:42:36.007681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 89/165] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:35 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:37.027770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-518fe857-83d3-46d6-82d4-ac79adb99da5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:37.028398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-518fe857-83d3-46d6-82d4-ac79adb99da5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:37.034878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-518fe857-83d3-46d6-82d4-ac79adb99da5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:37.035353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-518fe857-83d3-46d6-82d4-ac79adb99da5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:37.035785 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-518fe857-83d3-46d6-82d4-ac79adb99da5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:37.036461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-518fe857-83d3-46d6-82d4-ac79adb99da5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:37.036909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-518fe857-83d3-46d6-82d4-ac79adb99da5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:37.037358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-518fe857-83d3-46d6-82d4-ac79adb99da5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:37.167831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-518fe857-83d3-46d6-82d4-ac79adb99da5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:37.176308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-518fe857-83d3-46d6-82d4-ac79adb99da5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.152310 Aug 08 08:42:37.178926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 77/166] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:37 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:38.199968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3afcddbd-e8bb-47dd-89f9-9f7d783d402b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:38.200569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3afcddbd-e8bb-47dd-89f9-9f7d783d402b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:38.207633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3afcddbd-e8bb-47dd-89f9-9f7d783d402b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:38.208200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3afcddbd-e8bb-47dd-89f9-9f7d783d402b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:38.208545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3afcddbd-e8bb-47dd-89f9-9f7d783d402b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:38.209259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3afcddbd-e8bb-47dd-89f9-9f7d783d402b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:38.209712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3afcddbd-e8bb-47dd-89f9-9f7d783d402b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:38.210134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3afcddbd-e8bb-47dd-89f9-9f7d783d402b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:38.344593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3afcddbd-e8bb-47dd-89f9-9f7d783d402b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:38.352841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3afcddbd-e8bb-47dd-89f9-9f7d783d402b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.156602 Aug 08 08:42:38.353477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 90/167] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:38 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:39.375529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-73269144-37e9-46e0-8030-d00ab0bbdcf4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:39.376147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-73269144-37e9-46e0-8030-d00ab0bbdcf4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:39.378606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=84 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:39.383323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73269144-37e9-46e0-8030-d00ab0bbdcf4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:39.383893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73269144-37e9-46e0-8030-d00ab0bbdcf4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:39.384332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73269144-37e9-46e0-8030-d00ab0bbdcf4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:39.385029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73269144-37e9-46e0-8030-d00ab0bbdcf4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:39.385519 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73269144-37e9-46e0-8030-d00ab0bbdcf4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:39.390834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73269144-37e9-46e0-8030-d00ab0bbdcf4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:39.515787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-73269144-37e9-46e0-8030-d00ab0bbdcf4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:39.523302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-73269144-37e9-46e0-8030-d00ab0bbdcf4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.152466 Aug 08 08:42:39.523872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 78/168] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:39 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:40.544250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0cb6c582-0894-4532-b024-e4393169de84 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:40.545105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0cb6c582-0894-4532-b024-e4393169de84 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:40.551448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cb6c582-0894-4532-b024-e4393169de84 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:40.552028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cb6c582-0894-4532-b024-e4393169de84 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:40.552474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cb6c582-0894-4532-b024-e4393169de84 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:40.553220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cb6c582-0894-4532-b024-e4393169de84 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:40.553714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cb6c582-0894-4532-b024-e4393169de84 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:40.554382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cb6c582-0894-4532-b024-e4393169de84 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:40.690199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0cb6c582-0894-4532-b024-e4393169de84 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:40.697966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0cb6c582-0894-4532-b024-e4393169de84 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.157978 Aug 08 08:42:40.698519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 91/169] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:40 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:41.719469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-72024c00-5e7d-4702-8b16-58ff893ab01f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:41.722644 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-72024c00-5e7d-4702-8b16-58ff893ab01f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:41.727521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72024c00-5e7d-4702-8b16-58ff893ab01f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:41.728088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72024c00-5e7d-4702-8b16-58ff893ab01f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:41.728604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72024c00-5e7d-4702-8b16-58ff893ab01f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:41.729458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72024c00-5e7d-4702-8b16-58ff893ab01f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:41.730193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72024c00-5e7d-4702-8b16-58ff893ab01f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:41.730728 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72024c00-5e7d-4702-8b16-58ff893ab01f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:41.863454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-72024c00-5e7d-4702-8b16-58ff893ab01f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:41.870950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-72024c00-5e7d-4702-8b16-58ff893ab01f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.155892 Aug 08 08:42:41.871722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 79/170] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:41 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:42.891683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b8b4b4b6-6ff8-4be0-a46c-7bf8b4f3f772 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:42.892324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b8b4b4b6-6ff8-4be0-a46c-7bf8b4f3f772 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:42.898224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b4b4b6-6ff8-4be0-a46c-7bf8b4f3f772 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:42.898703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b4b4b6-6ff8-4be0-a46c-7bf8b4f3f772 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:42.899135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b4b4b6-6ff8-4be0-a46c-7bf8b4f3f772 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:42.899813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b4b4b6-6ff8-4be0-a46c-7bf8b4f3f772 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:42.900264 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b4b4b6-6ff8-4be0-a46c-7bf8b4f3f772 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:42.900681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b4b4b6-6ff8-4be0-a46c-7bf8b4f3f772 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:43.025900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b8b4b4b6-6ff8-4be0-a46c-7bf8b4f3f772 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:43.029530 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:43.034470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b8b4b4b6-6ff8-4be0-a46c-7bf8b4f3f772 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.146631 Aug 08 08:42:43.035024 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 92/171] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:42 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:44.055941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2ed74017-17fa-45df-b950-e77be5fb7f32 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:44.056580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2ed74017-17fa-45df-b950-e77be5fb7f32 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:44.063105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ed74017-17fa-45df-b950-e77be5fb7f32 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:44.063587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ed74017-17fa-45df-b950-e77be5fb7f32 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:44.064020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ed74017-17fa-45df-b950-e77be5fb7f32 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:44.064867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ed74017-17fa-45df-b950-e77be5fb7f32 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:44.065344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ed74017-17fa-45df-b950-e77be5fb7f32 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:44.065770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ed74017-17fa-45df-b950-e77be5fb7f32 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:44.225456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2ed74017-17fa-45df-b950-e77be5fb7f32 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:44.233306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2ed74017-17fa-45df-b950-e77be5fb7f32 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.181502 Aug 08 08:42:44.237331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 80/172] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:44 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:42:44.676730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dd7a3c4a-eb5c-495a-9bc1-74a8f36a9e42 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:44.677335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dd7a3c4a-eb5c-495a-9bc1-74a8f36a9e42 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:44.683607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd7a3c4a-eb5c-495a-9bc1-74a8f36a9e42 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:44.684180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd7a3c4a-eb5c-495a-9bc1-74a8f36a9e42 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:44.684680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd7a3c4a-eb5c-495a-9bc1-74a8f36a9e42 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:44.685516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd7a3c4a-eb5c-495a-9bc1-74a8f36a9e42 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:44.686037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd7a3c4a-eb5c-495a-9bc1-74a8f36a9e42 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:44.686531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd7a3c4a-eb5c-495a-9bc1-74a8f36a9e42 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:44.712569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dd7a3c4a-eb5c-495a-9bc1-74a8f36a9e42 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:42:45.083230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dd7a3c4a-eb5c-495a-9bc1-74a8f36a9e42 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 204 len: 0 microversion: 2.1 time: 0.410378 Aug 08 08:42:45.083818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 93/173] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:42:44 2022] DELETE /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 08:42:45.092132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3db7a933-882d-4d26-ae9b-413fe6c9af8c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:45.092781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3db7a933-882d-4d26-ae9b-413fe6c9af8c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:45.100072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3db7a933-882d-4d26-ae9b-413fe6c9af8c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:45.100592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3db7a933-882d-4d26-ae9b-413fe6c9af8c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:45.101031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3db7a933-882d-4d26-ae9b-413fe6c9af8c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:45.101751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3db7a933-882d-4d26-ae9b-413fe6c9af8c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:45.102205 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3db7a933-882d-4d26-ae9b-413fe6c9af8c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:45.102659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3db7a933-882d-4d26-ae9b-413fe6c9af8c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:45.231358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3db7a933-882d-4d26-ae9b-413fe6c9af8c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:45.239937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3db7a933-882d-4d26-ae9b-413fe6c9af8c tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1552 microversion: 2.1 time: 0.151761 Aug 08 08:42:45.240493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 81/174] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:45 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:45.256467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8d0c3526-ee53-4b47-a2ea-968411bf0568 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:45.257742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8d0c3526-ee53-4b47-a2ea-968411bf0568 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:45.263167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d0c3526-ee53-4b47-a2ea-968411bf0568 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:45.263624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d0c3526-ee53-4b47-a2ea-968411bf0568 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:45.264056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d0c3526-ee53-4b47-a2ea-968411bf0568 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:45.264736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d0c3526-ee53-4b47-a2ea-968411bf0568 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:45.265344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d0c3526-ee53-4b47-a2ea-968411bf0568 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:45.265876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d0c3526-ee53-4b47-a2ea-968411bf0568 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:45.426904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8d0c3526-ee53-4b47-a2ea-968411bf0568 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:45.434714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8d0c3526-ee53-4b47-a2ea-968411bf0568 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.182428 Aug 08 08:42:45.435269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 94/175] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:45 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:46.260133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b0c7e5a9-ad49-4959-b4e7-98de028af066 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:46.260820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b0c7e5a9-ad49-4959-b4e7-98de028af066 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:46.268026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0c7e5a9-ad49-4959-b4e7-98de028af066 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:46.271093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0c7e5a9-ad49-4959-b4e7-98de028af066 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:46.271093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0c7e5a9-ad49-4959-b4e7-98de028af066 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:46.271093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0c7e5a9-ad49-4959-b4e7-98de028af066 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:46.271093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0c7e5a9-ad49-4959-b4e7-98de028af066 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:46.271411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0c7e5a9-ad49-4959-b4e7-98de028af066 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:46.398465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b0c7e5a9-ad49-4959-b4e7-98de028af066 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:46.407007 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b0c7e5a9-ad49-4959-b4e7-98de028af066 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1552 microversion: 2.1 time: 0.150848 Aug 08 08:42:46.407571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 82/176] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:46 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:46.456136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dd42e342-de46-45bc-b328-96501fdfb912 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:46.456749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dd42e342-de46-45bc-b328-96501fdfb912 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:46.462875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd42e342-de46-45bc-b328-96501fdfb912 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:46.463410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd42e342-de46-45bc-b328-96501fdfb912 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:46.463876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd42e342-de46-45bc-b328-96501fdfb912 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:46.464543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd42e342-de46-45bc-b328-96501fdfb912 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:46.464990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd42e342-de46-45bc-b328-96501fdfb912 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:46.465451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd42e342-de46-45bc-b328-96501fdfb912 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:46.599609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dd42e342-de46-45bc-b328-96501fdfb912 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:46.607373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dd42e342-de46-45bc-b328-96501fdfb912 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.155668 Aug 08 08:42:46.607930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 95/177] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:46 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:47.434734 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4abccae3-af5c-4036-b32a-72abe4599644 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:47.435345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4abccae3-af5c-4036-b32a-72abe4599644 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:47.441815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4abccae3-af5c-4036-b32a-72abe4599644 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:47.442302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4abccae3-af5c-4036-b32a-72abe4599644 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:47.442737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4abccae3-af5c-4036-b32a-72abe4599644 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:47.443433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4abccae3-af5c-4036-b32a-72abe4599644 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:47.443891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4abccae3-af5c-4036-b32a-72abe4599644 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:47.444318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4abccae3-af5c-4036-b32a-72abe4599644 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:47.578691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4abccae3-af5c-4036-b32a-72abe4599644 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:47.584498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4abccae3-af5c-4036-b32a-72abe4599644 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1552 microversion: 2.1 time: 0.153557 Aug 08 08:42:47.585072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 83/178] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:47 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:47.627665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4ba213bc-2475-4ded-94ce-8942b1fba89e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:47.628314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4ba213bc-2475-4ded-94ce-8942b1fba89e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:47.634389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ba213bc-2475-4ded-94ce-8942b1fba89e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:47.634877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ba213bc-2475-4ded-94ce-8942b1fba89e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:47.635311 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ba213bc-2475-4ded-94ce-8942b1fba89e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:47.636004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ba213bc-2475-4ded-94ce-8942b1fba89e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:47.636460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ba213bc-2475-4ded-94ce-8942b1fba89e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:47.636893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ba213bc-2475-4ded-94ce-8942b1fba89e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:47.771874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4ba213bc-2475-4ded-94ce-8942b1fba89e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:47.779984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4ba213bc-2475-4ded-94ce-8942b1fba89e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.156164 Aug 08 08:42:47.792673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 96/179] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:47 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:48.618926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7c224921-58a0-43e6-bbf0-6b4027d2032b tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:48.626229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7c224921-58a0-43e6-bbf0-6b4027d2032b tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:48.641099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c224921-58a0-43e6-bbf0-6b4027d2032b tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:48.644499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c224921-58a0-43e6-bbf0-6b4027d2032b tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:48.645166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c224921-58a0-43e6-bbf0-6b4027d2032b tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:48.646231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c224921-58a0-43e6-bbf0-6b4027d2032b tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:48.646935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c224921-58a0-43e6-bbf0-6b4027d2032b tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:48.647575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c224921-58a0-43e6-bbf0-6b4027d2032b tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:48.660159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-2c8ab4bd-9ff5-489d-beb2-f900d180e2cd req-c4330bef-368a-4e08-84de-fdb765568995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c8af4b-cc42-4abc-9451-141a3b8d7f0a", "name": "network-vif-deleted", "tag": "18ac550c-5a89-4fc0-8a55-4e35711b1e3c"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:42:48.672697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2c8ab4bd-9ff5-489d-beb2-f900d180e2cd req-c4330bef-368a-4e08-84de-fdb765568995 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:48.673764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2c8ab4bd-9ff5-489d-beb2-f900d180e2cd req-c4330bef-368a-4e08-84de-fdb765568995 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:48.674398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2c8ab4bd-9ff5-489d-beb2-f900d180e2cd req-c4330bef-368a-4e08-84de-fdb765568995 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:48.689125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-2c8ab4bd-9ff5-489d-beb2-f900d180e2cd req-c4330bef-368a-4e08-84de-fdb765568995 service nova] Creating event network-vif-deleted:18ac550c-5a89-4fc0-8a55-4e35711b1e3c for instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a on hv-cinder-83697 Aug 08 08:42:48.694891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-2c8ab4bd-9ff5-489d-beb2-f900d180e2cd req-c4330bef-368a-4e08-84de-fdb765568995 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040342 Aug 08 08:42:48.696230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 97/180] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:42:48.741906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7c224921-58a0-43e6-bbf0-6b4027d2032b tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:48.750745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7c224921-58a0-43e6-bbf0-6b4027d2032b tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1510 microversion: 2.1 time: 0.147493 Aug 08 08:42:48.751321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 84/181] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:48 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:48.804213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-87fa281e-80be-431e-9436-f4f80df9898a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:48.807483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-87fa281e-80be-431e-9436-f4f80df9898a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:48.812082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87fa281e-80be-431e-9436-f4f80df9898a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:48.812582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87fa281e-80be-431e-9436-f4f80df9898a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:48.813134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87fa281e-80be-431e-9436-f4f80df9898a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:48.813869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87fa281e-80be-431e-9436-f4f80df9898a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:48.814332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87fa281e-80be-431e-9436-f4f80df9898a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:48.815060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87fa281e-80be-431e-9436-f4f80df9898a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:48.954853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-87fa281e-80be-431e-9436-f4f80df9898a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:48.962821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-87fa281e-80be-431e-9436-f4f80df9898a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.162858 Aug 08 08:42:48.963384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 98/182] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:48 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:49.771833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:49.772491 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:49.778483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:49.778966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:49.779387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:49.780072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:49.780524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:49.781505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:49.814789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:49.815274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:49.815704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:49.816158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lazy-loading 'fault' on Instance uuid a4c8af4b-cc42-4abc-9451-141a3b8d7f0a {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:42:49.862889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489aa74b7ab34d5789416739b8751473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee46083a26948a9a4aba2068f5c816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:49.870856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ac9ca17e-cc12-42a1-84f0-a7ca15e4102e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 200 len: 1350 microversion: 2.1 time: 0.102907 Aug 08 08:42:49.871512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 85/183] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:49 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:49.984164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c5d9a781-3acc-4f73-a2c4-bfe135644c67 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:49.984703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c5d9a781-3acc-4f73-a2c4-bfe135644c67 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:49.990753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5d9a781-3acc-4f73-a2c4-bfe135644c67 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:49.994619 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5d9a781-3acc-4f73-a2c4-bfe135644c67 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:49.994619 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5d9a781-3acc-4f73-a2c4-bfe135644c67 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:49.994619 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5d9a781-3acc-4f73-a2c4-bfe135644c67 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:49.994619 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5d9a781-3acc-4f73-a2c4-bfe135644c67 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:49.994943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5d9a781-3acc-4f73-a2c4-bfe135644c67 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:50.123547 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c5d9a781-3acc-4f73-a2c4-bfe135644c67 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:50.131322 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c5d9a781-3acc-4f73-a2c4-bfe135644c67 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.151251 Aug 08 08:42:50.131884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 99/184] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:49 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:50.892487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:50.893219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:50.899624 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:50.900180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:50.900678 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:50.901481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:50.902064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:50.902569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:50.907764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:50.916428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] HTTP exception thrown: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Request method failure captured: Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a HTTP/1.1 Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxFpUdyMQzCoSa8emVisVEpAcB6Y97l8YfYgt8rHXCR4UC1AsToSa9RDmIZtsTu2ICgjt4dg_kCJRTqrB9WaBICM8VurUAIjI91W7xlFQQ3-kzLJCq2f1ado7Hx7rnDJ7UnhMzVP0S8KiaRODg7DnyhbcUIblU4CXcUAdJ79Wjw_Rg Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: cee46083a26948a9a4aba2068f5c816c Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:42:50.921136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: cee46083a26948a9a4aba2068f5c816c Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-DeleteServersTestJSON-1733137092-project Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 489aa74b7ab34d5789416739b8751473 Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-DeleteServersTestJSON-1733137092-project Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:50.922800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': 'a4c8af4b-cc42-4abc-9451-141a3b8d7f0a'} Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:42:50.923643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:50.925069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:42:50.932228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Returning 404 to user: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:42:50.932228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7b2fe6c4-3025-44f2-b847-b566fb612651 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 404 len: 111 microversion: 2.1 time: 0.034759 Aug 08 08:42:50.932228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 86/185] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:50 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:42:51.071628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:51.073901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:51.080681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:51.081250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:51.082038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:51.082740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:51.083200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:51.083634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:51.097956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] HTTP exception thrown: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Request method failure captured: Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a/os-volume_attachments HTTP/1.1 Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxFpUdyMQzCoSa8emVisVEpAcB6Y97l8YfYgt8rHXCR4UC1AsToSa9RDmIZtsTu2ICgjt4dg_kCJRTqrB9WaBICM8VurUAIjI91W7xlFQQ3-kzLJCq2f1ado7Hx7rnDJ7UnhMzVP0S8KiaRODg7DnyhbcUIblU4CXcUAdJ79Wjw_Rg Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: cee46083a26948a9a4aba2068f5c816c Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:42:51.103098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: cee46083a26948a9a4aba2068f5c816c Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-DeleteServersTestJSON-1733137092-project Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 489aa74b7ab34d5789416739b8751473 Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-DeleteServersTestJSON-1733137092-project Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:51.104479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'server_id': 'a4c8af4b-cc42-4abc-9451-141a3b8d7f0a'} Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:42:51.105277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:51.106393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:42:51.107482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Returning 404 to user: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:42:51.107482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-60e471d4-0ca1-433d-9534-5806aac8640e tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036926 Aug 08 08:42:51.107482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 100/186] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:42:51 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:42:51.152381 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-354c9273-9480-402d-b6ba-0da4dbbd61b0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:51.152983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-354c9273-9480-402d-b6ba-0da4dbbd61b0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:51.159179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-354c9273-9480-402d-b6ba-0da4dbbd61b0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:51.159662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-354c9273-9480-402d-b6ba-0da4dbbd61b0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:51.160090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-354c9273-9480-402d-b6ba-0da4dbbd61b0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:51.161047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-354c9273-9480-402d-b6ba-0da4dbbd61b0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:51.161550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-354c9273-9480-402d-b6ba-0da4dbbd61b0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:51.161971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-354c9273-9480-402d-b6ba-0da4dbbd61b0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:51.291791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-354c9273-9480-402d-b6ba-0da4dbbd61b0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:51.299448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-354c9273-9480-402d-b6ba-0da4dbbd61b0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.151195 Aug 08 08:42:51.300029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 87/187] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:51 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:52.320588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-24e175b4-736d-4af4-b198-9543130f597b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:52.321136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-24e175b4-736d-4af4-b198-9543130f597b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:52.323169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:42:52.328346 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24e175b4-736d-4af4-b198-9543130f597b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:52.328901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24e175b4-736d-4af4-b198-9543130f597b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:52.329373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24e175b4-736d-4af4-b198-9543130f597b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:52.330058 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24e175b4-736d-4af4-b198-9543130f597b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:52.332570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24e175b4-736d-4af4-b198-9543130f597b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:52.332570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24e175b4-736d-4af4-b198-9543130f597b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:52.461386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-24e175b4-736d-4af4-b198-9543130f597b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:52.469857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-24e175b4-736d-4af4-b198-9543130f597b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.153181 Aug 08 08:42:52.470417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 101/188] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:52 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:53.490265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-915dd20d-8562-44a0-9dea-868122ff9ac5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:53.490828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-915dd20d-8562-44a0-9dea-868122ff9ac5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:53.496413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-915dd20d-8562-44a0-9dea-868122ff9ac5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:53.496893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-915dd20d-8562-44a0-9dea-868122ff9ac5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:53.497367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-915dd20d-8562-44a0-9dea-868122ff9ac5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:53.498053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-915dd20d-8562-44a0-9dea-868122ff9ac5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:53.498505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-915dd20d-8562-44a0-9dea-868122ff9ac5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:53.498926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-915dd20d-8562-44a0-9dea-868122ff9ac5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:53.631223 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-915dd20d-8562-44a0-9dea-868122ff9ac5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:53.638961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-915dd20d-8562-44a0-9dea-868122ff9ac5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.152970 Aug 08 08:42:53.639522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 88/189] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:53 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:54.660337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bf237eff-bb95-4f20-8d8d-3ee7e523e650 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:54.661012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bf237eff-bb95-4f20-8d8d-3ee7e523e650 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:54.666871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf237eff-bb95-4f20-8d8d-3ee7e523e650 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:54.667350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf237eff-bb95-4f20-8d8d-3ee7e523e650 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:54.667834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf237eff-bb95-4f20-8d8d-3ee7e523e650 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:54.668520 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf237eff-bb95-4f20-8d8d-3ee7e523e650 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:54.668970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf237eff-bb95-4f20-8d8d-3ee7e523e650 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:54.669497 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf237eff-bb95-4f20-8d8d-3ee7e523e650 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:54.804499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bf237eff-bb95-4f20-8d8d-3ee7e523e650 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:54.811775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bf237eff-bb95-4f20-8d8d-3ee7e523e650 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.155888 Aug 08 08:42:54.812328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 102/190] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:54 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:55.586488 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:55.587492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:55.593695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:55.594557 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:55.595043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:55.596796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:55.597304 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:55.597743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:55.612383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] HTTP exception thrown: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Request method failure captured: Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a HTTP/1.1 Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxFpUdyMQzCoSa8emVisVEpAcB6Y97l8YfYgt8rHXCR4UC1AsToSa9RDmIZtsTu2ICgjt4dg_kCJRTqrB9WaBICM8VurUAIjI91W7xlFQQ3-kzLJCq2f1ado7Hx7rnDJ7UnhMzVP0S8KiaRODg7DnyhbcUIblU4CXcUAdJ79Wjw_Rg Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: cee46083a26948a9a4aba2068f5c816c Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:42:55.613971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: cee46083a26948a9a4aba2068f5c816c Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-DeleteServersTestJSON-1733137092-project Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 489aa74b7ab34d5789416739b8751473 Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-DeleteServersTestJSON-1733137092-project Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:55.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': 'a4c8af4b-cc42-4abc-9451-141a3b8d7f0a'} Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:42:55.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:55.617459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:42:55.618782 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Returning 404 to user: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:42:55.618782 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5359d69b-278b-4d89-8009-1c0035e18d40 tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 404 len: 111 microversion: 2.1 time: 0.033056 Aug 08 08:42:55.618782 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 89/191] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:42:55 2022] DELETE /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:42:55.624128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:55.624738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] [instance: a4c8af4b-cc42-4abc-9451-141a3b8d7f0a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:55.631686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:55.632180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:55.632609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:55.633337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:55.633819 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:55.634277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:55.649006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] HTTP exception thrown: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Request method failure captured: Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a HTTP/1.1 Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxFpUdyMQzCoSa8emVisVEpAcB6Y97l8YfYgt8rHXCR4UC1AsToSa9RDmIZtsTu2ICgjt4dg_kCJRTqrB9WaBICM8VurUAIjI91W7xlFQQ3-kzLJCq2f1ado7Hx7rnDJ7UnhMzVP0S8KiaRODg7DnyhbcUIblU4CXcUAdJ79Wjw_Rg Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: cee46083a26948a9a4aba2068f5c816c Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:42:55.651388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cee46083a26948a9a4aba2068f5c816c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: cee46083a26948a9a4aba2068f5c816c Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-DeleteServersTestJSON-1733137092 Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-DeleteServersTestJSON-1733137092-project Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 489aa74b7ab34d5789416739b8751473 Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-DeleteServersTestJSON-1733137092-project Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:55.652600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'a4c8af4b-cc42-4abc-9451-141a3b8d7f0a'} Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:42:55.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. Aug 08 08:42:55.654421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:42:55.655342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] Returning 404 to user: Instance a4c8af4b-cc42-4abc-9451-141a3b8d7f0a could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:42:55.655342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8f7c9397-3245-4a05-a536-aa073081fb6f tempest-DeleteServersTestJSON-1733137092 tempest-DeleteServersTestJSON-1733137092-project] 10.222.0.33 "GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a" status: 404 len: 111 microversion: 2.1 time: 0.032777 Aug 08 08:42:55.655342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 103/192] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:55 2022] GET /compute/v2.1/servers/a4c8af4b-cc42-4abc-9451-141a3b8d7f0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:42:55.833568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-17a1888f-3565-4f1f-95b4-232bb14c25be tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:55.834376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-17a1888f-3565-4f1f-95b4-232bb14c25be tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:55.841034 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17a1888f-3565-4f1f-95b4-232bb14c25be tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:55.841707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17a1888f-3565-4f1f-95b4-232bb14c25be tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:55.842014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17a1888f-3565-4f1f-95b4-232bb14c25be tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:55.842727 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17a1888f-3565-4f1f-95b4-232bb14c25be tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:55.843185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17a1888f-3565-4f1f-95b4-232bb14c25be tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:55.843611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17a1888f-3565-4f1f-95b4-232bb14c25be tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:56.247710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-17a1888f-3565-4f1f-95b4-232bb14c25be tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:56.255641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-17a1888f-3565-4f1f-95b4-232bb14c25be tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.427436 Aug 08 08:42:56.256193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 90/193] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:55 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:57.286603 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-351b6aae-cb48-4359-ba23-4434fb01aa59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:57.287393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-351b6aae-cb48-4359-ba23-4434fb01aa59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:57.293982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-351b6aae-cb48-4359-ba23-4434fb01aa59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:57.294473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-351b6aae-cb48-4359-ba23-4434fb01aa59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:57.294911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-351b6aae-cb48-4359-ba23-4434fb01aa59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:57.295616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-351b6aae-cb48-4359-ba23-4434fb01aa59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:57.296110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-351b6aae-cb48-4359-ba23-4434fb01aa59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:57.297464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-351b6aae-cb48-4359-ba23-4434fb01aa59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:57.537117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-351b6aae-cb48-4359-ba23-4434fb01aa59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:57.544577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-351b6aae-cb48-4359-ba23-4434fb01aa59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.266288 Aug 08 08:42:57.545137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 104/194] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:57 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:58.566610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7079d9dc-c1ed-4c11-8660-3fd5d3794f01 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:58.568147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7079d9dc-c1ed-4c11-8660-3fd5d3794f01 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:58.578913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7079d9dc-c1ed-4c11-8660-3fd5d3794f01 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:58.579567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7079d9dc-c1ed-4c11-8660-3fd5d3794f01 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:58.580351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7079d9dc-c1ed-4c11-8660-3fd5d3794f01 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:58.581071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7079d9dc-c1ed-4c11-8660-3fd5d3794f01 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:58.581560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7079d9dc-c1ed-4c11-8660-3fd5d3794f01 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:58.581993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7079d9dc-c1ed-4c11-8660-3fd5d3794f01 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:58.726930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7079d9dc-c1ed-4c11-8660-3fd5d3794f01 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:58.734642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7079d9dc-c1ed-4c11-8660-3fd5d3794f01 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.172730 Aug 08 08:42:58.735212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 91/195] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:58 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:42:59.756911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c8534910-1cb8-4630-a001-af9dab45186d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:42:59.758316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c8534910-1cb8-4630-a001-af9dab45186d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:42:59.765535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8534910-1cb8-4630-a001-af9dab45186d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:59.765535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8534910-1cb8-4630-a001-af9dab45186d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:59.765535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8534910-1cb8-4630-a001-af9dab45186d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:59.766101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8534910-1cb8-4630-a001-af9dab45186d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:42:59.767091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8534910-1cb8-4630-a001-af9dab45186d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:42:59.767517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8534910-1cb8-4630-a001-af9dab45186d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:42:59.963429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c8534910-1cb8-4630-a001-af9dab45186d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:42:59.975151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c8534910-1cb8-4630-a001-af9dab45186d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.220335 Aug 08 08:42:59.975151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 105/196] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:42:59 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:00.994552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-225c1067-2759-422c-bf18-112371b8abec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:00.998228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-225c1067-2759-422c-bf18-112371b8abec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:01.002536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225c1067-2759-422c-bf18-112371b8abec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:01.003027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225c1067-2759-422c-bf18-112371b8abec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:01.003811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225c1067-2759-422c-bf18-112371b8abec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:01.004518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225c1067-2759-422c-bf18-112371b8abec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:01.004979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225c1067-2759-422c-bf18-112371b8abec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:01.005430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225c1067-2759-422c-bf18-112371b8abec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:01.148166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-225c1067-2759-422c-bf18-112371b8abec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:01.156455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-225c1067-2759-422c-bf18-112371b8abec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.165895 Aug 08 08:43:01.162059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 92/197] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:00 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:02.178356 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b7a8ea42-39f7-4451-8c3d-6236aeb5cda8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:02.178972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b7a8ea42-39f7-4451-8c3d-6236aeb5cda8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:02.185087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea42-39f7-4451-8c3d-6236aeb5cda8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:02.185616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea42-39f7-4451-8c3d-6236aeb5cda8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:02.186049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea42-39f7-4451-8c3d-6236aeb5cda8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:02.186756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea42-39f7-4451-8c3d-6236aeb5cda8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:02.187212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea42-39f7-4451-8c3d-6236aeb5cda8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:02.187639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea42-39f7-4451-8c3d-6236aeb5cda8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:02.337316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b7a8ea42-39f7-4451-8c3d-6236aeb5cda8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:02.341007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b7a8ea42-39f7-4451-8c3d-6236aeb5cda8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.166505 Aug 08 08:43:02.341596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 106/198] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:02 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:03.362991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-baf36e17-a83a-4a03-807a-d742837f7473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:03.363607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-baf36e17-a83a-4a03-807a-d742837f7473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:03.369926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baf36e17-a83a-4a03-807a-d742837f7473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:03.372523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baf36e17-a83a-4a03-807a-d742837f7473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:03.372523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baf36e17-a83a-4a03-807a-d742837f7473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:03.372523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baf36e17-a83a-4a03-807a-d742837f7473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:03.372523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baf36e17-a83a-4a03-807a-d742837f7473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:03.372926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baf36e17-a83a-4a03-807a-d742837f7473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:03.506496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-baf36e17-a83a-4a03-807a-d742837f7473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:03.514155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-baf36e17-a83a-4a03-807a-d742837f7473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.155647 Aug 08 08:43:03.514827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 93/199] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:03 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:04.534585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-80dd9e6a-fcb7-49da-9959-5d1a8495159f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:04.535201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-80dd9e6a-fcb7-49da-9959-5d1a8495159f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:04.541092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80dd9e6a-fcb7-49da-9959-5d1a8495159f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:04.541608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80dd9e6a-fcb7-49da-9959-5d1a8495159f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:04.542037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80dd9e6a-fcb7-49da-9959-5d1a8495159f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:04.542720 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80dd9e6a-fcb7-49da-9959-5d1a8495159f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:04.543173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80dd9e6a-fcb7-49da-9959-5d1a8495159f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:04.543601 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80dd9e6a-fcb7-49da-9959-5d1a8495159f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:04.693022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-80dd9e6a-fcb7-49da-9959-5d1a8495159f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:04.700631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-80dd9e6a-fcb7-49da-9959-5d1a8495159f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.169953 Aug 08 08:43:04.701240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 107/200] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:04 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:05.722217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1cf1bc67-0177-4be9-8fed-b9ac38b67c0a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:05.722893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1cf1bc67-0177-4be9-8fed-b9ac38b67c0a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:05.731960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf1bc67-0177-4be9-8fed-b9ac38b67c0a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:05.731960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf1bc67-0177-4be9-8fed-b9ac38b67c0a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:05.731960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf1bc67-0177-4be9-8fed-b9ac38b67c0a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:05.732729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf1bc67-0177-4be9-8fed-b9ac38b67c0a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:05.733406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf1bc67-0177-4be9-8fed-b9ac38b67c0a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:05.734021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf1bc67-0177-4be9-8fed-b9ac38b67c0a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:05.907006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1cf1bc67-0177-4be9-8fed-b9ac38b67c0a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:05.916800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1cf1bc67-0177-4be9-8fed-b9ac38b67c0a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.198866 Aug 08 08:43:05.928934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 94/201] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:05 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:06.940165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f945da3b-7ead-4466-825a-133d70940a02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:06.940772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f945da3b-7ead-4466-825a-133d70940a02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:06.946762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f945da3b-7ead-4466-825a-133d70940a02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:06.947244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f945da3b-7ead-4466-825a-133d70940a02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:06.947676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f945da3b-7ead-4466-825a-133d70940a02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:06.948373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f945da3b-7ead-4466-825a-133d70940a02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:06.948909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f945da3b-7ead-4466-825a-133d70940a02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:06.949363 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f945da3b-7ead-4466-825a-133d70940a02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:07.094845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f945da3b-7ead-4466-825a-133d70940a02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:07.105365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f945da3b-7ead-4466-825a-133d70940a02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.170110 Aug 08 08:43:07.106141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 108/202] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:06 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:08.126132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d1d39bef-6f8c-48fa-a7a9-8db182c5cc07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:08.132915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d1d39bef-6f8c-48fa-a7a9-8db182c5cc07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:08.135673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d39bef-6f8c-48fa-a7a9-8db182c5cc07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:08.136161 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d39bef-6f8c-48fa-a7a9-8db182c5cc07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:08.136600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d39bef-6f8c-48fa-a7a9-8db182c5cc07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:08.137367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d39bef-6f8c-48fa-a7a9-8db182c5cc07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:08.137847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d39bef-6f8c-48fa-a7a9-8db182c5cc07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:08.138264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d39bef-6f8c-48fa-a7a9-8db182c5cc07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:08.275214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d1d39bef-6f8c-48fa-a7a9-8db182c5cc07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:08.283480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d1d39bef-6f8c-48fa-a7a9-8db182c5cc07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.161109 Aug 08 08:43:08.284029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 95/203] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:08 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:09.305610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6680354c-e5a5-4c17-8e5d-91c1086d517f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:09.307381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6680354c-e5a5-4c17-8e5d-91c1086d517f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:09.319142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6680354c-e5a5-4c17-8e5d-91c1086d517f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:09.319142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6680354c-e5a5-4c17-8e5d-91c1086d517f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:09.319142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6680354c-e5a5-4c17-8e5d-91c1086d517f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:09.319142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6680354c-e5a5-4c17-8e5d-91c1086d517f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:09.319593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6680354c-e5a5-4c17-8e5d-91c1086d517f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:09.319593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6680354c-e5a5-4c17-8e5d-91c1086d517f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:09.460501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6680354c-e5a5-4c17-8e5d-91c1086d517f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:09.464059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:09.468461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6680354c-e5a5-4c17-8e5d-91c1086d517f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.167553 Aug 08 08:43:09.469019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 109/204] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:09 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:10.491280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-14618dd9-b606-439d-ac04-21d7112662a6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:10.492405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-14618dd9-b606-439d-ac04-21d7112662a6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:10.494939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=38 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:10.499703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14618dd9-b606-439d-ac04-21d7112662a6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:10.500205 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14618dd9-b606-439d-ac04-21d7112662a6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:10.500648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14618dd9-b606-439d-ac04-21d7112662a6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:10.508563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14618dd9-b606-439d-ac04-21d7112662a6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:10.508563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14618dd9-b606-439d-ac04-21d7112662a6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:10.508563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14618dd9-b606-439d-ac04-21d7112662a6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:10.708759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-14618dd9-b606-439d-ac04-21d7112662a6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:10.718275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-14618dd9-b606-439d-ac04-21d7112662a6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.230823 Aug 08 08:43:10.718933 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 96/205] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:10 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:11.744342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-20ee55ef-44d5-4bfb-a16a-2ea49841b1cc tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:11.746300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-20ee55ef-44d5-4bfb-a16a-2ea49841b1cc tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:11.753411 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ee55ef-44d5-4bfb-a16a-2ea49841b1cc tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:11.754646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ee55ef-44d5-4bfb-a16a-2ea49841b1cc tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:11.755153 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ee55ef-44d5-4bfb-a16a-2ea49841b1cc tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:11.755992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ee55ef-44d5-4bfb-a16a-2ea49841b1cc tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:11.756660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ee55ef-44d5-4bfb-a16a-2ea49841b1cc tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:11.757204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ee55ef-44d5-4bfb-a16a-2ea49841b1cc tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:11.909473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-20ee55ef-44d5-4bfb-a16a-2ea49841b1cc tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:11.917252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-20ee55ef-44d5-4bfb-a16a-2ea49841b1cc tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.179643 Aug 08 08:43:11.917820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 110/206] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:11 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:12.940949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fb06fad0-2d97-468c-86e3-5e54af505b06 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:12.941945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fb06fad0-2d97-468c-86e3-5e54af505b06 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:12.950489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb06fad0-2d97-468c-86e3-5e54af505b06 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:12.951122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb06fad0-2d97-468c-86e3-5e54af505b06 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:12.951661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb06fad0-2d97-468c-86e3-5e54af505b06 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:12.952534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb06fad0-2d97-468c-86e3-5e54af505b06 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:12.953277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb06fad0-2d97-468c-86e3-5e54af505b06 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:12.954116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb06fad0-2d97-468c-86e3-5e54af505b06 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:13.116136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fb06fad0-2d97-468c-86e3-5e54af505b06 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:13.124750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fb06fad0-2d97-468c-86e3-5e54af505b06 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.189451 Aug 08 08:43:13.125691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 97/207] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:12 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:14.145667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-eb18048e-54fe-4a95-abed-79543e9ba2fb tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:14.146276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-eb18048e-54fe-4a95-abed-79543e9ba2fb tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:14.152730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb18048e-54fe-4a95-abed-79543e9ba2fb tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:14.153259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb18048e-54fe-4a95-abed-79543e9ba2fb tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:14.153753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb18048e-54fe-4a95-abed-79543e9ba2fb tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:14.154450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb18048e-54fe-4a95-abed-79543e9ba2fb tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:14.154931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb18048e-54fe-4a95-abed-79543e9ba2fb tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:14.155384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb18048e-54fe-4a95-abed-79543e9ba2fb tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:14.326274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-eb18048e-54fe-4a95-abed-79543e9ba2fb tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:14.349120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-eb18048e-54fe-4a95-abed-79543e9ba2fb tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.207145 Aug 08 08:43:14.350167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 111/208] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:14 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:15.369884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2a22904c-ee0b-4b44-bf20-22663e8c89e5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:15.370626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2a22904c-ee0b-4b44-bf20-22663e8c89e5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:15.378439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a22904c-ee0b-4b44-bf20-22663e8c89e5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:15.378696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a22904c-ee0b-4b44-bf20-22663e8c89e5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:15.379129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a22904c-ee0b-4b44-bf20-22663e8c89e5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:15.379818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a22904c-ee0b-4b44-bf20-22663e8c89e5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:15.380270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a22904c-ee0b-4b44-bf20-22663e8c89e5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:15.380769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a22904c-ee0b-4b44-bf20-22663e8c89e5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:15.517553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2a22904c-ee0b-4b44-bf20-22663e8c89e5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:15.525224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2a22904c-ee0b-4b44-bf20-22663e8c89e5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.159208 Aug 08 08:43:15.525786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 98/209] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:15 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:16.545791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c908bd62-435a-4a0f-bfd2-6bbeab62d401 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:16.546404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c908bd62-435a-4a0f-bfd2-6bbeab62d401 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:16.552796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c908bd62-435a-4a0f-bfd2-6bbeab62d401 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:16.553326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c908bd62-435a-4a0f-bfd2-6bbeab62d401 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:16.553765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c908bd62-435a-4a0f-bfd2-6bbeab62d401 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:16.554506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c908bd62-435a-4a0f-bfd2-6bbeab62d401 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:16.555128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c908bd62-435a-4a0f-bfd2-6bbeab62d401 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:16.555572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c908bd62-435a-4a0f-bfd2-6bbeab62d401 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:16.690581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c908bd62-435a-4a0f-bfd2-6bbeab62d401 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:16.699758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c908bd62-435a-4a0f-bfd2-6bbeab62d401 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.156669 Aug 08 08:43:16.699758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 112/210] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:16 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:17.720442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c624d8b2-0f87-4aa7-b562-d23bb0a5bfe3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:17.721279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c624d8b2-0f87-4aa7-b562-d23bb0a5bfe3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:17.728181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c624d8b2-0f87-4aa7-b562-d23bb0a5bfe3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:17.728683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c624d8b2-0f87-4aa7-b562-d23bb0a5bfe3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:17.729163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c624d8b2-0f87-4aa7-b562-d23bb0a5bfe3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:17.731840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c624d8b2-0f87-4aa7-b562-d23bb0a5bfe3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:17.731840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c624d8b2-0f87-4aa7-b562-d23bb0a5bfe3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:17.731840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c624d8b2-0f87-4aa7-b562-d23bb0a5bfe3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:17.871082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c624d8b2-0f87-4aa7-b562-d23bb0a5bfe3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:17.878725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c624d8b2-0f87-4aa7-b562-d23bb0a5bfe3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.162875 Aug 08 08:43:17.879350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 99/211] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:17 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:18.899670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8a2db67c-c5d2-4439-b53c-d03dd37a6c5d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:18.900280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8a2db67c-c5d2-4439-b53c-d03dd37a6c5d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:18.906108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8a2db67c-c5d2-4439-b53c-d03dd37a6c5d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:18.906599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8a2db67c-c5d2-4439-b53c-d03dd37a6c5d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:18.907068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8a2db67c-c5d2-4439-b53c-d03dd37a6c5d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:18.907757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8a2db67c-c5d2-4439-b53c-d03dd37a6c5d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:18.908212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8a2db67c-c5d2-4439-b53c-d03dd37a6c5d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:18.908640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8a2db67c-c5d2-4439-b53c-d03dd37a6c5d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:19.039844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8a2db67c-c5d2-4439-b53c-d03dd37a6c5d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:19.047405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8a2db67c-c5d2-4439-b53c-d03dd37a6c5d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.151590 Aug 08 08:43:19.048557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 113/212] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:18 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:20.068369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e6e90840-8b1f-4d5c-a655-0a9159178f93 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:20.069006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e6e90840-8b1f-4d5c-a655-0a9159178f93 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:20.075585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6e90840-8b1f-4d5c-a655-0a9159178f93 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:20.076066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6e90840-8b1f-4d5c-a655-0a9159178f93 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:20.076502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6e90840-8b1f-4d5c-a655-0a9159178f93 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:20.077336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6e90840-8b1f-4d5c-a655-0a9159178f93 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:20.077795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6e90840-8b1f-4d5c-a655-0a9159178f93 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:20.078221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6e90840-8b1f-4d5c-a655-0a9159178f93 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:20.228417 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e6e90840-8b1f-4d5c-a655-0a9159178f93 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:20.240520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e6e90840-8b1f-4d5c-a655-0a9159178f93 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1522 microversion: 2.1 time: 0.175935 Aug 08 08:43:20.253767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 100/213] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:20 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:21.261427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4aceee72-4d9c-4319-a47e-e3e25c7a5a0b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:21.262036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4aceee72-4d9c-4319-a47e-e3e25c7a5a0b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:21.268667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aceee72-4d9c-4319-a47e-e3e25c7a5a0b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:21.274103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aceee72-4d9c-4319-a47e-e3e25c7a5a0b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:21.274103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aceee72-4d9c-4319-a47e-e3e25c7a5a0b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:21.274103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aceee72-4d9c-4319-a47e-e3e25c7a5a0b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:21.274103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aceee72-4d9c-4319-a47e-e3e25c7a5a0b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:21.274491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aceee72-4d9c-4319-a47e-e3e25c7a5a0b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:21.544061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4aceee72-4d9c-4319-a47e-e3e25c7a5a0b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:21.552105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4aceee72-4d9c-4319-a47e-e3e25c7a5a0b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1502 microversion: 2.1 time: 0.294729 Aug 08 08:43:21.552664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 114/214] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:21 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1502 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:21.576895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-69a5909a-dbbc-4fa8-9fa2-831ed660e57a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:21.577551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-69a5909a-dbbc-4fa8-9fa2-831ed660e57a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:21.584082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69a5909a-dbbc-4fa8-9fa2-831ed660e57a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:21.584564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69a5909a-dbbc-4fa8-9fa2-831ed660e57a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:21.584996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69a5909a-dbbc-4fa8-9fa2-831ed660e57a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:21.585719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69a5909a-dbbc-4fa8-9fa2-831ed660e57a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:21.586173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69a5909a-dbbc-4fa8-9fa2-831ed660e57a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:21.586600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69a5909a-dbbc-4fa8-9fa2-831ed660e57a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:21.589235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=81 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:21.734428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-69a5909a-dbbc-4fa8-9fa2-831ed660e57a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:21.742516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-69a5909a-dbbc-4fa8-9fa2-831ed660e57a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1515 microversion: 2.1 time: 0.169476 Aug 08 08:43:21.743114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 101/215] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:21 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:23.508416 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ee2bd0a1-bf67-4e72-82d5-b74033780438 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:23.510629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ee2bd0a1-bf67-4e72-82d5-b74033780438 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:23.513966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=28 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:23.522887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee2bd0a1-bf67-4e72-82d5-b74033780438 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:23.522887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee2bd0a1-bf67-4e72-82d5-b74033780438 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:23.522887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee2bd0a1-bf67-4e72-82d5-b74033780438 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:23.522887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee2bd0a1-bf67-4e72-82d5-b74033780438 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:23.523605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee2bd0a1-bf67-4e72-82d5-b74033780438 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:23.523605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee2bd0a1-bf67-4e72-82d5-b74033780438 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:23.578330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-ee2bd0a1-bf67-4e72-82d5-b74033780438 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lazy-loading 'flavor' on Instance uuid 1ec8f653-4fc1-4f77-a832-768f73782b17 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:43:23.876798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ee2bd0a1-bf67-4e72-82d5-b74033780438 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "POST /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17/action" status: 200 len: 32 microversion: 2.1 time: 0.371790 Aug 08 08:43:23.880305 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 115/216] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:43:23 2022] POST /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17/action => generated 32 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 08:43:23.887099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4ae50c3e-92c4-42a2-93a0-0f92f1c885ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:23.887721 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4ae50c3e-92c4-42a2-93a0-0f92f1c885ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:23.894122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ae50c3e-92c4-42a2-93a0-0f92f1c885ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:23.894614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ae50c3e-92c4-42a2-93a0-0f92f1c885ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:23.895252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ae50c3e-92c4-42a2-93a0-0f92f1c885ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:23.896133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ae50c3e-92c4-42a2-93a0-0f92f1c885ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:23.896749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ae50c3e-92c4-42a2-93a0-0f92f1c885ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:23.897643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ae50c3e-92c4-42a2-93a0-0f92f1c885ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:24.169945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4ae50c3e-92c4-42a2-93a0-0f92f1c885ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:24.178392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4ae50c3e-92c4-42a2-93a0-0f92f1c885ef tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.295166 Aug 08 08:43:24.178960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 102/217] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:23 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:25.200140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b57a7407-555f-417c-a726-6ad5cf63ced5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:25.200763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b57a7407-555f-417c-a726-6ad5cf63ced5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:25.207480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b57a7407-555f-417c-a726-6ad5cf63ced5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:25.207985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b57a7407-555f-417c-a726-6ad5cf63ced5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:25.208419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b57a7407-555f-417c-a726-6ad5cf63ced5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:25.209094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b57a7407-555f-417c-a726-6ad5cf63ced5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:25.209578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b57a7407-555f-417c-a726-6ad5cf63ced5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:25.209984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b57a7407-555f-417c-a726-6ad5cf63ced5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:25.340651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b57a7407-555f-417c-a726-6ad5cf63ced5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:25.352036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b57a7407-555f-417c-a726-6ad5cf63ced5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.153160 Aug 08 08:43:25.352036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 116/218] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:25 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:25.713615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-76f28911-049a-4072-b6df-55b78d324ff0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:25.714084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-76f28911-049a-4072-b6df-55b78d324ff0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:25.721073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76f28911-049a-4072-b6df-55b78d324ff0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:25.721600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76f28911-049a-4072-b6df-55b78d324ff0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:25.722048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76f28911-049a-4072-b6df-55b78d324ff0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:25.722743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76f28911-049a-4072-b6df-55b78d324ff0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:25.723197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76f28911-049a-4072-b6df-55b78d324ff0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:25.723627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76f28911-049a-4072-b6df-55b78d324ff0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:25.747477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-76f28911-049a-4072-b6df-55b78d324ff0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/ips" status: 200 len: 151 microversion: 2.20 time: 0.037754 Aug 08 08:43:25.748055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 103/219] 10.222.0.33 () {60 vars in 1289 bytes} [Mon Aug 8 08:43:25 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:43:26.372600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a2305c59-99f8-4211-a817-4f3dbe3ecc26 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:26.373230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a2305c59-99f8-4211-a817-4f3dbe3ecc26 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:26.392304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2305c59-99f8-4211-a817-4f3dbe3ecc26 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:26.392806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2305c59-99f8-4211-a817-4f3dbe3ecc26 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:26.393622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2305c59-99f8-4211-a817-4f3dbe3ecc26 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:26.393973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2305c59-99f8-4211-a817-4f3dbe3ecc26 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:26.394608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2305c59-99f8-4211-a817-4f3dbe3ecc26 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:26.395038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2305c59-99f8-4211-a817-4f3dbe3ecc26 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:26.551651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a2305c59-99f8-4211-a817-4f3dbe3ecc26 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:26.551651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a2305c59-99f8-4211-a817-4f3dbe3ecc26 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.182483 Aug 08 08:43:26.551651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 117/220] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:26 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:27.569482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d71e195a-6dc8-4de4-8fd3-ad3b49cd1d5b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:27.570087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d71e195a-6dc8-4de4-8fd3-ad3b49cd1d5b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:27.576548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d71e195a-6dc8-4de4-8fd3-ad3b49cd1d5b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:27.577092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d71e195a-6dc8-4de4-8fd3-ad3b49cd1d5b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:27.577565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d71e195a-6dc8-4de4-8fd3-ad3b49cd1d5b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:27.578258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d71e195a-6dc8-4de4-8fd3-ad3b49cd1d5b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:27.578716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d71e195a-6dc8-4de4-8fd3-ad3b49cd1d5b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:27.579664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d71e195a-6dc8-4de4-8fd3-ad3b49cd1d5b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:27.722963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d71e195a-6dc8-4de4-8fd3-ad3b49cd1d5b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:27.730988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d71e195a-6dc8-4de4-8fd3-ad3b49cd1d5b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.165295 Aug 08 08:43:27.734872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 104/221] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:27 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:28.078721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-30fc30f4-ab27-47c5-9c5c-c8223b9870af tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:28.080066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-30fc30f4-ab27-47c5-9c5c-c8223b9870af tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:28.086468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fc30f4-ab27-47c5-9c5c-c8223b9870af tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:28.086962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fc30f4-ab27-47c5-9c5c-c8223b9870af tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:28.087399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fc30f4-ab27-47c5-9c5c-c8223b9870af tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:28.088107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fc30f4-ab27-47c5-9c5c-c8223b9870af tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:28.088668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fc30f4-ab27-47c5-9c5c-c8223b9870af tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:28.089182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fc30f4-ab27-47c5-9c5c-c8223b9870af tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:28.113199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-30fc30f4-ab27-47c5-9c5c-c8223b9870af tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lazy-loading 'flavor' on Instance uuid 9aa423dc-c608-40ed-a783-faf7a48d13c1 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:43:28.562034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-30fc30f4-ab27-47c5-9c5c-c8223b9870af tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "POST /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/action" status: 202 len: 0 microversion: 2.20 time: 0.487018 Aug 08 08:43:28.563109 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 118/222] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Aug 8 08:43:28 2022] POST /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:43:28.571119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:28.571761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:28.578276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:28.578765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:28.580457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:28.580457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:28.580457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:28.580870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:28.723472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:28.731501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:28.733011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:28.734188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c02d1faa-b2f7-4aea-9ae0-e9d39d80014f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.166923 Aug 08 08:43:28.734734 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 105/223] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:28 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:28.752271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e8b52c80-5c77-4f0c-877e-54daa38fad25 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:28.753171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e8b52c80-5c77-4f0c-877e-54daa38fad25 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:28.759636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8b52c80-5c77-4f0c-877e-54daa38fad25 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:28.760211 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8b52c80-5c77-4f0c-877e-54daa38fad25 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:28.760652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8b52c80-5c77-4f0c-877e-54daa38fad25 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:28.761410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8b52c80-5c77-4f0c-877e-54daa38fad25 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:28.761891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8b52c80-5c77-4f0c-877e-54daa38fad25 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:28.762324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8b52c80-5c77-4f0c-877e-54daa38fad25 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:28.898850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e8b52c80-5c77-4f0c-877e-54daa38fad25 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:28.906314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e8b52c80-5c77-4f0c-877e-54daa38fad25 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.158366 Aug 08 08:43:28.906878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 119/224] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:28 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:29.215551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-854a5c57-426b-443e-8355-52e582486337 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:29.216159 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-854a5c57-426b-443e-8355-52e582486337 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:29.223512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854a5c57-426b-443e-8355-52e582486337 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:29.224000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854a5c57-426b-443e-8355-52e582486337 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:29.224434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854a5c57-426b-443e-8355-52e582486337 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:29.225410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854a5c57-426b-443e-8355-52e582486337 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:29.225893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854a5c57-426b-443e-8355-52e582486337 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:29.226323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854a5c57-426b-443e-8355-52e582486337 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:29.249875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-854a5c57-426b-443e-8355-52e582486337 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/ips" status: 200 len: 147 microversion: 2.1 time: 0.038489 Aug 08 08:43:29.250441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 106/225] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 08:43:29 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:43:29.492455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a5e16d48-291d-4f52-ad7a-820ac7c360b6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:29.493009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a5e16d48-291d-4f52-ad7a-820ac7c360b6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:29.499082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5e16d48-291d-4f52-ad7a-820ac7c360b6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:29.499568 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5e16d48-291d-4f52-ad7a-820ac7c360b6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:29.500001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5e16d48-291d-4f52-ad7a-820ac7c360b6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:29.501343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5e16d48-291d-4f52-ad7a-820ac7c360b6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:29.501834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5e16d48-291d-4f52-ad7a-820ac7c360b6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:29.502273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5e16d48-291d-4f52-ad7a-820ac7c360b6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:29.526230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a5e16d48-291d-4f52-ad7a-820ac7c360b6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/ips" status: 200 len: 151 microversion: 2.1 time: 0.038355 Aug 08 08:43:29.526836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 120/226] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 08:43:29 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:43:29.764076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:29.764705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:29.772277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:29.772770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:29.773246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:29.773973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:29.774486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:29.774938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:29.915812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:29.924708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:29.926276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:29.927442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-eda96140-3f3d-4e93-885e-cc9eee7ae4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.167644 Aug 08 08:43:29.928023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 107/227] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:29 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:29.928453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f424251a-ac05-4a2e-95b4-e2ebbeb4f1de tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:29.929255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f424251a-ac05-4a2e-95b4-e2ebbeb4f1de tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:29.935361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f424251a-ac05-4a2e-95b4-e2ebbeb4f1de tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:29.935847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f424251a-ac05-4a2e-95b4-e2ebbeb4f1de tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:29.936287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f424251a-ac05-4a2e-95b4-e2ebbeb4f1de tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:29.937036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f424251a-ac05-4a2e-95b4-e2ebbeb4f1de tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:29.937582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f424251a-ac05-4a2e-95b4-e2ebbeb4f1de tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:29.947504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f424251a-ac05-4a2e-95b4-e2ebbeb4f1de tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:30.085768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f424251a-ac05-4a2e-95b4-e2ebbeb4f1de tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:30.093543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f424251a-ac05-4a2e-95b4-e2ebbeb4f1de tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.168786 Aug 08 08:43:30.095624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 121/228] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:29 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:30.950947 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:30.951588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:30.958940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:30.959431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:30.959869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:30.960584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:30.961043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:30.961498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:31.087852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:31.095921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:31.097447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:31.098617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0026ef18-39c8-4608-9301-1d57406e7ffb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.151565 Aug 08 08:43:31.099166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 108/229] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:30 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:31.116483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1b066e86-7bb9-4f46-8ac3-c3b376b9d03b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:31.117090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1b066e86-7bb9-4f46-8ac3-c3b376b9d03b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:31.123752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b066e86-7bb9-4f46-8ac3-c3b376b9d03b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:31.124270 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b066e86-7bb9-4f46-8ac3-c3b376b9d03b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:31.124712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b066e86-7bb9-4f46-8ac3-c3b376b9d03b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:31.125687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b066e86-7bb9-4f46-8ac3-c3b376b9d03b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:31.126534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b066e86-7bb9-4f46-8ac3-c3b376b9d03b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:31.126952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b066e86-7bb9-4f46-8ac3-c3b376b9d03b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:31.263191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1b066e86-7bb9-4f46-8ac3-c3b376b9d03b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:31.267190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:31.271694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1b066e86-7bb9-4f46-8ac3-c3b376b9d03b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.159100 Aug 08 08:43:31.272424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 122/230] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:31 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:31.444576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5f829eca-bd21-4198-9fdb-0dbbe6ddd6ba tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54c7e29e-bc0e-4575-82b9-9914d2a89a1d"}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:31.447154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5f829eca-bd21-4198-9fdb-0dbbe6ddd6ba tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:31.461827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f829eca-bd21-4198-9fdb-0dbbe6ddd6ba tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:31.461827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f829eca-bd21-4198-9fdb-0dbbe6ddd6ba tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:31.461827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f829eca-bd21-4198-9fdb-0dbbe6ddd6ba tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:31.461827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f829eca-bd21-4198-9fdb-0dbbe6ddd6ba tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:31.462389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f829eca-bd21-4198-9fdb-0dbbe6ddd6ba tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:31.462389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f829eca-bd21-4198-9fdb-0dbbe6ddd6ba tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:32.124263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:32.124878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:32.132374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:32.138830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:32.138830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:32.138830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:32.138830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:32.139122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:32.279812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:32.292216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:32.292216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:32.292216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2ff69b5d-5873-417b-877b-d69b78c4a285 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.171413 Aug 08 08:43:32.297125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 123/231] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:32 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:43:32.297125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6b9296e3-fbc0-4e95-a6fd-ad6aa95e2f9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:32.297125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6b9296e3-fbc0-4e95-a6fd-ad6aa95e2f9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:32.302422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b9296e3-fbc0-4e95-a6fd-ad6aa95e2f9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:32.302926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b9296e3-fbc0-4e95-a6fd-ad6aa95e2f9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:32.303379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b9296e3-fbc0-4e95-a6fd-ad6aa95e2f9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:32.304112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b9296e3-fbc0-4e95-a6fd-ad6aa95e2f9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:32.304564 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b9296e3-fbc0-4e95-a6fd-ad6aa95e2f9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:32.304986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b9296e3-fbc0-4e95-a6fd-ad6aa95e2f9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:32.343121 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5f829eca-bd21-4198-9fdb-0dbbe6ddd6ba tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902368 Aug 08 08:43:32.343754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 109/232] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:43:31 2022] POST /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-volume_attachments => generated 194 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:43:32.444197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6b9296e3-fbc0-4e95-a6fd-ad6aa95e2f9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:32.451875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6b9296e3-fbc0-4e95-a6fd-ad6aa95e2f9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.159208 Aug 08 08:43:32.452421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 124/233] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:32 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:32.887353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7e98153c-c01e-436a-b2e6-110d1b43f087 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "172a9f30-3127-45ea-a62c-69ed1d99547b"}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:32.889747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7e98153c-c01e-436a-b2e6-110d1b43f087 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:32.896858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e98153c-c01e-436a-b2e6-110d1b43f087 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:32.897374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e98153c-c01e-436a-b2e6-110d1b43f087 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:32.897812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e98153c-c01e-436a-b2e6-110d1b43f087 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:32.898492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e98153c-c01e-436a-b2e6-110d1b43f087 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:32.898944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e98153c-c01e-436a-b2e6-110d1b43f087 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:32.899366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e98153c-c01e-436a-b2e6-110d1b43f087 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:33.314078 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:33.314925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:33.321254 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:33.321738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:33.322171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:33.322852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:33.323304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:33.323794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:33.466793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:33.479276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:33.481282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:33.482767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ba4dc613-42c6-4255-997b-32eed3e4d0db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.172863 Aug 08 08:43:33.483379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 125/234] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:33 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:43:33.490700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1162dc39-c696-41e4-a8d8-6d4a9515f5e4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:33.492680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1162dc39-c696-41e4-a8d8-6d4a9515f5e4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:33.500196 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1162dc39-c696-41e4-a8d8-6d4a9515f5e4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:33.500694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1162dc39-c696-41e4-a8d8-6d4a9515f5e4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:33.501948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1162dc39-c696-41e4-a8d8-6d4a9515f5e4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:33.502842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1162dc39-c696-41e4-a8d8-6d4a9515f5e4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:33.503335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1162dc39-c696-41e4-a8d8-6d4a9515f5e4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:33.503767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1162dc39-c696-41e4-a8d8-6d4a9515f5e4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:33.562716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7e98153c-c01e-436a-b2e6-110d1b43f087 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "POST /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.675789 Aug 08 08:43:33.562716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 110/235] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:43:32 2022] POST /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:43:33.661259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1162dc39-c696-41e4-a8d8-6d4a9515f5e4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:33.667545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1162dc39-c696-41e4-a8d8-6d4a9515f5e4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.182467 Aug 08 08:43:33.668128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 126/236] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:33 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:34.508180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:34.508876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:34.515103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:34.515590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:34.516021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:34.516712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:34.517191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:34.518354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:34.680261 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:34.688012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:34.690110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:34.691106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-946857d6-cea9-49ec-a0b0-d11f1cbf77ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:34.691566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1691b77c-1505-44f0-935c-4d70043b5c2e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.187845 Aug 08 08:43:34.691723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-946857d6-cea9-49ec-a0b0-d11f1cbf77ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:34.691970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 111/237] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:34 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:34.698057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-946857d6-cea9-49ec-a0b0-d11f1cbf77ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:34.698544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-946857d6-cea9-49ec-a0b0-d11f1cbf77ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:34.698978 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-946857d6-cea9-49ec-a0b0-d11f1cbf77ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:34.699673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-946857d6-cea9-49ec-a0b0-d11f1cbf77ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:34.700131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-946857d6-cea9-49ec-a0b0-d11f1cbf77ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:34.700734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-946857d6-cea9-49ec-a0b0-d11f1cbf77ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:34.834592 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-946857d6-cea9-49ec-a0b0-d11f1cbf77ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:34.842331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-946857d6-cea9-49ec-a0b0-d11f1cbf77ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.156522 Aug 08 08:43:34.843809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 127/238] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:34 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:35.714365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:35.714909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:35.721358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:35.721841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:35.722272 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:35.722957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:35.723407 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:35.723827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:35.857855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:35.866220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5bf2d489-ed67-4a45-b192-98a679d98c86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:35.866875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5bf2d489-ed67-4a45-b192-98a679d98c86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:35.867728 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:35.869560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:35.870650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c6192869-5591-4289-953b-e785574dfe7e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.160216 Aug 08 08:43:35.871220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 112/239] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:35 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:35.874993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5bf2d489-ed67-4a45-b192-98a679d98c86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:35.875709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5bf2d489-ed67-4a45-b192-98a679d98c86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:35.876160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5bf2d489-ed67-4a45-b192-98a679d98c86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:35.877534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5bf2d489-ed67-4a45-b192-98a679d98c86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:35.878135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5bf2d489-ed67-4a45-b192-98a679d98c86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:35.878723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5bf2d489-ed67-4a45-b192-98a679d98c86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:36.009897 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5bf2d489-ed67-4a45-b192-98a679d98c86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:36.017969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5bf2d489-ed67-4a45-b192-98a679d98c86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.157975 Aug 08 08:43:36.018535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 128/240] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:35 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:43:36.902105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:36.902721 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:36.910029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:36.910804 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:36.911308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:36.912315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:36.912804 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:36.913255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:37.040490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7e1a1cf4-072f-46b6-9818-1b131f8807b5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:37.040490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7e1a1cf4-072f-46b6-9818-1b131f8807b5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:37.046525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e1a1cf4-072f-46b6-9818-1b131f8807b5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:37.047088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e1a1cf4-072f-46b6-9818-1b131f8807b5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:37.047708 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e1a1cf4-072f-46b6-9818-1b131f8807b5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:37.048402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e1a1cf4-072f-46b6-9818-1b131f8807b5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:37.049475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e1a1cf4-072f-46b6-9818-1b131f8807b5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:37.049909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e1a1cf4-072f-46b6-9818-1b131f8807b5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:37.054991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:37.064118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:37.066132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:37.067500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-715c56af-41ca-448f-b96a-ac8835b7f459 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.169220 Aug 08 08:43:37.070684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 113/241] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:36 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:37.188405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7e1a1cf4-072f-46b6-9818-1b131f8807b5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:37.196214 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7e1a1cf4-072f-46b6-9818-1b131f8807b5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.161527 Aug 08 08:43:37.196781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 129/242] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:37 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:38.098630 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:38.099242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:38.105975 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:38.106468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:38.106906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:38.107625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:38.108110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:38.108534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:38.218834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5f234112-4d45-4a44-b4dd-7180a483882b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:38.219948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5f234112-4d45-4a44-b4dd-7180a483882b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:38.228431 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5f234112-4d45-4a44-b4dd-7180a483882b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:38.228938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5f234112-4d45-4a44-b4dd-7180a483882b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:38.233818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5f234112-4d45-4a44-b4dd-7180a483882b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:38.234631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5f234112-4d45-4a44-b4dd-7180a483882b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:38.235103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5f234112-4d45-4a44-b4dd-7180a483882b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:38.235532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5f234112-4d45-4a44-b4dd-7180a483882b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:38.262828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:38.271256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:38.272915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:38.274446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-71012401-30e5-4bc8-8d76-5918b49b9a4a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.179869 Aug 08 08:43:38.274992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 114/243] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:38 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:38.375561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5f234112-4d45-4a44-b4dd-7180a483882b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:38.383678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5f234112-4d45-4a44-b4dd-7180a483882b tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.169621 Aug 08 08:43:38.384234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 130/244] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:38 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:43:39.298060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:39.299398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:39.305748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:39.306241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:39.306681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:39.307405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:39.307863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:39.308289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:39.403948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4c5298d4-6d8a-49d5-af1d-f61b9088d6b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:39.404745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4c5298d4-6d8a-49d5-af1d-f61b9088d6b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:39.411909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c5298d4-6d8a-49d5-af1d-f61b9088d6b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:39.412412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c5298d4-6d8a-49d5-af1d-f61b9088d6b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:39.412854 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c5298d4-6d8a-49d5-af1d-f61b9088d6b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:39.413601 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c5298d4-6d8a-49d5-af1d-f61b9088d6b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:39.414066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c5298d4-6d8a-49d5-af1d-f61b9088d6b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:39.414524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c5298d4-6d8a-49d5-af1d-f61b9088d6b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:39.443604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:39.445936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:39.455027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:39.456693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:39.459816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-79f88d24-0363-4d04-8736-e8a0b1d483a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.163782 Aug 08 08:43:39.459816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 115/245] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:39 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:39.576279 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4c5298d4-6d8a-49d5-af1d-f61b9088d6b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:39.584961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4c5298d4-6d8a-49d5-af1d-f61b9088d6b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.184868 Aug 08 08:43:39.586055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 131/246] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:39 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:43:39.897313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ab76bf4b-88a8-4dbc-abc6-a4275f6a9de4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: .version_select at 0x7f4795d22e50>, body: {"keypair": {"name": "tempest-keypair-149055267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyOWxEk17/E184lCLSHbu/X4wTE3jLw3dqC/3DuENNDK+mHiTAbh9hc2QQnhTQFo6Csk2jSKTsPHcyIhAqrYKAMD1Lr6lc+oJQhgyvXNWSzUeI6GDZ9wBTvG30o6Yvyug=="}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:39.913449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-ab76bf4b-88a8-4dbc-abc6-a4275f6a9de4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'key_pairs'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:43:39.917593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-ab76bf4b-88a8-4dbc-abc6-a4275f6a9de4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for user 32dcdc2e24e44a07ade44d1da330a77e and project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'key_pairs'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:43:39.981632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ab76bf4b-88a8-4dbc-abc6-a4275f6a9de4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088225 Aug 08 08:43:39.992459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 116/247] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 08:43:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:43:40.481475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:40.482111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:40.488172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:40.488650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:40.489087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:40.489791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:40.490244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:40.490667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:40.606630 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-eee3a3b2-7cac-49ca-9aa4-ac28c6277bce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:40.607232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-eee3a3b2-7cac-49ca-9aa4-ac28c6277bce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:40.614150 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eee3a3b2-7cac-49ca-9aa4-ac28c6277bce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:40.614631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eee3a3b2-7cac-49ca-9aa4-ac28c6277bce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:40.615058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eee3a3b2-7cac-49ca-9aa4-ac28c6277bce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:40.615742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eee3a3b2-7cac-49ca-9aa4-ac28c6277bce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:40.616193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eee3a3b2-7cac-49ca-9aa4-ac28c6277bce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:40.616614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eee3a3b2-7cac-49ca-9aa4-ac28c6277bce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:40.658552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:40.669368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:40.669810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:40.671227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5b1ba983-c9ae-49de-8fc9-4fd2b0879a1f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.193713 Aug 08 08:43:40.671984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 132/248] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:40 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:40.758698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-eee3a3b2-7cac-49ca-9aa4-ac28c6277bce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:40.766158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-eee3a3b2-7cac-49ca-9aa4-ac28c6277bce tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.163324 Aug 08 08:43:40.766712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 117/249] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:40 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:43:41.707780 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:41.708535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:41.714527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:41.715008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:41.715451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:41.716154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:41.716620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:41.717055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:41.788150 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-66b5b7a0-35f9-4753-a36f-5cfa4e9b51e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:41.788771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-66b5b7a0-35f9-4753-a36f-5cfa4e9b51e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:41.791171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:41.795803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-66b5b7a0-35f9-4753-a36f-5cfa4e9b51e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:41.796292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-66b5b7a0-35f9-4753-a36f-5cfa4e9b51e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:41.796730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-66b5b7a0-35f9-4753-a36f-5cfa4e9b51e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:41.797476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-66b5b7a0-35f9-4753-a36f-5cfa4e9b51e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:41.797991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-66b5b7a0-35f9-4753-a36f-5cfa4e9b51e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:41.798952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-66b5b7a0-35f9-4753-a36f-5cfa4e9b51e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:41.978152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:41.986660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:41.988173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:41.989374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-872258ce-9717-4f56-95cb-132cc0be80f2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.286190 Aug 08 08:43:41.989943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 133/250] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:41 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:42.009610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-66b5b7a0-35f9-4753-a36f-5cfa4e9b51e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:42.016918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-66b5b7a0-35f9-4753-a36f-5cfa4e9b51e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.232698 Aug 08 08:43:42.017510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 118/251] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:41 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:43:42.271441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1886008905", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fbd2a5d-fa4b-468d-80da-6dad72f31b93"}], "security_groups": [{"name": "tempest-securitygroup--1721134087"}], "key_name": "tempest-keypair-149055267", "user_data": "}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:42.371726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] validate_networks() for [('0fbd2a5d-fa4b-468d-80da-6dad72f31b93', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:43:42.742540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:43:42.743085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:43:42.743429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:43:42.743839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:43:42.744251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:43:42.753266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:42.753747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:42.754203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:42.754907 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:42.755362 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:42.755791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:42.772226 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:43:42.776149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for user 32dcdc2e24e44a07ade44d1da330a77e and project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:43:42.787770 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:43:42.790073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:43:42.952105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-80a460d4-ee88-42e7-905c-40bfd46c5618 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.685581 Aug 08 08:43:42.952775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 134/252] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:43:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:43:42.963606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a09088f2-cd50-41f0-8e25-aef300d7f1bd tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:42.964227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a09088f2-cd50-41f0-8e25-aef300d7f1bd tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:43.012232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:43.012853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:43.019540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:43.020038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:43.020481 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:43.021221 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:43.021684 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:43.022116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:43.023323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a09088f2-cd50-41f0-8e25-aef300d7f1bd tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:43.030893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a09088f2-cd50-41f0-8e25-aef300d7f1bd tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1241 microversion: 2.1 time: 0.071018 Aug 08 08:43:43.044289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 119/253] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:42 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:43.044289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-49cc6df2-b631-4fc1-bd13-a9bed365eb8d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:43.044289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-49cc6df2-b631-4fc1-bd13-a9bed365eb8d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:43.045128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49cc6df2-b631-4fc1-bd13-a9bed365eb8d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:43.045711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49cc6df2-b631-4fc1-bd13-a9bed365eb8d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:43.046262 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49cc6df2-b631-4fc1-bd13-a9bed365eb8d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:43.047030 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49cc6df2-b631-4fc1-bd13-a9bed365eb8d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:43.047571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49cc6df2-b631-4fc1-bd13-a9bed365eb8d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:43.049336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49cc6df2-b631-4fc1-bd13-a9bed365eb8d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:43.333637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:43.347394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-49cc6df2-b631-4fc1-bd13-a9bed365eb8d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:43.375351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:43.375351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:43.375351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-693feb49-3976-4fb8-824b-f815eea781e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.347279 Aug 08 08:43:43.376624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 135/254] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:43 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:43:43.377045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-49cc6df2-b631-4fc1-bd13-a9bed365eb8d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.322103 Aug 08 08:43:43.377045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 120/255] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:43 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:43:44.052372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7d0270eb-cb7b-445c-bd6d-060761b061f7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:44.052978 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7d0270eb-cb7b-445c-bd6d-060761b061f7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:44.058842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d0270eb-cb7b-445c-bd6d-060761b061f7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:44.059397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d0270eb-cb7b-445c-bd6d-060761b061f7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:44.060014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d0270eb-cb7b-445c-bd6d-060761b061f7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:44.060703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d0270eb-cb7b-445c-bd6d-060761b061f7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:44.061173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d0270eb-cb7b-445c-bd6d-060761b061f7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:44.061602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d0270eb-cb7b-445c-bd6d-060761b061f7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:44.131680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7d0270eb-cb7b-445c-bd6d-060761b061f7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:44.139028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7d0270eb-cb7b-445c-bd6d-060761b061f7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1245 microversion: 2.1 time: 0.091133 Aug 08 08:43:44.139622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 136/256] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:44 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:44.401327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-97fae30d-d0b2-4362-879f-fbb660bbeaf7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:44.401925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-97fae30d-d0b2-4362-879f-fbb660bbeaf7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:44.403156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:44.403780 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:44.409252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97fae30d-d0b2-4362-879f-fbb660bbeaf7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:44.409827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97fae30d-d0b2-4362-879f-fbb660bbeaf7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:44.410198 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:44.410301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97fae30d-d0b2-4362-879f-fbb660bbeaf7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:44.410689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:44.411094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97fae30d-d0b2-4362-879f-fbb660bbeaf7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:44.411447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:44.411753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97fae30d-d0b2-4362-879f-fbb660bbeaf7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:44.412050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:44.412180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97fae30d-d0b2-4362-879f-fbb660bbeaf7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:44.412512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:44.412941 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:44.611337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-97fae30d-d0b2-4362-879f-fbb660bbeaf7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:44.619600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-97fae30d-d0b2-4362-879f-fbb660bbeaf7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.222276 Aug 08 08:43:44.620245 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 121/257] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:44 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:44.622326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:44.630304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:44.631838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:44.632974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-255ec087-67f2-4c3e-936e-44a5e9f85fb7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.233712 Aug 08 08:43:44.633550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 137/258] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:44 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:43:45.159438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a7461ce4-4024-4401-b3b9-411e53601f19 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:45.160145 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a7461ce4-4024-4401-b3b9-411e53601f19 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:45.166547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7461ce4-4024-4401-b3b9-411e53601f19 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:45.167018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7461ce4-4024-4401-b3b9-411e53601f19 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:45.167459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7461ce4-4024-4401-b3b9-411e53601f19 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:45.168156 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7461ce4-4024-4401-b3b9-411e53601f19 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:45.168614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7461ce4-4024-4401-b3b9-411e53601f19 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:45.169041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7461ce4-4024-4401-b3b9-411e53601f19 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:45.236877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a7461ce4-4024-4401-b3b9-411e53601f19 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:45.245451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a7461ce4-4024-4401-b3b9-411e53601f19 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1293 microversion: 2.1 time: 0.089991 Aug 08 08:43:45.250391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 122/259] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:45 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:45.640525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-623bd4a0-8d45-4cc0-8f10-004c98687df0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:45.641252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-623bd4a0-8d45-4cc0-8f10-004c98687df0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:45.648229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-623bd4a0-8d45-4cc0-8f10-004c98687df0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:45.649004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-623bd4a0-8d45-4cc0-8f10-004c98687df0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:45.651793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-623bd4a0-8d45-4cc0-8f10-004c98687df0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:45.652824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-623bd4a0-8d45-4cc0-8f10-004c98687df0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:45.653324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-623bd4a0-8d45-4cc0-8f10-004c98687df0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:45.654008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-623bd4a0-8d45-4cc0-8f10-004c98687df0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:45.655899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:45.656896 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:45.663640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:45.664131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:45.665242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:45.665950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:45.666414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:45.667079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:45.858224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-623bd4a0-8d45-4cc0-8f10-004c98687df0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:45.866653 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-623bd4a0-8d45-4cc0-8f10-004c98687df0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.230426 Aug 08 08:43:45.867901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 138/260] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:45 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:45.870323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:45.879036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:45.880642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:45.881833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b76629a5-3f0a-4ed6-abb6-38d57e526e5e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1743 microversion: 2.20 time: 0.229877 Aug 08 08:43:45.882374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 123/261] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:45 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1743 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:43:46.270865 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cac5658a-1132-41b8-b200-e68028dda701 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:46.271423 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cac5658a-1132-41b8-b200-e68028dda701 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:46.277621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cac5658a-1132-41b8-b200-e68028dda701 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:46.278115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cac5658a-1132-41b8-b200-e68028dda701 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:46.278555 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cac5658a-1132-41b8-b200-e68028dda701 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:46.279255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cac5658a-1132-41b8-b200-e68028dda701 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:46.279720 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cac5658a-1132-41b8-b200-e68028dda701 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:46.280151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cac5658a-1132-41b8-b200-e68028dda701 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:46.355751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cac5658a-1132-41b8-b200-e68028dda701 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:46.362548 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cac5658a-1132-41b8-b200-e68028dda701 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1299 microversion: 2.1 time: 0.096183 Aug 08 08:43:46.363114 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 139/262] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:46 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:46.887592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0f50eca2-8e2c-4db1-afba-d30aaf62d378 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:46.888202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0f50eca2-8e2c-4db1-afba-d30aaf62d378 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:46.895518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f50eca2-8e2c-4db1-afba-d30aaf62d378 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:46.895997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f50eca2-8e2c-4db1-afba-d30aaf62d378 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:46.896432 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f50eca2-8e2c-4db1-afba-d30aaf62d378 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:46.897113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f50eca2-8e2c-4db1-afba-d30aaf62d378 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:46.898395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f50eca2-8e2c-4db1-afba-d30aaf62d378 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:46.899074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f50eca2-8e2c-4db1-afba-d30aaf62d378 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:46.912963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:46.913675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:46.920401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:46.921068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:46.921565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:46.922351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:46.922810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:46.923245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:46.934179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:47.210555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0f50eca2-8e2c-4db1-afba-d30aaf62d378 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:47.220848 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:47.224357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0f50eca2-8e2c-4db1-afba-d30aaf62d378 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.338639 Aug 08 08:43:47.226702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 124/263] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:46 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:47.239816 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:47.241490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:47.242665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-70d7de26-d0a2-4798-b274-7c05b5581dba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1743 microversion: 2.20 time: 0.335449 Aug 08 08:43:47.243218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 140/264] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:46 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1743 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:43:47.383468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-35b75965-9e24-4ce6-b889-c1d98dac5371 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:47.384033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-35b75965-9e24-4ce6-b889-c1d98dac5371 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:47.392060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35b75965-9e24-4ce6-b889-c1d98dac5371 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:47.395629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35b75965-9e24-4ce6-b889-c1d98dac5371 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:47.396097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35b75965-9e24-4ce6-b889-c1d98dac5371 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:47.396839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35b75965-9e24-4ce6-b889-c1d98dac5371 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:47.397347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35b75965-9e24-4ce6-b889-c1d98dac5371 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:47.397786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35b75965-9e24-4ce6-b889-c1d98dac5371 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:47.507058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-35b75965-9e24-4ce6-b889-c1d98dac5371 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:47.515514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-35b75965-9e24-4ce6-b889-c1d98dac5371 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1299 microversion: 2.1 time: 0.136063 Aug 08 08:43:47.516081 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 125/265] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:47 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:48.249543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9f855cbc-9cbd-40e6-b9e4-28ceff004ff5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:48.251022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9f855cbc-9cbd-40e6-b9e4-28ceff004ff5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:48.269456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:48.270229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:48.280380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f855cbc-9cbd-40e6-b9e4-28ceff004ff5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:48.282486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f855cbc-9cbd-40e6-b9e4-28ceff004ff5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:48.286288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f855cbc-9cbd-40e6-b9e4-28ceff004ff5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:48.287197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f855cbc-9cbd-40e6-b9e4-28ceff004ff5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:48.288512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:48.289242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f855cbc-9cbd-40e6-b9e4-28ceff004ff5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:48.290479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f855cbc-9cbd-40e6-b9e4-28ceff004ff5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:48.291458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:48.294144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:48.296173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:48.299498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:48.301041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:48.638293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9f855cbc-9cbd-40e6-b9e4-28ceff004ff5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:48.650738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9f855cbc-9cbd-40e6-b9e4-28ceff004ff5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.407650 Aug 08 08:43:48.667405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:48.670274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 141/266] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:48 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:48.678850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-4dc96cf8-ebba-4d88-b4f0-cbe9ef2bb6fe req-4bd1235c-c02c-4ebf-a781-88b9c7170644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa423dc-c608-40ed-a783-faf7a48d13c1", "name": "network-vif-plugged", "status": "completed", "tag": "22c96d99-e75c-4e18-bb06-3b7e1fc4519b"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:48.681816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:48.684271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:48.686282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c2e86f3c-12c0-4e7f-963a-71797ba6ffa5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.424377 Aug 08 08:43:48.687930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 126/267] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:48 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:43:48.697376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4e1c8814-62c7-4ed6-939d-93d8aa84a0a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:48.697376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4e1c8814-62c7-4ed6-939d-93d8aa84a0a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:48.704566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e1c8814-62c7-4ed6-939d-93d8aa84a0a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:48.705398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e1c8814-62c7-4ed6-939d-93d8aa84a0a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:48.706128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e1c8814-62c7-4ed6-939d-93d8aa84a0a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:48.706869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e1c8814-62c7-4ed6-939d-93d8aa84a0a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:48.707518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e1c8814-62c7-4ed6-939d-93d8aa84a0a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:48.707951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e1c8814-62c7-4ed6-939d-93d8aa84a0a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:48.717775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-4dc96cf8-ebba-4d88-b4f0-cbe9ef2bb6fe req-4bd1235c-c02c-4ebf-a781-88b9c7170644 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:48.719277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-4dc96cf8-ebba-4d88-b4f0-cbe9ef2bb6fe req-4bd1235c-c02c-4ebf-a781-88b9c7170644 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:48.719721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-4dc96cf8-ebba-4d88-b4f0-cbe9ef2bb6fe req-4bd1235c-c02c-4ebf-a781-88b9c7170644 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:48.737726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-4dc96cf8-ebba-4d88-b4f0-cbe9ef2bb6fe req-4bd1235c-c02c-4ebf-a781-88b9c7170644 service nova] Creating event network-vif-plugged:22c96d99-e75c-4e18-bb06-3b7e1fc4519b for instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 on hv-cinder-83697 Aug 08 08:43:48.743982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-4dc96cf8-ebba-4d88-b4f0-cbe9ef2bb6fe req-4bd1235c-c02c-4ebf-a781-88b9c7170644 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072549 Aug 08 08:43:48.744575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 142/268] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:43:48.858954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4e1c8814-62c7-4ed6-939d-93d8aa84a0a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:48.868398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4e1c8814-62c7-4ed6-939d-93d8aa84a0a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1367 microversion: 2.1 time: 0.178828 Aug 08 08:43:48.869313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 127/269] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:48 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:49.244616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-b8c72406-a843-4bec-b6be-07ddc33e347b req-38d1ac50-abb3-4377-a5c7-3c94024aa255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f62f454f-de08-4ed1-b767-cce30f0af653", "tag": "bf74583c-a89c-4fe1-8d42-8e25aafa9a58"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:49.255232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-b8c72406-a843-4bec-b6be-07ddc33e347b req-38d1ac50-abb3-4377-a5c7-3c94024aa255 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:49.255796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-b8c72406-a843-4bec-b6be-07ddc33e347b req-38d1ac50-abb3-4377-a5c7-3c94024aa255 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:49.256282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-b8c72406-a843-4bec-b6be-07ddc33e347b req-38d1ac50-abb3-4377-a5c7-3c94024aa255 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:49.268226 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-b8c72406-a843-4bec-b6be-07ddc33e347b req-38d1ac50-abb3-4377-a5c7-3c94024aa255 service nova] Creating event network-changed:bf74583c-a89c-4fe1-8d42-8e25aafa9a58 for instance f62f454f-de08-4ed1-b767-cce30f0af653 on hv-cinder-83697 Aug 08 08:43:49.273499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-b8c72406-a843-4bec-b6be-07ddc33e347b req-38d1ac50-abb3-4377-a5c7-3c94024aa255 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033368 Aug 08 08:43:49.275499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 143/270] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:43:49.692033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e344cafc-5fea-4cb8-b6d5-8fe16be54be0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:49.693327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e344cafc-5fea-4cb8-b6d5-8fe16be54be0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:49.699400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e344cafc-5fea-4cb8-b6d5-8fe16be54be0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:49.699901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e344cafc-5fea-4cb8-b6d5-8fe16be54be0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:49.700343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e344cafc-5fea-4cb8-b6d5-8fe16be54be0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:49.701055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e344cafc-5fea-4cb8-b6d5-8fe16be54be0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:49.701543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e344cafc-5fea-4cb8-b6d5-8fe16be54be0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:49.701983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e344cafc-5fea-4cb8-b6d5-8fe16be54be0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:49.724230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:49.725253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:49.735567 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:49.741887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:49.742579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:49.743525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:49.744140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:49.744725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:49.983986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e344cafc-5fea-4cb8-b6d5-8fe16be54be0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:49.992196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e344cafc-5fea-4cb8-b6d5-8fe16be54be0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1501 microversion: 2.1 time: 0.304779 Aug 08 08:43:49.995841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 128/271] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:49 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1501 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:50.000932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4d5ba99b-fd41-43c7-87dc-abc7a9fbd44e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:50.002560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4d5ba99b-fd41-43c7-87dc-abc7a9fbd44e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:50.009126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d5ba99b-fd41-43c7-87dc-abc7a9fbd44e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:50.009862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d5ba99b-fd41-43c7-87dc-abc7a9fbd44e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:50.015076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d5ba99b-fd41-43c7-87dc-abc7a9fbd44e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:50.022325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d5ba99b-fd41-43c7-87dc-abc7a9fbd44e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:50.024084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d5ba99b-fd41-43c7-87dc-abc7a9fbd44e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:50.025772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d5ba99b-fd41-43c7-87dc-abc7a9fbd44e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:50.150172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:50.163855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:50.167914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:50.175616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2b6faa17-4286-4b3a-ae5b-476f5b335daf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.451286 Aug 08 08:43:50.175616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 144/272] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:49 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:50.182685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72b8eeec-f90e-4911-9ded-91f465a4b439"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:50.185265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:50.200812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:50.204297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:50.204297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:50.204297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:50.204297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:50.204650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:50.238302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] HTTP exception thrown: Cannot 'attach_volume' instance 1ec8f653-4fc1-4f77-a832-768f73782b17 while it is in vm_state rescued Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Request method failure captured: Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: POST /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17/os-volume_attachments HTTP/1.1 Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 74 Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxL2F7ZuGskPSxhai7x0oCP1vO9ils3SnaQq8McZIlcSa0VOxLWO6VilcGbV94Kh5zwVgCfUYE97a1dvb13NYbQkeUAJAoUQrR8y52k20in8oG8jaOnuESYqYBI_dUu-rSkgOop2uVpELpc5_TxTQGz7w12k7peMHSN-XCHDlBqsUo Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 2a4e5c5a950c4047b15749aace25f46d Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:43:50.240514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 2a4e5c5a950c4047b15749aace25f46d Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-ServerRescueNegativeTestJSON-7596386-project Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 00e07188d3df4d958ce83085b7bb141a Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-ServerRescueNegativeTestJSON-7596386-project Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {"volumeAttachment": {"volumeId": "72b8eeec-f90e-4911-9ded-91f465a4b439"}} Aug 08 08:43:50.241791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Cannot 'attach_volume' instance 1ec8f653-4fc1-4f77-a832-768f73782b17 while it is in vm_state rescued Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'server_id': '1ec8f653-4fc1-4f77-a832-768f73782b17', 'body': {'volumeAttachment': {'volumeId': '72b8eeec-f90e-4911-9ded-91f465a4b439'}}} Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1ec8f653-4fc1-4f77-a832-768f73782b17 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:43:50.242502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1ec8f653-4fc1-4f77-a832-768f73782b17 while it is in vm_state rescued Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:43:50.243670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:43:50.244706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:43:50.244706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:43:50.244706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1ec8f653-4fc1-4f77-a832-768f73782b17 while it is in vm_state rescued Aug 08 08:43:50.244706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:43:50.247260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Returning 409 to user: Cannot 'attach_volume' instance 1ec8f653-4fc1-4f77-a832-768f73782b17 while it is in vm_state rescued {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:43:50.248386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e87df19d-1bde-4ac0-95af-b0bc5d34dcda tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "POST /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.076154 Aug 08 08:43:50.249183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 145/273] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:43:50 2022] POST /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17/os-volume_attachments => generated 152 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 08:43:50.259037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4f16befb-3143-476f-baca-b0eab5e7b3c3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:50.259629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4f16befb-3143-476f-baca-b0eab5e7b3c3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:50.269850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f16befb-3143-476f-baca-b0eab5e7b3c3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:50.270347 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f16befb-3143-476f-baca-b0eab5e7b3c3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:50.270954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f16befb-3143-476f-baca-b0eab5e7b3c3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:50.271904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f16befb-3143-476f-baca-b0eab5e7b3c3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:50.272657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f16befb-3143-476f-baca-b0eab5e7b3c3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:50.274983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f16befb-3143-476f-baca-b0eab5e7b3c3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:50.357189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4d5ba99b-fd41-43c7-87dc-abc7a9fbd44e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:50.371597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4d5ba99b-fd41-43c7-87dc-abc7a9fbd44e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1367 microversion: 2.1 time: 0.374304 Aug 08 08:43:50.372783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 129/274] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:49 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:50.551528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4f16befb-3143-476f-baca-b0eab5e7b3c3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "POST /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17/action" status: 202 len: 0 microversion: 2.1 time: 0.295730 Aug 08 08:43:50.559118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 146/275] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:43:50 2022] POST /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 08:43:50.563523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e853f029-66b0-4197-8395-000e401c6b9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:50.565214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e853f029-66b0-4197-8395-000e401c6b9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:50.582996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e853f029-66b0-4197-8395-000e401c6b9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:50.583872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e853f029-66b0-4197-8395-000e401c6b9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:50.584462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e853f029-66b0-4197-8395-000e401c6b9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:50.585332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e853f029-66b0-4197-8395-000e401c6b9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:50.586818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e853f029-66b0-4197-8395-000e401c6b9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:50.587373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e853f029-66b0-4197-8395-000e401c6b9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:50.822387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b8af87e6-e590-4339-8ba7-521c1afaa66a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:50.836381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8af87e6-e590-4339-8ba7-521c1afaa66a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:50.849503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8af87e6-e590-4339-8ba7-521c1afaa66a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:50.849503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8af87e6-e590-4339-8ba7-521c1afaa66a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:50.973873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e853f029-66b0-4197-8395-000e401c6b9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:51.009780 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e853f029-66b0-4197-8395-000e401c6b9e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1509 microversion: 2.1 time: 0.450238 Aug 08 08:43:51.011002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 130/276] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:50 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1509 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:43:51.022814 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b8af87e6-e590-4339-8ba7-521c1afaa66a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Going to try to stop instance {{(pid=124672) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 08:43:51.198334 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:51.199617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:51.210461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:51.213320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:51.213320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:51.213320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:51.213589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:51.214864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:51.215760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b8af87e6-e590-4339-8ba7-521c1afaa66a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "POST /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/action" status: 202 len: 0 microversion: 2.1 time: 0.398686 Aug 08 08:43:51.216462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 147/277] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:43:50 2022] POST /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:43:51.228148 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7498c406-f296-4eff-a481-fdef01d5c3e6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:51.234954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7498c406-f296-4eff-a481-fdef01d5c3e6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:51.244181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7498c406-f296-4eff-a481-fdef01d5c3e6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:51.245097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7498c406-f296-4eff-a481-fdef01d5c3e6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:51.245765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7498c406-f296-4eff-a481-fdef01d5c3e6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:51.252749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7498c406-f296-4eff-a481-fdef01d5c3e6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:51.260145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7498c406-f296-4eff-a481-fdef01d5c3e6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:51.261456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7498c406-f296-4eff-a481-fdef01d5c3e6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:51.487768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:51.504709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:51.508311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:51.510781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e0cac294-0bad-4a4a-a191-6f437ad4ac30 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.317946 Aug 08 08:43:51.511526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 131/278] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:51 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:43:51.516751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d3af2c43-7d53-4232-9c61-e2c05a7223cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:51.517801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d3af2c43-7d53-4232-9c61-e2c05a7223cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:51.524777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3af2c43-7d53-4232-9c61-e2c05a7223cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:51.525518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3af2c43-7d53-4232-9c61-e2c05a7223cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:51.526157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3af2c43-7d53-4232-9c61-e2c05a7223cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:51.526855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3af2c43-7d53-4232-9c61-e2c05a7223cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:51.527315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3af2c43-7d53-4232-9c61-e2c05a7223cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:51.527743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3af2c43-7d53-4232-9c61-e2c05a7223cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:51.546810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7498c406-f296-4eff-a481-fdef01d5c3e6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:51.559639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7498c406-f296-4eff-a481-fdef01d5c3e6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.337528 Aug 08 08:43:51.569183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 148/279] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:51 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:51.752700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d3af2c43-7d53-4232-9c61-e2c05a7223cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:51.765280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d3af2c43-7d53-4232-9c61-e2c05a7223cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1367 microversion: 2.1 time: 0.248660 Aug 08 08:43:51.765280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 132/280] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:51 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:52.036403 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-aa12f347-564e-42bf-8184-a09a37a57dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:52.037081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-aa12f347-564e-42bf-8184-a09a37a57dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:52.050243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa12f347-564e-42bf-8184-a09a37a57dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:52.050748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa12f347-564e-42bf-8184-a09a37a57dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:52.053119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa12f347-564e-42bf-8184-a09a37a57dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:52.055456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa12f347-564e-42bf-8184-a09a37a57dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:52.055456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa12f347-564e-42bf-8184-a09a37a57dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:52.058416 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa12f347-564e-42bf-8184-a09a37a57dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:52.268646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-aa12f347-564e-42bf-8184-a09a37a57dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:52.282057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-aa12f347-564e-42bf-8184-a09a37a57dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1509 microversion: 2.1 time: 0.250482 Aug 08 08:43:52.283507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 149/281] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:52 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:52.538607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:52.539157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:52.546102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:52.549275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:52.552914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:52.552914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:52.552914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:52.552914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:52.586253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8d9480d1-7480-4a36-b409-5d9b393b4b6e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:52.586886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8d9480d1-7480-4a36-b409-5d9b393b4b6e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:52.605077 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d9480d1-7480-4a36-b409-5d9b393b4b6e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:52.609788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d9480d1-7480-4a36-b409-5d9b393b4b6e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:52.610489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d9480d1-7480-4a36-b409-5d9b393b4b6e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:52.612206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d9480d1-7480-4a36-b409-5d9b393b4b6e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:52.612910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d9480d1-7480-4a36-b409-5d9b393b4b6e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:52.613911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d9480d1-7480-4a36-b409-5d9b393b4b6e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:52.762974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:52.779573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:52.783837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=6 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:52.794260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:52.795718 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:52.800312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4e4f3816-20d3-43da-9c86-fe0d33af57e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.267651 Aug 08 08:43:52.821071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 133/282] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:52 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:52.826388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-369bc402-4b4a-480d-9079-2908c4ade520 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:52.827249 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-369bc402-4b4a-480d-9079-2908c4ade520 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:52.838846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-369bc402-4b4a-480d-9079-2908c4ade520 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:52.838846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-369bc402-4b4a-480d-9079-2908c4ade520 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:52.838846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-369bc402-4b4a-480d-9079-2908c4ade520 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:52.846450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-369bc402-4b4a-480d-9079-2908c4ade520 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:52.854812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-369bc402-4b4a-480d-9079-2908c4ade520 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:52.855271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-369bc402-4b4a-480d-9079-2908c4ade520 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:52.882650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:52.913078 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8d9480d1-7480-4a36-b409-5d9b393b4b6e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:52.925526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8d9480d1-7480-4a36-b409-5d9b393b4b6e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.347645 Aug 08 08:43:52.941359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 150/283] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:52 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:53.028572 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=6 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:53.097389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-369bc402-4b4a-480d-9079-2908c4ade520 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:53.108326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-369bc402-4b4a-480d-9079-2908c4ade520 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1367 microversion: 2.1 time: 0.285694 Aug 08 08:43:53.109880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 134/284] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:52 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:53.304147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-00306cc6-9db7-41bd-958f-c5b341aca24f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:53.304753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-00306cc6-9db7-41bd-958f-c5b341aca24f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:53.311501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00306cc6-9db7-41bd-958f-c5b341aca24f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:53.311875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00306cc6-9db7-41bd-958f-c5b341aca24f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:53.312365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00306cc6-9db7-41bd-958f-c5b341aca24f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:53.313050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00306cc6-9db7-41bd-958f-c5b341aca24f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:53.313536 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00306cc6-9db7-41bd-958f-c5b341aca24f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:53.314059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00306cc6-9db7-41bd-958f-c5b341aca24f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:53.472044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-00306cc6-9db7-41bd-958f-c5b341aca24f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:53.479874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-00306cc6-9db7-41bd-958f-c5b341aca24f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1509 microversion: 2.1 time: 0.180094 Aug 08 08:43:53.480515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 151/285] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:53 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:53.824631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:53.829421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:53.834574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:53.835189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:53.835544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:53.836239 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:53.836721 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:53.837164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:53.949934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-97fc5b59-4aaf-4f4f-a088-696bec6bd03c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:53.953678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-97fc5b59-4aaf-4f4f-a088-696bec6bd03c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:53.957450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:53.962709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97fc5b59-4aaf-4f4f-a088-696bec6bd03c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:53.963691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97fc5b59-4aaf-4f4f-a088-696bec6bd03c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:53.963691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97fc5b59-4aaf-4f4f-a088-696bec6bd03c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:53.964308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97fc5b59-4aaf-4f4f-a088-696bec6bd03c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:53.964913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97fc5b59-4aaf-4f4f-a088-696bec6bd03c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:53.965647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97fc5b59-4aaf-4f4f-a088-696bec6bd03c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:54.070697 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:54.083114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:54.085343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:54.086950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1a1307a0-6b1b-422e-9d1c-a919d6cdff4b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.266621 Aug 08 08:43:54.087707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 135/286] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:53 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:54.160681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6f651c12-9055-446a-8f6d-f4946bdccdd0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:54.162350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-97fc5b59-4aaf-4f4f-a088-696bec6bd03c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:54.168983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6f651c12-9055-446a-8f6d-f4946bdccdd0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:54.174772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-97fc5b59-4aaf-4f4f-a088-696bec6bd03c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.229120 Aug 08 08:43:54.177105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 152/287] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:53 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:54.199302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f651c12-9055-446a-8f6d-f4946bdccdd0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:54.199818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f651c12-9055-446a-8f6d-f4946bdccdd0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:54.200606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f651c12-9055-446a-8f6d-f4946bdccdd0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:54.201795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f651c12-9055-446a-8f6d-f4946bdccdd0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:54.202670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f651c12-9055-446a-8f6d-f4946bdccdd0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:54.203465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f651c12-9055-446a-8f6d-f4946bdccdd0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:54.442650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6f651c12-9055-446a-8f6d-f4946bdccdd0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:54.454770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6f651c12-9055-446a-8f6d-f4946bdccdd0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1367 microversion: 2.1 time: 0.319498 Aug 08 08:43:54.461996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 136/288] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:54 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:43:54.503793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-422c5aa4-d3a7-46d6-9fe4-4ca2727f03c1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:54.506402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-422c5aa4-d3a7-46d6-9fe4-4ca2727f03c1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:54.514289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-422c5aa4-d3a7-46d6-9fe4-4ca2727f03c1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:54.515843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-422c5aa4-d3a7-46d6-9fe4-4ca2727f03c1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:54.518040 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-422c5aa4-d3a7-46d6-9fe4-4ca2727f03c1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:54.519010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-422c5aa4-d3a7-46d6-9fe4-4ca2727f03c1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:54.520903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-422c5aa4-d3a7-46d6-9fe4-4ca2727f03c1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:54.521533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-422c5aa4-d3a7-46d6-9fe4-4ca2727f03c1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:54.740941 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-422c5aa4-d3a7-46d6-9fe4-4ca2727f03c1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:54.748665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-422c5aa4-d3a7-46d6-9fe4-4ca2727f03c1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1509 microversion: 2.1 time: 0.249482 Aug 08 08:43:54.749698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 153/289] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:54 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:55.123077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:55.124608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:55.145360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:55.147058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:55.147520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:55.148296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:55.148760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:55.149200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:55.203288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-48df2821-5b48-4e5a-b39e-f34a89399bb6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:55.204208 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-48df2821-5b48-4e5a-b39e-f34a89399bb6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:55.223005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48df2821-5b48-4e5a-b39e-f34a89399bb6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:55.223783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48df2821-5b48-4e5a-b39e-f34a89399bb6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:55.224379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48df2821-5b48-4e5a-b39e-f34a89399bb6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:55.227652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48df2821-5b48-4e5a-b39e-f34a89399bb6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:55.228308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48df2821-5b48-4e5a-b39e-f34a89399bb6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:55.228919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48df2821-5b48-4e5a-b39e-f34a89399bb6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:55.757275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-48df2821-5b48-4e5a-b39e-f34a89399bb6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:55.760267 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:55.770340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-48df2821-5b48-4e5a-b39e-f34a89399bb6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.571209 Aug 08 08:43:55.785581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:55.785931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 154/290] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:55 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:43:55.786146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:55.786146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-adfe2e82-da41-4dd3-8584-8d30d61cd697 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.665841 Aug 08 08:43:55.786146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 137/291] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:55 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:43:55.795767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8fc02815-a1ea-4e63-ba74-a58102b2cdc3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:55.802175 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8fc02815-a1ea-4e63-ba74-a58102b2cdc3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:55.807165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8955d9ae-34ee-4eb9-acb3-14e31af86949 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:55.807798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8955d9ae-34ee-4eb9-acb3-14e31af86949 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:55.810227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc02815-a1ea-4e63-ba74-a58102b2cdc3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:55.811034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc02815-a1ea-4e63-ba74-a58102b2cdc3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:55.811710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc02815-a1ea-4e63-ba74-a58102b2cdc3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:55.812736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc02815-a1ea-4e63-ba74-a58102b2cdc3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:55.813468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc02815-a1ea-4e63-ba74-a58102b2cdc3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:55.814688 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc02815-a1ea-4e63-ba74-a58102b2cdc3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:55.822283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8955d9ae-34ee-4eb9-acb3-14e31af86949 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:55.822862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8955d9ae-34ee-4eb9-acb3-14e31af86949 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:55.823398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8955d9ae-34ee-4eb9-acb3-14e31af86949 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:55.824646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8955d9ae-34ee-4eb9-acb3-14e31af86949 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:55.828597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8955d9ae-34ee-4eb9-acb3-14e31af86949 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:55.828597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8955d9ae-34ee-4eb9-acb3-14e31af86949 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:56.088609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8fc02815-a1ea-4e63-ba74-a58102b2cdc3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:56.091360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8955d9ae-34ee-4eb9-acb3-14e31af86949 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:56.098429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8fc02815-a1ea-4e63-ba74-a58102b2cdc3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1367 microversion: 2.1 time: 0.318567 Aug 08 08:43:56.098940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8955d9ae-34ee-4eb9-acb3-14e31af86949 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1515 microversion: 2.1 time: 0.316444 Aug 08 08:43:56.099553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 138/292] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:55 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1515 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:56.106431 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 155/293] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:55 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:56.608499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-8353a73d-4717-4e5a-a550-6cc286a89db5 req-c9c9d1fc-4e9f-4f30-84e5-01c914f1890f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62f454f-de08-4ed1-b767-cce30f0af653", "name": "network-vif-plugged", "status": "completed", "tag": "bf74583c-a89c-4fe1-8d42-8e25aafa9a58"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:56.623729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-8353a73d-4717-4e5a-a550-6cc286a89db5 req-c9c9d1fc-4e9f-4f30-84e5-01c914f1890f service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:56.624212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-8353a73d-4717-4e5a-a550-6cc286a89db5 req-c9c9d1fc-4e9f-4f30-84e5-01c914f1890f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:56.624647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-8353a73d-4717-4e5a-a550-6cc286a89db5 req-c9c9d1fc-4e9f-4f30-84e5-01c914f1890f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:56.644919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-8353a73d-4717-4e5a-a550-6cc286a89db5 req-c9c9d1fc-4e9f-4f30-84e5-01c914f1890f service nova] Creating event network-vif-plugged:bf74583c-a89c-4fe1-8d42-8e25aafa9a58 for instance f62f454f-de08-4ed1-b767-cce30f0af653 on hv-cinder-83697 Aug 08 08:43:56.651965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-8353a73d-4717-4e5a-a550-6cc286a89db5 req-c9c9d1fc-4e9f-4f30-84e5-01c914f1890f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047165 Aug 08 08:43:56.653661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 139/294] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:43:56.813179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-77c0df16-8bfd-484f-9825-7fb37ef4a3f3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:56.813825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-77c0df16-8bfd-484f-9825-7fb37ef4a3f3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:56.823735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:56.823735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:56.823989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c0df16-8bfd-484f-9825-7fb37ef4a3f3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:56.823989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c0df16-8bfd-484f-9825-7fb37ef4a3f3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:56.823989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c0df16-8bfd-484f-9825-7fb37ef4a3f3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:56.823989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c0df16-8bfd-484f-9825-7fb37ef4a3f3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:56.824273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c0df16-8bfd-484f-9825-7fb37ef4a3f3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:56.824273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c0df16-8bfd-484f-9825-7fb37ef4a3f3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:56.826425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:56.828458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:56.830583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:56.832253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:56.833238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:56.848571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:56.863077 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:43:57.159374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-77c0df16-8bfd-484f-9825-7fb37ef4a3f3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:57.178928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-77c0df16-8bfd-484f-9825-7fb37ef4a3f3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.366238 Aug 08 08:43:57.178928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 156/295] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:56 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:57.178928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-041fc39f-2b2a-4fd2-b620-6a3632bfaff3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:57.180001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-041fc39f-2b2a-4fd2-b620-6a3632bfaff3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:57.212654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-041fc39f-2b2a-4fd2-b620-6a3632bfaff3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:57.214034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-041fc39f-2b2a-4fd2-b620-6a3632bfaff3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:57.214842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-041fc39f-2b2a-4fd2-b620-6a3632bfaff3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:57.215962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-041fc39f-2b2a-4fd2-b620-6a3632bfaff3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:57.219056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-041fc39f-2b2a-4fd2-b620-6a3632bfaff3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:57.219921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-041fc39f-2b2a-4fd2-b620-6a3632bfaff3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:57.242589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:57.254863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:57.255912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:57.257219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-63dbed84-17b2-48ba-911c-7bc4c7ff67a0 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.448055 Aug 08 08:43:57.258174 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 140/296] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:56 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:43:57.444955 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-041fc39f-2b2a-4fd2-b620-6a3632bfaff3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:57.492732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-041fc39f-2b2a-4fd2-b620-6a3632bfaff3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1367 microversion: 2.1 time: 0.318026 Aug 08 08:43:57.507780 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 157/297] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:57 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:58.003891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b670dc0a-bf15-4775-83ce-0319d5ffd473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Action: 'create', calling method: .version_select at 0x7f4795fbab80>, body: {"keypair": {"name": "tempest-keypair-1244088946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEh21YIhzBIoUYTS4YSaL+DWBt8YUnznGaqngfXiIcwDXD59Mm99nUS4LnX7rqIkeXuPbfkiBpZhcSpa6k2erWN6UTmdDo8Q9UbqQIO85jdtn/TYaBCteOHKKgu8OODCpA=="}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:43:58.034447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-b670dc0a-bf15-4775-83ce-0319d5ffd473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Getting quotas for project 2a4e5c5a950c4047b15749aace25f46d. Resources: {'key_pairs'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:43:58.038343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-b670dc0a-bf15-4775-83ce-0319d5ffd473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Getting quotas for user 00e07188d3df4d958ce83085b7bb141a and project 2a4e5c5a950c4047b15749aace25f46d. Resources: {'key_pairs'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:43:58.194720 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-859ee7f5-6d01-4a4d-b9ba-44d6470246ee tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:58.195336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-859ee7f5-6d01-4a4d-b9ba-44d6470246ee tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:58.201591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-859ee7f5-6d01-4a4d-b9ba-44d6470246ee tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:58.202763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-859ee7f5-6d01-4a4d-b9ba-44d6470246ee tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:58.202763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-859ee7f5-6d01-4a4d-b9ba-44d6470246ee tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:58.203250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-859ee7f5-6d01-4a4d-b9ba-44d6470246ee tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:58.203707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-859ee7f5-6d01-4a4d-b9ba-44d6470246ee tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:58.204170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-859ee7f5-6d01-4a4d-b9ba-44d6470246ee tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:58.255225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b670dc0a-bf15-4775-83ce-0319d5ffd473 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.255804 Aug 08 08:43:58.261810 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 141/298] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 08:43:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:43:58.288396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:58.288647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:58.299754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:58.299754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:58.299969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:58.300623 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:58.301086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:58.301554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:58.484968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-859ee7f5-6d01-4a4d-b9ba-44d6470246ee tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:58.499274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-859ee7f5-6d01-4a4d-b9ba-44d6470246ee tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.308304 Aug 08 08:43:58.500057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 158/299] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:58 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:43:58.521485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1d56216c-09ae-4b74-a56b-d5481fc1c2b9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:58.522046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1d56216c-09ae-4b74-a56b-d5481fc1c2b9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:58.530768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d56216c-09ae-4b74-a56b-d5481fc1c2b9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:58.535634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d56216c-09ae-4b74-a56b-d5481fc1c2b9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:58.535634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d56216c-09ae-4b74-a56b-d5481fc1c2b9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:58.535634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d56216c-09ae-4b74-a56b-d5481fc1c2b9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:58.535634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d56216c-09ae-4b74-a56b-d5481fc1c2b9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:58.535949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d56216c-09ae-4b74-a56b-d5481fc1c2b9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:58.859692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:58.878624 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:58.882762 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:58.883510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-07dd1cad-3fb5-4c42-94aa-62d593b2967d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.600119 Aug 08 08:43:58.886477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 142/300] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:58 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:43:58.994629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1d56216c-09ae-4b74-a56b-d5481fc1c2b9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:59.019979 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1d56216c-09ae-4b74-a56b-d5481fc1c2b9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1367 microversion: 2.1 time: 0.505436 Aug 08 08:43:59.020628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 159/301] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:58 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:59.526506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4596cad2-a664-4e79-83f2-5aa4d7bf3cdd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:59.526506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4596cad2-a664-4e79-83f2-5aa4d7bf3cdd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:59.530874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4596cad2-a664-4e79-83f2-5aa4d7bf3cdd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:59.531377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4596cad2-a664-4e79-83f2-5aa4d7bf3cdd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:59.531824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4596cad2-a664-4e79-83f2-5aa4d7bf3cdd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:59.533589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4596cad2-a664-4e79-83f2-5aa4d7bf3cdd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:59.534067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4596cad2-a664-4e79-83f2-5aa4d7bf3cdd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:59.534491 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4596cad2-a664-4e79-83f2-5aa4d7bf3cdd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:59.745032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4596cad2-a664-4e79-83f2-5aa4d7bf3cdd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:43:59.758867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4596cad2-a664-4e79-83f2-5aa4d7bf3cdd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.240679 Aug 08 08:43:59.772690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 143/302] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:43:59 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:43:59.914019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:43:59.914563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:43:59.920715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:59.921628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:59.926490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:43:59.934324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:43:59.936983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:43:59.936983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:00.043917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-60ac80f8-f355-4db2-80cd-8d80e810943f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:00.044555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-60ac80f8-f355-4db2-80cd-8d80e810943f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:00.053863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ac80f8-f355-4db2-80cd-8d80e810943f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:00.054356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ac80f8-f355-4db2-80cd-8d80e810943f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:00.054798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ac80f8-f355-4db2-80cd-8d80e810943f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:00.055511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ac80f8-f355-4db2-80cd-8d80e810943f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:00.055970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ac80f8-f355-4db2-80cd-8d80e810943f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:00.056397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ac80f8-f355-4db2-80cd-8d80e810943f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:00.288375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:00.307128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:00.308741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:00.316281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-67381677-e1f4-425c-be3d-cff8fc5007e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.406318 Aug 08 08:44:00.323526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 160/303] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:43:59 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:00.374027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-60ac80f8-f355-4db2-80cd-8d80e810943f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:00.384656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-60ac80f8-f355-4db2-80cd-8d80e810943f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1558 microversion: 2.1 time: 0.346522 Aug 08 08:44:00.390935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 144/304] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:00 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1558 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:00.410881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c50da534-a884-4edc-bc93-4e14035b4807 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:00.411674 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c50da534-a884-4edc-bc93-4e14035b4807 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:00.420949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c50da534-a884-4edc-bc93-4e14035b4807 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:00.421687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c50da534-a884-4edc-bc93-4e14035b4807 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:00.430079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c50da534-a884-4edc-bc93-4e14035b4807 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:00.431193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c50da534-a884-4edc-bc93-4e14035b4807 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:00.431854 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c50da534-a884-4edc-bc93-4e14035b4807 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:00.432446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c50da534-a884-4edc-bc93-4e14035b4807 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:00.635934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c50da534-a884-4edc-bc93-4e14035b4807 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.230759 Aug 08 08:44:00.638931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 161/305] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 08:44:00 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653/os-interface => generated 285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:00.779980 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c4439d53-6c8e-42d7-bc17-ff47a40b1eef tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:00.780567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c4439d53-6c8e-42d7-bc17-ff47a40b1eef tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:00.792626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4439d53-6c8e-42d7-bc17-ff47a40b1eef tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:00.793431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4439d53-6c8e-42d7-bc17-ff47a40b1eef tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:00.797204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4439d53-6c8e-42d7-bc17-ff47a40b1eef tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:00.797204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4439d53-6c8e-42d7-bc17-ff47a40b1eef tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:00.797204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4439d53-6c8e-42d7-bc17-ff47a40b1eef tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:00.797204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4439d53-6c8e-42d7-bc17-ff47a40b1eef tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:01.255108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c4439d53-6c8e-42d7-bc17-ff47a40b1eef tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:01.265498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c4439d53-6c8e-42d7-bc17-ff47a40b1eef tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.487560 Aug 08 08:44:01.271162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 145/306] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:00 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:01.347374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:01.347986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:01.363237 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:01.364145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:01.364881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:01.366057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:01.367055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:01.367893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:01.712966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:01.727409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:01.731754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:01.738381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7fe41c3a-2d11-491b-80bd-485a78836de7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.396106 Aug 08 08:44:01.738966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 162/307] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:01 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:01.911382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1717627408", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cceb7cf5-55a5-4f06-9402-fd48dc2229c9"}], "security_groups": [{"name": "tempest-securitygroup--1503890976"}], "key_name": "tempest-keypair-1244088946", "user_data": "}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:02.289268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-61cdbd9f-ecaa-4598-a76b-9118e33c08f7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:02.290062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-61cdbd9f-ecaa-4598-a76b-9118e33c08f7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:02.307107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61cdbd9f-ecaa-4598-a76b-9118e33c08f7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:02.307930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61cdbd9f-ecaa-4598-a76b-9118e33c08f7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:02.308973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61cdbd9f-ecaa-4598-a76b-9118e33c08f7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:02.310417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61cdbd9f-ecaa-4598-a76b-9118e33c08f7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:02.311053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61cdbd9f-ecaa-4598-a76b-9118e33c08f7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:02.311652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61cdbd9f-ecaa-4598-a76b-9118e33c08f7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:02.713938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-61cdbd9f-ecaa-4598-a76b-9118e33c08f7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:02.723530 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-61cdbd9f-ecaa-4598-a76b-9118e33c08f7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.439084 Aug 08 08:44:02.740903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 163/308] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:02 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:44:02.771051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:02.772192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:02.779409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:02.784727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:02.785520 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:02.786492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:02.786957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:02.787399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:02.994808 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:03.004485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:03.012071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:03.013367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-59feaecf-e246-4bbf-837a-94d572ddab9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.255426 Aug 08 08:44:03.013935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 164/309] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:02 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:03.744595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-378a403a-f243-4353-a287-ad6ad55717e5 req-b655a376-a89e-468e-adcb-75c81cef6154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f62f454f-de08-4ed1-b767-cce30f0af653", "tag": "bf74583c-a89c-4fe1-8d42-8e25aafa9a58"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:03.757015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-378a403a-f243-4353-a287-ad6ad55717e5 req-b655a376-a89e-468e-adcb-75c81cef6154 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:03.757949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-378a403a-f243-4353-a287-ad6ad55717e5 req-b655a376-a89e-468e-adcb-75c81cef6154 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:03.758542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-378a403a-f243-4353-a287-ad6ad55717e5 req-b655a376-a89e-468e-adcb-75c81cef6154 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:03.776766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-378a403a-f243-4353-a287-ad6ad55717e5 req-b655a376-a89e-468e-adcb-75c81cef6154 service nova] Creating event network-changed:bf74583c-a89c-4fe1-8d42-8e25aafa9a58 for instance f62f454f-de08-4ed1-b767-cce30f0af653 on hv-cinder-83697 Aug 08 08:44:03.785559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-378a403a-f243-4353-a287-ad6ad55717e5 req-b655a376-a89e-468e-adcb-75c81cef6154 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044430 Aug 08 08:44:03.786879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 165/310] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:44:03.796621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8c6bdadc-1ce2-40e9-b954-41e4ae05c500 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:03.797926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8c6bdadc-1ce2-40e9-b954-41e4ae05c500 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:03.817783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c6bdadc-1ce2-40e9-b954-41e4ae05c500 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:03.817783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c6bdadc-1ce2-40e9-b954-41e4ae05c500 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:03.817783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c6bdadc-1ce2-40e9-b954-41e4ae05c500 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:03.818259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c6bdadc-1ce2-40e9-b954-41e4ae05c500 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:03.818888 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c6bdadc-1ce2-40e9-b954-41e4ae05c500 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:03.819327 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c6bdadc-1ce2-40e9-b954-41e4ae05c500 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:04.061294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8c6bdadc-1ce2-40e9-b954-41e4ae05c500 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:04.078363 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8c6bdadc-1ce2-40e9-b954-41e4ae05c500 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.290264 Aug 08 08:44:04.079833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 166/311] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:03 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:04.117175 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:04.122238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:04.133934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:04.138443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:04.139098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:04.140017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:04.140638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:04.141276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:04.418913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:04.435640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:04.438390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:04.440727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-35dd11b9-170f-4e74-b388-934a12bf92ca tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.359221 Aug 08 08:44:04.453911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 167/312] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:04 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:05.102200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ca3e7be9-22bb-482e-b743-485849abcf8c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:05.103874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ca3e7be9-22bb-482e-b743-485849abcf8c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:05.113318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca3e7be9-22bb-482e-b743-485849abcf8c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:05.114227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca3e7be9-22bb-482e-b743-485849abcf8c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:05.115104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca3e7be9-22bb-482e-b743-485849abcf8c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:05.119213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca3e7be9-22bb-482e-b743-485849abcf8c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:05.120026 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca3e7be9-22bb-482e-b743-485849abcf8c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:05.120688 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca3e7be9-22bb-482e-b743-485849abcf8c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:05.355086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.network.neutron [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] validate_networks() for [('cceb7cf5-55a5-4f06-9402-fd48dc2229c9', None, None, None, None, None)] {{(pid=124673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:44:05.467012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ca3e7be9-22bb-482e-b743-485849abcf8c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:05.478443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ca3e7be9-22bb-482e-b743-485849abcf8c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.382179 Aug 08 08:44:05.495996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 168/313] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:05 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:05.502265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:05.502846 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:05.513469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:05.515760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:05.516369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:05.517971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:05.519336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:05.519336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:05.785326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:05.804670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:05.810910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:05.812632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b85ed830-d3aa-470c-a087-1ca08c316126 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1738 microversion: 2.20 time: 0.315484 Aug 08 08:44:05.836348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 169/314] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:05 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1738 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:06.081335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Flavor limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:44:06.081335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Image limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:44:06.081335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Flavor pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:44:06.081719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Image pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:44:06.082460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:44:06.094725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:06.095892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:06.096575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:06.097553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:06.098479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:06.099085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:06.127091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Getting quotas for project 2a4e5c5a950c4047b15749aace25f46d. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:44:06.132908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Getting quotas for user 00e07188d3df4d958ce83085b7bb141a and project 2a4e5c5a950c4047b15749aace25f46d. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:44:06.145038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Going to run 1 instances... {{(pid=124673) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:44:06.150208 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:44:06.252769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f8ebabd0-dc79-4196-aba2-419dd86647f0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.345914 Aug 08 08:44:06.254770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 146/315] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:44:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 4348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:44:06.270291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9adc2f3d-f5bc-4a6a-ad4e-3111c518165d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:06.270913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9adc2f3d-f5bc-4a6a-ad4e-3111c518165d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:06.356409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9adc2f3d-f5bc-4a6a-ad4e-3111c518165d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:06.365888 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9adc2f3d-f5bc-4a6a-ad4e-3111c518165d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1246 microversion: 2.1 time: 0.100518 Aug 08 08:44:06.367612 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 170/316] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:06 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:06.500056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8ca2a649-df63-4114-a169-450c5b20670a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:06.502653 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8ca2a649-df63-4114-a169-450c5b20670a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:06.520693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ca2a649-df63-4114-a169-450c5b20670a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:06.521659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ca2a649-df63-4114-a169-450c5b20670a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:06.522243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ca2a649-df63-4114-a169-450c5b20670a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:06.523091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ca2a649-df63-4114-a169-450c5b20670a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:06.523562 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ca2a649-df63-4114-a169-450c5b20670a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:06.524574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ca2a649-df63-4114-a169-450c5b20670a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:06.694342 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8ca2a649-df63-4114-a169-450c5b20670a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:06.702621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8ca2a649-df63-4114-a169-450c5b20670a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.206654 Aug 08 08:44:06.703508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 147/317] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:06 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:06.836722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:06.837680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:06.844491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:06.844979 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:06.846229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:06.846942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:06.847397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:06.847857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:07.029130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:07.041964 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:07.044129 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:07.045683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-62c7c204-c64e-4170-b5e0-eac621bb76a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1720 microversion: 2.20 time: 0.213285 Aug 08 08:44:07.046400 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 171/318] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:06 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:07.387453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-39a58621-5343-491c-9dda-2327f77ca51d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:07.388966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-39a58621-5343-491c-9dda-2327f77ca51d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:07.421041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a58621-5343-491c-9dda-2327f77ca51d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:07.427025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a58621-5343-491c-9dda-2327f77ca51d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:07.430020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a58621-5343-491c-9dda-2327f77ca51d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:07.430020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a58621-5343-491c-9dda-2327f77ca51d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:07.430020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a58621-5343-491c-9dda-2327f77ca51d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:07.430020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a58621-5343-491c-9dda-2327f77ca51d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:07.504303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-39a58621-5343-491c-9dda-2327f77ca51d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:07.513539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-39a58621-5343-491c-9dda-2327f77ca51d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1250 microversion: 2.1 time: 0.130210 Aug 08 08:44:07.514573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 148/319] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:07 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1250 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:07.724514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3d28eeed-b675-495d-9963-2e3edc9b7661 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:07.725226 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3d28eeed-b675-495d-9963-2e3edc9b7661 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:07.733774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d28eeed-b675-495d-9963-2e3edc9b7661 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:07.734268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d28eeed-b675-495d-9963-2e3edc9b7661 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:07.734710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d28eeed-b675-495d-9963-2e3edc9b7661 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:07.735414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d28eeed-b675-495d-9963-2e3edc9b7661 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:07.736007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d28eeed-b675-495d-9963-2e3edc9b7661 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:07.736438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d28eeed-b675-495d-9963-2e3edc9b7661 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:07.874443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3d28eeed-b675-495d-9963-2e3edc9b7661 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:07.883590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3d28eeed-b675-495d-9963-2e3edc9b7661 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1724 microversion: 2.1 time: 0.163592 Aug 08 08:44:07.884598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 172/320] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:07 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:08.074139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:08.074941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:08.082587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:08.083651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:08.084507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:08.085662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:08.086335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:08.086983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:08.238149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:08.246873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:08.248711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:08.249911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9828b22d-51a7-4bdd-9574-2b8d58b36d84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1720 microversion: 2.20 time: 0.179909 Aug 08 08:44:08.250463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 149/321] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:08 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:08.524384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-747ea2b0-c5a4-4451-af5e-b737d5dc5bc3 req-51bbabe2-30ff-4549-a6c6-b193b290bca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa423dc-c608-40ed-a783-faf7a48d13c1", "name": "network-vif-unplugged", "status": "completed", "tag": "22c96d99-e75c-4e18-bb06-3b7e1fc4519b"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:08.534250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6cb1c767-ff02-4aa7-913d-e6ab00f70bec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:08.534955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6cb1c767-ff02-4aa7-913d-e6ab00f70bec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:08.535475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-747ea2b0-c5a4-4451-af5e-b737d5dc5bc3 req-51bbabe2-30ff-4549-a6c6-b193b290bca7 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:08.535960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-747ea2b0-c5a4-4451-af5e-b737d5dc5bc3 req-51bbabe2-30ff-4549-a6c6-b193b290bca7 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:08.536392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-747ea2b0-c5a4-4451-af5e-b737d5dc5bc3 req-51bbabe2-30ff-4549-a6c6-b193b290bca7 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:08.552635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6cb1c767-ff02-4aa7-913d-e6ab00f70bec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:08.553454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6cb1c767-ff02-4aa7-913d-e6ab00f70bec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:08.554048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6cb1c767-ff02-4aa7-913d-e6ab00f70bec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:08.555691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6cb1c767-ff02-4aa7-913d-e6ab00f70bec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:08.557981 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6cb1c767-ff02-4aa7-913d-e6ab00f70bec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:08.558596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6cb1c767-ff02-4aa7-913d-e6ab00f70bec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:08.562151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-747ea2b0-c5a4-4451-af5e-b737d5dc5bc3 req-51bbabe2-30ff-4549-a6c6-b193b290bca7 service nova] Creating event network-vif-unplugged:22c96d99-e75c-4e18-bb06-3b7e1fc4519b for instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 on hv-cinder-83697 Aug 08 08:44:08.575164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-747ea2b0-c5a4-4451-af5e-b737d5dc5bc3 req-51bbabe2-30ff-4549-a6c6-b193b290bca7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055234 Aug 08 08:44:08.578947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 173/322] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:08.668312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6cb1c767-ff02-4aa7-913d-e6ab00f70bec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:08.679108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6cb1c767-ff02-4aa7-913d-e6ab00f70bec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1250 microversion: 2.1 time: 0.149038 Aug 08 08:44:08.680193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 150/323] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:08 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1250 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:44:08.907357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-079feec4-c81b-4f90-8bcf-b714d04b4cf9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:08.908866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-079feec4-c81b-4f90-8bcf-b714d04b4cf9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:08.915469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-079feec4-c81b-4f90-8bcf-b714d04b4cf9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:08.915902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-079feec4-c81b-4f90-8bcf-b714d04b4cf9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:08.916344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-079feec4-c81b-4f90-8bcf-b714d04b4cf9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:08.917052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-079feec4-c81b-4f90-8bcf-b714d04b4cf9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:08.917543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-079feec4-c81b-4f90-8bcf-b714d04b4cf9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:08.917978 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-079feec4-c81b-4f90-8bcf-b714d04b4cf9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:09.085739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-079feec4-c81b-4f90-8bcf-b714d04b4cf9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:09.094818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-079feec4-c81b-4f90-8bcf-b714d04b4cf9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1701 microversion: 2.1 time: 0.192250 Aug 08 08:44:09.096528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 174/324] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:08 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1701 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:44:09.117654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0f9d6f82-1826-49c5-ad4d-94aaf25b46b3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:09.123742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f9d6f82-1826-49c5-ad4d-94aaf25b46b3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:09.124434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f9d6f82-1826-49c5-ad4d-94aaf25b46b3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:09.124881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f9d6f82-1826-49c5-ad4d-94aaf25b46b3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:09.188123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0f9d6f82-1826-49c5-ad4d-94aaf25b46b3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Going to try to start instance {{(pid=124673) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 08:44:09.273925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:09.275199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:09.283840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:09.284568 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:09.285937 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:09.287059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:09.287380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:09.287900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:09.384926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0f9d6f82-1826-49c5-ad4d-94aaf25b46b3 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "POST /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/action" status: 202 len: 0 microversion: 2.1 time: 0.271722 Aug 08 08:44:09.386085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 151/325] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:44:09 2022] POST /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:44:09.401720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8798143f-fa94-4a6b-af9d-4831b4eaad33 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:09.402786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8798143f-fa94-4a6b-af9d-4831b4eaad33 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:09.413950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8798143f-fa94-4a6b-af9d-4831b4eaad33 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:09.415366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8798143f-fa94-4a6b-af9d-4831b4eaad33 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:09.415366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8798143f-fa94-4a6b-af9d-4831b4eaad33 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:09.416261 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8798143f-fa94-4a6b-af9d-4831b4eaad33 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:09.416990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8798143f-fa94-4a6b-af9d-4831b4eaad33 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:09.417768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8798143f-fa94-4a6b-af9d-4831b4eaad33 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:09.443997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:09.491887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:09.496234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:09.506142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:09.508120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:09.509410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-12d544f9-34ad-43c8-a182-67ec584245e4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1723 microversion: 2.20 time: 0.241104 Aug 08 08:44:09.510489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 175/326] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:09 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:44:09.534005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2d91a47f-810b-4ce2-bcf5-088df1a592b4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "855bfe0f-64e4-4048-a273-f7f8fcbe41b0"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:09.536903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2d91a47f-810b-4ce2-bcf5-088df1a592b4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:09.543605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2d91a47f-810b-4ce2-bcf5-088df1a592b4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:09.544342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2d91a47f-810b-4ce2-bcf5-088df1a592b4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:09.544970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2d91a47f-810b-4ce2-bcf5-088df1a592b4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:09.545738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2d91a47f-810b-4ce2-bcf5-088df1a592b4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:09.546236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2d91a47f-810b-4ce2-bcf5-088df1a592b4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:09.546673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2d91a47f-810b-4ce2-bcf5-088df1a592b4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:09.685684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8798143f-fa94-4a6b-af9d-4831b4eaad33 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:09.695098 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8798143f-fa94-4a6b-af9d-4831b4eaad33 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1710 microversion: 2.1 time: 0.303674 Aug 08 08:44:09.695658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 152/327] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:09 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1710 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:09.716586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-155dbb2e-722e-4c20-ac14-b9fb4056a530 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:09.719448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-155dbb2e-722e-4c20-ac14-b9fb4056a530 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:09.732398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-155dbb2e-722e-4c20-ac14-b9fb4056a530 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:09.732893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-155dbb2e-722e-4c20-ac14-b9fb4056a530 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:09.733362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-155dbb2e-722e-4c20-ac14-b9fb4056a530 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:09.737281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-155dbb2e-722e-4c20-ac14-b9fb4056a530 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:09.737759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-155dbb2e-722e-4c20-ac14-b9fb4056a530 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:09.739672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-155dbb2e-722e-4c20-ac14-b9fb4056a530 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:09.858480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-155dbb2e-722e-4c20-ac14-b9fb4056a530 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:09.871532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-155dbb2e-722e-4c20-ac14-b9fb4056a530 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1298 microversion: 2.1 time: 0.168913 Aug 08 08:44:09.872125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 153/328] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:09 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1298 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:10.718594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-19fa9d53-98c5-4cc1-be55-828643b7a93b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:10.721801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-19fa9d53-98c5-4cc1-be55-828643b7a93b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:10.726984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:10.743784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19fa9d53-98c5-4cc1-be55-828643b7a93b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:10.746013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19fa9d53-98c5-4cc1-be55-828643b7a93b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:10.747374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19fa9d53-98c5-4cc1-be55-828643b7a93b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:10.749910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19fa9d53-98c5-4cc1-be55-828643b7a93b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:10.750571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19fa9d53-98c5-4cc1-be55-828643b7a93b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:10.752600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19fa9d53-98c5-4cc1-be55-828643b7a93b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:11.071815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2d91a47f-810b-4ce2-bcf5-088df1a592b4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "POST /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.542391 Aug 08 08:44:11.073453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 176/329] 10.222.0.33 () {62 vars in 1364 bytes} [Mon Aug 8 08:44:09 2022] POST /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments => generated 188 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:44:11.078470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fad7dccf-cfec-4e1e-928a-05d6125844d5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:11.079108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fad7dccf-cfec-4e1e-928a-05d6125844d5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:11.109564 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fad7dccf-cfec-4e1e-928a-05d6125844d5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:11.111495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fad7dccf-cfec-4e1e-928a-05d6125844d5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:11.112612 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fad7dccf-cfec-4e1e-928a-05d6125844d5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:11.115509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fad7dccf-cfec-4e1e-928a-05d6125844d5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:11.116293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fad7dccf-cfec-4e1e-928a-05d6125844d5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:11.117642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fad7dccf-cfec-4e1e-928a-05d6125844d5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:11.391412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fad7dccf-cfec-4e1e-928a-05d6125844d5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:11.399696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-19fa9d53-98c5-4cc1-be55-828643b7a93b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:11.402015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fad7dccf-cfec-4e1e-928a-05d6125844d5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1304 microversion: 2.1 time: 0.328550 Aug 08 08:44:11.407831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-19fa9d53-98c5-4cc1-be55-828643b7a93b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1710 microversion: 2.1 time: 0.694212 Aug 08 08:44:11.421894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 154/330] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:10 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1710 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:11.424638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 177/331] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:11 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1304 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:11.428987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7f25cb1b-44b9-45d6-881c-4aa7a63344db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:11.428987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7f25cb1b-44b9-45d6-881c-4aa7a63344db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:11.434710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f25cb1b-44b9-45d6-881c-4aa7a63344db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:11.435207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f25cb1b-44b9-45d6-881c-4aa7a63344db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:11.435828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f25cb1b-44b9-45d6-881c-4aa7a63344db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:11.436678 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f25cb1b-44b9-45d6-881c-4aa7a63344db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:11.437330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f25cb1b-44b9-45d6-881c-4aa7a63344db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:11.437917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f25cb1b-44b9-45d6-881c-4aa7a63344db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:11.491147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7f25cb1b-44b9-45d6-881c-4aa7a63344db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124673) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 08:44:11.862904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7f25cb1b-44b9-45d6-881c-4aa7a63344db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "POST /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/action" status: 202 len: 0 microversion: 2.20 time: 0.439603 Aug 08 08:44:11.863583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 155/332] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Aug 8 08:44:11 2022] POST /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:44:11.874905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:11.876910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:11.884950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:11.886539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:11.887468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:11.888404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:11.889047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:11.889586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:12.076134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:12.085570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:12.090878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:12.097556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d83eaee6-88e9-49f0-90c6-0363fc851e9d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1749 microversion: 2.20 time: 0.228805 Aug 08 08:44:12.105238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 178/333] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:11 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1749 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:12.438191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8f490f91-70dc-4c71-a015-0d226f3c5680 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:12.440326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8f490f91-70dc-4c71-a015-0d226f3c5680 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:12.452871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b2f386cb-c6e3-4f76-89ea-bc8a031e5e59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:12.457186 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b2f386cb-c6e3-4f76-89ea-bc8a031e5e59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:12.472689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f490f91-70dc-4c71-a015-0d226f3c5680 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:12.473048 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2f386cb-c6e3-4f76-89ea-bc8a031e5e59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:12.473639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2f386cb-c6e3-4f76-89ea-bc8a031e5e59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:12.474403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f490f91-70dc-4c71-a015-0d226f3c5680 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:12.474628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2f386cb-c6e3-4f76-89ea-bc8a031e5e59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:12.476070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f490f91-70dc-4c71-a015-0d226f3c5680 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:12.476956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2f386cb-c6e3-4f76-89ea-bc8a031e5e59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:12.478201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f490f91-70dc-4c71-a015-0d226f3c5680 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:12.478870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2f386cb-c6e3-4f76-89ea-bc8a031e5e59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:12.479897 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2f386cb-c6e3-4f76-89ea-bc8a031e5e59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:12.480269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f490f91-70dc-4c71-a015-0d226f3c5680 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:12.483924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f490f91-70dc-4c71-a015-0d226f3c5680 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:12.927461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b2f386cb-c6e3-4f76-89ea-bc8a031e5e59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:12.935228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b2f386cb-c6e3-4f76-89ea-bc8a031e5e59 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.488054 Aug 08 08:44:12.935823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 179/334] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:12 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:12.950473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8f490f91-70dc-4c71-a015-0d226f3c5680 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:12.959090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8f490f91-70dc-4c71-a015-0d226f3c5680 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1710 microversion: 2.1 time: 0.528599 Aug 08 08:44:12.959820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 156/335] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:12 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1710 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:13.126801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:13.128020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:13.135776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:13.136510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:13.137244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:13.138148 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:13.138796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:13.139406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:13.477118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:13.486797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:13.505106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:13.505892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4d2e8266-b1b6-4944-8ece-730cc4303c02 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1749 microversion: 2.20 time: 0.388471 Aug 08 08:44:13.506399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 180/336] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:13 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1749 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:13.821853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-0f62b9d3-b07c-48ca-a663-66c687017611 req-29e1c77e-caa6-4c40-a555-d5513fabb837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79aff6d2-7210-4da9-8624-b1fa9f66350a", "tag": "354f0823-fe90-4acf-b32b-47d5aa7bebb5"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:13.846306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-0f62b9d3-b07c-48ca-a663-66c687017611 req-29e1c77e-caa6-4c40-a555-d5513fabb837 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:13.847122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-0f62b9d3-b07c-48ca-a663-66c687017611 req-29e1c77e-caa6-4c40-a555-d5513fabb837 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:13.848377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-0f62b9d3-b07c-48ca-a663-66c687017611 req-29e1c77e-caa6-4c40-a555-d5513fabb837 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:13.865675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-0f62b9d3-b07c-48ca-a663-66c687017611 req-29e1c77e-caa6-4c40-a555-d5513fabb837 service nova] Creating event network-changed:354f0823-fe90-4acf-b32b-47d5aa7bebb5 for instance 79aff6d2-7210-4da9-8624-b1fa9f66350a on hv-cinder-83697 Aug 08 08:44:13.876351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-0f62b9d3-b07c-48ca-a663-66c687017611 req-29e1c77e-caa6-4c40-a555-d5513fabb837 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059718 Aug 08 08:44:13.879053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 157/337] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:13.959300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-66869e36-f551-424b-b71c-58fe34d4c089 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:13.960843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-66869e36-f551-424b-b71c-58fe34d4c089 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:13.982527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c1c59c9a-5e45-4ad5-abfb-19d600fa448d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:13.984142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c1c59c9a-5e45-4ad5-abfb-19d600fa448d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:13.991135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66869e36-f551-424b-b71c-58fe34d4c089 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:13.991896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66869e36-f551-424b-b71c-58fe34d4c089 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:13.994751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66869e36-f551-424b-b71c-58fe34d4c089 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:13.996381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66869e36-f551-424b-b71c-58fe34d4c089 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:13.996900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1c59c9a-5e45-4ad5-abfb-19d600fa448d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:13.997235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66869e36-f551-424b-b71c-58fe34d4c089 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:13.997419 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1c59c9a-5e45-4ad5-abfb-19d600fa448d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:13.997859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1c59c9a-5e45-4ad5-abfb-19d600fa448d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:13.998449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66869e36-f551-424b-b71c-58fe34d4c089 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:14.003748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1c59c9a-5e45-4ad5-abfb-19d600fa448d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:14.004327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1c59c9a-5e45-4ad5-abfb-19d600fa448d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:14.006150 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1c59c9a-5e45-4ad5-abfb-19d600fa448d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:14.322247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-66869e36-f551-424b-b71c-58fe34d4c089 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:14.339715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-66869e36-f551-424b-b71c-58fe34d4c089 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.385882 Aug 08 08:44:14.342570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 181/338] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:13 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:14.353975 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c1c59c9a-5e45-4ad5-abfb-19d600fa448d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:14.366557 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c1c59c9a-5e45-4ad5-abfb-19d600fa448d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1714 microversion: 2.1 time: 0.390343 Aug 08 08:44:14.367698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 158/339] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:13 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1714 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:14.541378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:14.541997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:14.554761 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:14.555324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:14.555768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:14.556496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:14.556980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:14.557467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:14.756579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:14.767480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:14.769491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:14.770874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a276dd8c-1d13-4935-9093-53ea21cac4b6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1749 microversion: 2.20 time: 0.233426 Aug 08 08:44:14.771436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 182/340] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:14 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1749 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:15.365891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d933a986-112b-43c3-8c07-63510403dfd4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:15.367790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d933a986-112b-43c3-8c07-63510403dfd4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:15.377429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d933a986-112b-43c3-8c07-63510403dfd4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:15.378285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d933a986-112b-43c3-8c07-63510403dfd4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:15.378791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d933a986-112b-43c3-8c07-63510403dfd4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:15.379426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d933a986-112b-43c3-8c07-63510403dfd4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:15.380038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d933a986-112b-43c3-8c07-63510403dfd4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:15.380620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d933a986-112b-43c3-8c07-63510403dfd4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:15.547560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d933a986-112b-43c3-8c07-63510403dfd4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:15.556809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d933a986-112b-43c3-8c07-63510403dfd4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.195400 Aug 08 08:44:15.557622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 159/341] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:15 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:15.646833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fbe320ae-876d-43dc-8700-e5e7caf572ba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Action: 'create', calling method: .version_select at 0x7f4795cc6700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1650248059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4BzQznnQ+0qzFksgob8rBUjlTRdbvHmbVIbkS0AMiAwTDVlAYhrBQr0RJ7tnAlbeW0ShlvguXy4EARA8cWe79cchJV8jUkgJsSJy4SuEDsEcx5rt3FX0tBHeg2Y02nfQ=="}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:15.670160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-fbe320ae-876d-43dc-8700-e5e7caf572ba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Getting quotas for project e87616891fa34cd9aca388a5d101f3f9. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:44:15.674716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-fbe320ae-876d-43dc-8700-e5e7caf572ba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Getting quotas for user cd870619247a47ac810fea1aa636ac65 and project e87616891fa34cd9aca388a5d101f3f9. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:44:15.779277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fbe320ae-876d-43dc-8700-e5e7caf572ba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.300416 Aug 08 08:44:15.779894 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 183/342] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 08:44:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:44:15.793899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:15.794577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:15.807153 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:15.807988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:15.808591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:15.813416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:15.814446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:15.814893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:16.061454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:16.070660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:16.072327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:16.073527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ff7ecc9d-8596-458a-a23f-5cd8f5f617a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1751 microversion: 2.20 time: 0.283687 Aug 08 08:44:16.074324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 160/343] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:15 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1751 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:16.578293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3f992fae-2122-4baa-aa45-eb0343000123 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:16.580201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3f992fae-2122-4baa-aa45-eb0343000123 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:16.587061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f992fae-2122-4baa-aa45-eb0343000123 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:16.587554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f992fae-2122-4baa-aa45-eb0343000123 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:16.588114 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f992fae-2122-4baa-aa45-eb0343000123 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:16.588822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f992fae-2122-4baa-aa45-eb0343000123 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:16.589311 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f992fae-2122-4baa-aa45-eb0343000123 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:16.589852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f992fae-2122-4baa-aa45-eb0343000123 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:16.734065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3f992fae-2122-4baa-aa45-eb0343000123 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:16.742549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3f992fae-2122-4baa-aa45-eb0343000123 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.168463 Aug 08 08:44:16.743129 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 184/344] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:16 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:17.099314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:17.100934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:17.108052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:17.109030 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=10 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:17.112273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:17.112948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:17.113715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:17.114577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:17.115184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:17.115766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:17.277837 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:17.288144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:17.289726 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:17.290894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b206d1c6-2b4f-41e9-b19d-9fc5c401482d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1751 microversion: 2.20 time: 0.196436 Aug 08 08:44:17.291455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 161/345] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:17 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:17.763140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4d2c442f-4abf-494e-b48b-9d110ac311ec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:17.763752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4d2c442f-4abf-494e-b48b-9d110ac311ec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:17.770495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2c442f-4abf-494e-b48b-9d110ac311ec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:17.771036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2c442f-4abf-494e-b48b-9d110ac311ec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:17.771471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2c442f-4abf-494e-b48b-9d110ac311ec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:17.772167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2c442f-4abf-494e-b48b-9d110ac311ec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:17.772621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2c442f-4abf-494e-b48b-9d110ac311ec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:17.773047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d2c442f-4abf-494e-b48b-9d110ac311ec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:17.911122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4d2c442f-4abf-494e-b48b-9d110ac311ec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:17.922334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4d2c442f-4abf-494e-b48b-9d110ac311ec tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.162114 Aug 08 08:44:17.922334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 185/346] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:17 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:18.314661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:18.315403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:18.322235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:18.322844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:18.323397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:18.324218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:18.324720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:18.325172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:18.471648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:18.477678 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:18.479181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:18.480675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-37b7254d-eb9f-41ac-b564-9c17d0ee6d0c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1751 microversion: 2.20 time: 0.170870 Aug 08 08:44:18.481709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 162/347] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:18 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:18.944304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bbfa57ab-97b7-45e4-acde-1ba38f24030a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:18.944925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bbfa57ab-97b7-45e4-acde-1ba38f24030a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:18.951534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bbfa57ab-97b7-45e4-acde-1ba38f24030a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:18.952026 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bbfa57ab-97b7-45e4-acde-1ba38f24030a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:18.952512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bbfa57ab-97b7-45e4-acde-1ba38f24030a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:18.953273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bbfa57ab-97b7-45e4-acde-1ba38f24030a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:18.953811 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bbfa57ab-97b7-45e4-acde-1ba38f24030a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:18.954459 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bbfa57ab-97b7-45e4-acde-1ba38f24030a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:19.109804 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bbfa57ab-97b7-45e4-acde-1ba38f24030a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:19.119349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bbfa57ab-97b7-45e4-acde-1ba38f24030a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.179253 Aug 08 08:44:19.119919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 186/348] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:18 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:19.505420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:19.506040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:19.512740 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:19.513264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:19.513706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:19.514404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:19.514863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:19.515349 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:19.651643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:19.660635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:19.662139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:19.663353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-36346317-1202-4a3d-a954-e4924800d4a5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.162489 Aug 08 08:44:19.663897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 163/349] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:19 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:20.139729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9d60a30e-6f70-42a6-91ac-c9f8ce111f5c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:20.140335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9d60a30e-6f70-42a6-91ac-c9f8ce111f5c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:20.146959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d60a30e-6f70-42a6-91ac-c9f8ce111f5c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:20.147440 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d60a30e-6f70-42a6-91ac-c9f8ce111f5c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:20.147873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d60a30e-6f70-42a6-91ac-c9f8ce111f5c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:20.148581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d60a30e-6f70-42a6-91ac-c9f8ce111f5c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:20.149013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d60a30e-6f70-42a6-91ac-c9f8ce111f5c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:20.149464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d60a30e-6f70-42a6-91ac-c9f8ce111f5c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:20.374642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9d60a30e-6f70-42a6-91ac-c9f8ce111f5c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:20.382727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9d60a30e-6f70-42a6-91ac-c9f8ce111f5c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.246791 Aug 08 08:44:20.383404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 187/350] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:20 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:20.687229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:20.687910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:20.695371 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:20.695992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:20.696478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:20.697282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:20.697803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:20.704537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:20.842184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:20.851384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:20.853254 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:20.854494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-71e25758-17d8-4908-8335-58b263bafcc7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.171436 Aug 08 08:44:20.858501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 164/351] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:20 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:21.404040 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-67361b22-bd24-4d81-9593-a8a1b21c281e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:21.404712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-67361b22-bd24-4d81-9593-a8a1b21c281e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:21.415259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67361b22-bd24-4d81-9593-a8a1b21c281e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:21.415772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67361b22-bd24-4d81-9593-a8a1b21c281e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:21.416216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67361b22-bd24-4d81-9593-a8a1b21c281e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:21.416965 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67361b22-bd24-4d81-9593-a8a1b21c281e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:21.417491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67361b22-bd24-4d81-9593-a8a1b21c281e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:21.419274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67361b22-bd24-4d81-9593-a8a1b21c281e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:21.637071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-67361b22-bd24-4d81-9593-a8a1b21c281e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:21.648881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-67361b22-bd24-4d81-9593-a8a1b21c281e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.248772 Aug 08 08:44:21.651053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 188/352] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:21 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:21.826400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-cd83cc9a-1972-445b-8a38-8de059d4ec70 req-46980deb-896a-49e6-bc63-60b4cb5477a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79aff6d2-7210-4da9-8624-b1fa9f66350a", "name": "network-vif-plugged", "status": "completed", "tag": "354f0823-fe90-4acf-b32b-47d5aa7bebb5"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:21.848010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-cd83cc9a-1972-445b-8a38-8de059d4ec70 req-46980deb-896a-49e6-bc63-60b4cb5477a0 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:21.849059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-cd83cc9a-1972-445b-8a38-8de059d4ec70 req-46980deb-896a-49e6-bc63-60b4cb5477a0 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:21.851774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-cd83cc9a-1972-445b-8a38-8de059d4ec70 req-46980deb-896a-49e6-bc63-60b4cb5477a0 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:21.880270 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:21.880896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:21.887745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:21.888112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-cd83cc9a-1972-445b-8a38-8de059d4ec70 req-46980deb-896a-49e6-bc63-60b4cb5477a0 service nova] Creating event network-vif-plugged:354f0823-fe90-4acf-b32b-47d5aa7bebb5 for instance 79aff6d2-7210-4da9-8624-b1fa9f66350a on hv-cinder-83697 Aug 08 08:44:21.892314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:21.893202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:21.895240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:21.895907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-cd83cc9a-1972-445b-8a38-8de059d4ec70 req-46980deb-896a-49e6-bc63-60b4cb5477a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073113 Aug 08 08:44:21.896548 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:21.897845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:21.898244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 165/353] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:22.068420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:22.077862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:22.079507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:22.081299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-658e7fec-a8d5-447c-aabc-8dd6b05a294c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.205974 Aug 08 08:44:22.081860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 189/354] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:21 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:22.682955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c1179a46-8a76-4ca9-a975-e73e9e39cf0e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:22.682955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c1179a46-8a76-4ca9-a975-e73e9e39cf0e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:22.682955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1179a46-8a76-4ca9-a975-e73e9e39cf0e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:22.682955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1179a46-8a76-4ca9-a975-e73e9e39cf0e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:22.683603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1179a46-8a76-4ca9-a975-e73e9e39cf0e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:22.683603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1179a46-8a76-4ca9-a975-e73e9e39cf0e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:22.683603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1179a46-8a76-4ca9-a975-e73e9e39cf0e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:22.683603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1179a46-8a76-4ca9-a975-e73e9e39cf0e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:22.848978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c1179a46-8a76-4ca9-a975-e73e9e39cf0e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:22.856626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c1179a46-8a76-4ca9-a975-e73e9e39cf0e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.188495 Aug 08 08:44:22.857355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 166/355] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:22 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:44:23.105916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:23.106673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:23.112883 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:23.113404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:23.113846 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:23.114535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:23.115107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:23.115537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:23.297760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:23.301333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:23.306682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:23.308207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:23.309466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a2de8113-5ae4-414f-ae06-ce9261ac5d36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.207995 Aug 08 08:44:23.310019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 190/356] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:23 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:23.879424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dde757b6-f8ee-41e4-9787-e19a4ef8be02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:23.882127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dde757b6-f8ee-41e4-9787-e19a4ef8be02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:23.888845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde757b6-f8ee-41e4-9787-e19a4ef8be02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:23.889567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde757b6-f8ee-41e4-9787-e19a4ef8be02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:23.890076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde757b6-f8ee-41e4-9787-e19a4ef8be02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:23.890817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde757b6-f8ee-41e4-9787-e19a4ef8be02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:23.891292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde757b6-f8ee-41e4-9787-e19a4ef8be02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:23.891755 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde757b6-f8ee-41e4-9787-e19a4ef8be02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:24.035909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-dde757b6-f8ee-41e4-9787-e19a4ef8be02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:24.043705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dde757b6-f8ee-41e4-9787-e19a4ef8be02 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.169361 Aug 08 08:44:24.044266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 167/357] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:23 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:24.336951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:24.337585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:24.352015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:24.359097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:24.359097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:24.359097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:24.359097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:24.359430 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:24.520074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:24.523049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:24.524609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:24.525794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-919b482c-6e7c-4356-a69c-b69926599164 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.193798 Aug 08 08:44:24.526343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 191/358] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:24 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:44:25.066318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a9f67b97-fc9f-49b0-9859-e02d1121d859 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:25.069796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a9f67b97-fc9f-49b0-9859-e02d1121d859 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:25.082059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9f67b97-fc9f-49b0-9859-e02d1121d859 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:25.086237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9f67b97-fc9f-49b0-9859-e02d1121d859 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:25.086237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9f67b97-fc9f-49b0-9859-e02d1121d859 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:25.086237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9f67b97-fc9f-49b0-9859-e02d1121d859 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:25.086237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9f67b97-fc9f-49b0-9859-e02d1121d859 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:25.086725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9f67b97-fc9f-49b0-9859-e02d1121d859 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:25.255481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a9f67b97-fc9f-49b0-9859-e02d1121d859 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:25.263439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a9f67b97-fc9f-49b0-9859-e02d1121d859 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.202682 Aug 08 08:44:25.273459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 168/359] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:25 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:25.551776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:25.552417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:25.554378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:25.559000 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:25.559485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:25.559923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:25.560612 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:25.561076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:25.561527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:25.682217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=6 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:25.727682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:25.739808 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:25.741283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:25.742817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-97888ba9-9756-46dd-a357-77690531604a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.195744 Aug 08 08:44:25.743498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 192/360] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:25 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:26.285619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-60ceef27-19c0-4c94-9590-15081a39d988 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:26.286910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-60ceef27-19c0-4c94-9590-15081a39d988 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:26.306077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ceef27-19c0-4c94-9590-15081a39d988 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:26.306889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ceef27-19c0-4c94-9590-15081a39d988 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:26.308330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ceef27-19c0-4c94-9590-15081a39d988 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:26.309049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ceef27-19c0-4c94-9590-15081a39d988 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:26.309535 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ceef27-19c0-4c94-9590-15081a39d988 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:26.309978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60ceef27-19c0-4c94-9590-15081a39d988 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:26.327110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:26.477514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-60ceef27-19c0-4c94-9590-15081a39d988 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:26.484798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-60ceef27-19c0-4c94-9590-15081a39d988 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.204446 Aug 08 08:44:26.485419 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 169/361] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:26 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:26.766787 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:26.767594 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:26.791080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:26.791589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:26.792033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:26.792748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:26.793458 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:26.793890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:26.942628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:26.952309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:26.954431 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:26.957092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d93fa1d2-4682-4c31-986d-c0ed8ccd76fc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.194821 Aug 08 08:44:26.959865 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 193/362] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:26 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:27.505567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7c30dd65-25e6-4c3f-b823-de2cee722b41 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:27.506182 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7c30dd65-25e6-4c3f-b823-de2cee722b41 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:27.512756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c30dd65-25e6-4c3f-b823-de2cee722b41 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:27.513270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c30dd65-25e6-4c3f-b823-de2cee722b41 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:27.513708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c30dd65-25e6-4c3f-b823-de2cee722b41 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:27.514396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c30dd65-25e6-4c3f-b823-de2cee722b41 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:27.514855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c30dd65-25e6-4c3f-b823-de2cee722b41 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:27.515278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7c30dd65-25e6-4c3f-b823-de2cee722b41 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:27.649808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7c30dd65-25e6-4c3f-b823-de2cee722b41 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:27.659942 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7c30dd65-25e6-4c3f-b823-de2cee722b41 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.159003 Aug 08 08:44:27.660541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 170/363] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:27 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:27.980217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:27.980784 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:27.987515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:27.988001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:27.988443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:27.989234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:27.989699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:27.990139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:28.130931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:28.138574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:28.140496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:28.142097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1a38e052-7056-4637-a39e-961d9655b651 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.166201 Aug 08 08:44:28.143672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 194/364] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:27 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:28.682350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-af4e1f8a-25cf-4a5f-939e-c569d1db04e3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:28.683790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-af4e1f8a-25cf-4a5f-939e-c569d1db04e3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:28.693627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4e1f8a-25cf-4a5f-939e-c569d1db04e3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:28.694380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4e1f8a-25cf-4a5f-939e-c569d1db04e3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:28.694967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4e1f8a-25cf-4a5f-939e-c569d1db04e3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:28.695831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4e1f8a-25cf-4a5f-939e-c569d1db04e3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:28.696441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4e1f8a-25cf-4a5f-939e-c569d1db04e3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:28.697995 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4e1f8a-25cf-4a5f-939e-c569d1db04e3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:29.103803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-af4e1f8a-25cf-4a5f-939e-c569d1db04e3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:29.111765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-af4e1f8a-25cf-4a5f-939e-c569d1db04e3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.433758 Aug 08 08:44:29.112345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 171/365] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:28 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:29.166581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:29.167188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:29.173053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:29.173565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:29.176113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:29.176113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:29.176113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:29.176113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:29.313558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:29.324623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:29.326246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:29.327480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-facee9e7-25d9-4280-9c8f-70be8f5569c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.164764 Aug 08 08:44:29.328263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 195/366] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:29 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:30.132354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-238be6e9-6f9a-4ec5-b8b7-d6d1c638a553 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:30.132955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-238be6e9-6f9a-4ec5-b8b7-d6d1c638a553 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:30.139529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-238be6e9-6f9a-4ec5-b8b7-d6d1c638a553 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:30.140261 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-238be6e9-6f9a-4ec5-b8b7-d6d1c638a553 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:30.140704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-238be6e9-6f9a-4ec5-b8b7-d6d1c638a553 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:30.141445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-238be6e9-6f9a-4ec5-b8b7-d6d1c638a553 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:30.141904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-238be6e9-6f9a-4ec5-b8b7-d6d1c638a553 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:30.142338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-238be6e9-6f9a-4ec5-b8b7-d6d1c638a553 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:30.281942 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-238be6e9-6f9a-4ec5-b8b7-d6d1c638a553 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:30.290036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-238be6e9-6f9a-4ec5-b8b7-d6d1c638a553 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.161602 Aug 08 08:44:30.290605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 172/367] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:30 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:30.353046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:30.354376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:30.360859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:30.361405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:30.361907 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:30.362619 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:30.363071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:30.363494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:30.495287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:30.504702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:30.510699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:30.510699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9599684e-c937-4999-b388-75a9d7977393 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.158548 Aug 08 08:44:30.510699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 196/368] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:30 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:31.311516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-07658a76-95a4-4aa8-a3a9-972b265df8b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:31.312109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-07658a76-95a4-4aa8-a3a9-972b265df8b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:31.319340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07658a76-95a4-4aa8-a3a9-972b265df8b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:31.321592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07658a76-95a4-4aa8-a3a9-972b265df8b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:31.321592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07658a76-95a4-4aa8-a3a9-972b265df8b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:31.321592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07658a76-95a4-4aa8-a3a9-972b265df8b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:31.321592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07658a76-95a4-4aa8-a3a9-972b265df8b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:31.321924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07658a76-95a4-4aa8-a3a9-972b265df8b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:31.467837 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-07658a76-95a4-4aa8-a3a9-972b265df8b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:31.475729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-07658a76-95a4-4aa8-a3a9-972b265df8b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.168389 Aug 08 08:44:31.476301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 173/369] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:31 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:31.531766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:31.532378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:31.538804 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:31.539347 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:31.539796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:31.540534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:31.541072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:31.541484 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:31.673105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:31.682114 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:31.683610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:31.684776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1b72948a-b1b3-499a-bec2-382174d867ee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.156984 Aug 08 08:44:31.685355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 197/370] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:31 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:32.498207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-117cfbe2-7203-4e1a-b55c-9c5b781b417d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:32.498814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-117cfbe2-7203-4e1a-b55c-9c5b781b417d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:32.505616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-117cfbe2-7203-4e1a-b55c-9c5b781b417d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:32.506106 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-117cfbe2-7203-4e1a-b55c-9c5b781b417d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:32.506542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-117cfbe2-7203-4e1a-b55c-9c5b781b417d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:32.507234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-117cfbe2-7203-4e1a-b55c-9c5b781b417d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:32.507689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-117cfbe2-7203-4e1a-b55c-9c5b781b417d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:32.508120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-117cfbe2-7203-4e1a-b55c-9c5b781b417d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:32.638713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-117cfbe2-7203-4e1a-b55c-9c5b781b417d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:32.647153 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-117cfbe2-7203-4e1a-b55c-9c5b781b417d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.152690 Aug 08 08:44:32.647658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 174/371] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:32 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:32.708987 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:32.709625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:32.715541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:32.716020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:32.716451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:32.717133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:32.717606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:32.718025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:32.846159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:32.854848 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:32.856348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:32.857522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-30855f7e-64aa-4a8a-8008-f4657bd01aaa tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.153199 Aug 08 08:44:32.858071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 198/372] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:32 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:33.667621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-653f8413-02dd-449a-ac8f-4147d3ef4819 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:33.668237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-653f8413-02dd-449a-ac8f-4147d3ef4819 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:33.674745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-653f8413-02dd-449a-ac8f-4147d3ef4819 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:33.675228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-653f8413-02dd-449a-ac8f-4147d3ef4819 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:33.675694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-653f8413-02dd-449a-ac8f-4147d3ef4819 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:33.676745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-653f8413-02dd-449a-ac8f-4147d3ef4819 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:33.677233 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-653f8413-02dd-449a-ac8f-4147d3ef4819 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:33.677665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-653f8413-02dd-449a-ac8f-4147d3ef4819 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:33.812634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-653f8413-02dd-449a-ac8f-4147d3ef4819 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:33.820299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-653f8413-02dd-449a-ac8f-4147d3ef4819 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.156488 Aug 08 08:44:33.820870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 175/373] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:33 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:33.880031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:33.885185 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:33.886677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:33.887162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:33.887602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:33.888288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:33.888741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:33.889196 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:34.017002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:34.026766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:34.028268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:34.029486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b9d7defa-df0e-4526-b394-91dbbe73dca4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.153575 Aug 08 08:44:34.030043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 199/374] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:33 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:34.841699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-78bed8d8-f9f3-4693-886e-885add73e0d3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:34.842230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-78bed8d8-f9f3-4693-886e-885add73e0d3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:34.849297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78bed8d8-f9f3-4693-886e-885add73e0d3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:34.849779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78bed8d8-f9f3-4693-886e-885add73e0d3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:34.850213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78bed8d8-f9f3-4693-886e-885add73e0d3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:34.850894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78bed8d8-f9f3-4693-886e-885add73e0d3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:34.851344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78bed8d8-f9f3-4693-886e-885add73e0d3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:34.851767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78bed8d8-f9f3-4693-886e-885add73e0d3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:34.981907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-78bed8d8-f9f3-4693-886e-885add73e0d3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:34.989807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-78bed8d8-f9f3-4693-886e-885add73e0d3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1372 microversion: 2.1 time: 0.152285 Aug 08 08:44:34.997269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 176/375] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:34 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:35.053463 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:35.054076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:35.061115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:35.061632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:35.062069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:35.062766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:35.063227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:35.063660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:35.197471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:35.206172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:35.208307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:35.209553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c6002375-00ee-4499-890e-43ab81bc3f56 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.160903 Aug 08 08:44:35.210160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 200/376] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:35 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:36.010292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-788016e8-7eaf-46eb-9cd3-284232716da2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:36.010897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-788016e8-7eaf-46eb-9cd3-284232716da2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:36.017238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-788016e8-7eaf-46eb-9cd3-284232716da2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:36.017718 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-788016e8-7eaf-46eb-9cd3-284232716da2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:36.018151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-788016e8-7eaf-46eb-9cd3-284232716da2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:36.019143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-788016e8-7eaf-46eb-9cd3-284232716da2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:36.019606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-788016e8-7eaf-46eb-9cd3-284232716da2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:36.020027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-788016e8-7eaf-46eb-9cd3-284232716da2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:36.149575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-788016e8-7eaf-46eb-9cd3-284232716da2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:36.157572 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-788016e8-7eaf-46eb-9cd3-284232716da2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1566 microversion: 2.1 time: 0.150991 Aug 08 08:44:36.172431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 177/377] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:36 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:36.178777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-be8aeaa2-717d-4102-a54a-27cdd424f85c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:36.179830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-be8aeaa2-717d-4102-a54a-27cdd424f85c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:36.186258 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be8aeaa2-717d-4102-a54a-27cdd424f85c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:36.186749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be8aeaa2-717d-4102-a54a-27cdd424f85c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:36.187188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be8aeaa2-717d-4102-a54a-27cdd424f85c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:36.187885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be8aeaa2-717d-4102-a54a-27cdd424f85c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:36.188343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be8aeaa2-717d-4102-a54a-27cdd424f85c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:36.188773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be8aeaa2-717d-4102-a54a-27cdd424f85c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:36.233970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:36.234583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:36.242027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:36.242304 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:36.242744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:36.243443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:36.243895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:36.244320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:36.270492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-be8aeaa2-717d-4102-a54a-27cdd424f85c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096548 Aug 08 08:44:36.271091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 201/378] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 08:44:36 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:36.380059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:36.386846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:36.388350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:36.389549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-27e0087f-eaad-4963-a84b-21820738a9cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.159450 Aug 08 08:44:36.390111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 178/379] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:36 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:44:37.301249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-0a63b6f6-76d0-42c2-af66-308172134d8f req-12abfa97-ccc8-4933-b2e4-d1d5c5d0385b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79aff6d2-7210-4da9-8624-b1fa9f66350a", "tag": "354f0823-fe90-4acf-b32b-47d5aa7bebb5"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:37.312000 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-0a63b6f6-76d0-42c2-af66-308172134d8f req-12abfa97-ccc8-4933-b2e4-d1d5c5d0385b service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:37.312484 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-0a63b6f6-76d0-42c2-af66-308172134d8f req-12abfa97-ccc8-4933-b2e4-d1d5c5d0385b service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:37.312914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-0a63b6f6-76d0-42c2-af66-308172134d8f req-12abfa97-ccc8-4933-b2e4-d1d5c5d0385b service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:37.324743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-0a63b6f6-76d0-42c2-af66-308172134d8f req-12abfa97-ccc8-4933-b2e4-d1d5c5d0385b service nova] Creating event network-changed:354f0823-fe90-4acf-b32b-47d5aa7bebb5 for instance 79aff6d2-7210-4da9-8624-b1fa9f66350a on hv-cinder-83697 Aug 08 08:44:37.330282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-0a63b6f6-76d0-42c2-af66-308172134d8f req-12abfa97-ccc8-4933-b2e4-d1d5c5d0385b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034977 Aug 08 08:44:37.330874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 202/380] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:37.424079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:37.425282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:37.432696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-483207062", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1650248059", "security_groups": [{"name": "tempest-secgroup-smoke-306397345"}], "block_device_mapping_v2": [{"uuid": "377126e8-5e47-40fd-b0ea-29ae2cbda763", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aded838a-535a-491c-a5f4-94feae65f9aa"}]}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:37.433233 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:37.433907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:37.434511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:37.435360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:37.436609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:37.437223 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:37.638994 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] validate_networks() for [('aded838a-535a-491c-a5f4-94feae65f9aa', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:44:37.709906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:37.718596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:37.720387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:37.721741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ad77f139-97ad-4001-b39f-0ab761fecf11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.307952 Aug 08 08:44:37.722692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 179/381] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:37 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:38.222085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:44:38.222512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:44:38.222990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:44:38.223399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:44:38.223818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:44:38.232872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:38.233397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:38.233832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:38.234561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:38.235012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:38.235437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:38.254841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Getting quotas for project e87616891fa34cd9aca388a5d101f3f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:44:38.258984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Getting quotas for user cd870619247a47ac810fea1aa636ac65 and project e87616891fa34cd9aca388a5d101f3f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:44:38.317612 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:44:38.326679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='377126e8-5e47-40fd-b0ea-29ae2cbda763',volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:44:38.745912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:38.746516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:38.753432 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:38.753922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:38.754358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:38.755146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:38.755614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:38.756042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:38.776826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-382d5b54-f5fd-4dcb-b859-04968a390493 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.349098 Aug 08 08:44:38.777502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 203/382] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:44:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 08:44:38.789517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7835b276-8229-439d-84ad-33b0372da66a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:38.790237 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7835b276-8229-439d-84ad-33b0372da66a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:38.855906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7835b276-8229-439d-84ad-33b0372da66a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:38.863953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7835b276-8229-439d-84ad-33b0372da66a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1094 microversion: 2.1 time: 0.078161 Aug 08 08:44:38.864659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 204/383] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:38 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:38.929363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:38.929363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:38.930795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:38.930795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-46dab7d6-6409-4c9a-8f38-e4823f915dfc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.185736 Aug 08 08:44:38.930795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 180/384] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:38 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:44:39.884337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c5792bcc-6261-44a4-a35a-01dbfc87ba99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:39.884943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c5792bcc-6261-44a4-a35a-01dbfc87ba99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:39.891323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5792bcc-6261-44a4-a35a-01dbfc87ba99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:39.891841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5792bcc-6261-44a4-a35a-01dbfc87ba99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:39.892290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5792bcc-6261-44a4-a35a-01dbfc87ba99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:39.892976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5792bcc-6261-44a4-a35a-01dbfc87ba99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:39.893465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5792bcc-6261-44a4-a35a-01dbfc87ba99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:39.893890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5792bcc-6261-44a4-a35a-01dbfc87ba99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:39.951404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:39.952043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:39.956901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c5792bcc-6261-44a4-a35a-01dbfc87ba99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:39.959426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:39.959916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:39.960353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:39.961049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:39.961544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:39.961967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:39.965072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c5792bcc-6261-44a4-a35a-01dbfc87ba99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1144 microversion: 2.1 time: 0.084655 Aug 08 08:44:39.965686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 205/385] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:39 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:40.090845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:40.099221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:40.100753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:40.101953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bac24372-146d-4f4f-b2b6-74c5a5f61769 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.154588 Aug 08 08:44:40.102544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 181/386] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:39 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:44:40.987045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-001273c3-e2e7-4606-bb20-1a2c50b65f54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:40.987683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-001273c3-e2e7-4606-bb20-1a2c50b65f54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:40.994185 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-001273c3-e2e7-4606-bb20-1a2c50b65f54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:40.994662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-001273c3-e2e7-4606-bb20-1a2c50b65f54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:40.995093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-001273c3-e2e7-4606-bb20-1a2c50b65f54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:40.995772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-001273c3-e2e7-4606-bb20-1a2c50b65f54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:40.996223 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-001273c3-e2e7-4606-bb20-1a2c50b65f54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:40.996643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-001273c3-e2e7-4606-bb20-1a2c50b65f54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:41.055904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-001273c3-e2e7-4606-bb20-1a2c50b65f54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:41.063191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-001273c3-e2e7-4606-bb20-1a2c50b65f54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1144 microversion: 2.1 time: 0.080083 Aug 08 08:44:41.063744 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 206/387] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:40 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:44:41.124747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:41.125383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:41.131875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:41.132348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:41.132781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:41.133494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:41.133947 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:41.134367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:41.263701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:41.273043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:41.274549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:41.275692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a8e29081-0a74-4c73-b600-a08a3a66d5ae tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.154807 Aug 08 08:44:41.276239 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 182/388] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:41 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:42.084086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-99ca4172-4504-41ae-ad59-0a2d3d757ea2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:42.084720 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-99ca4172-4504-41ae-ad59-0a2d3d757ea2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:42.090604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99ca4172-4504-41ae-ad59-0a2d3d757ea2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:42.091085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99ca4172-4504-41ae-ad59-0a2d3d757ea2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:42.091518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99ca4172-4504-41ae-ad59-0a2d3d757ea2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:42.092203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99ca4172-4504-41ae-ad59-0a2d3d757ea2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:42.092750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99ca4172-4504-41ae-ad59-0a2d3d757ea2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:42.093255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99ca4172-4504-41ae-ad59-0a2d3d757ea2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:42.152659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-99ca4172-4504-41ae-ad59-0a2d3d757ea2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:42.159852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-99ca4172-4504-41ae-ad59-0a2d3d757ea2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1144 microversion: 2.1 time: 0.080278 Aug 08 08:44:42.160406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 207/389] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:42 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:42.298228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:42.298871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:42.301213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:42.305843 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:42.306330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:42.306771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:42.307458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:42.307915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:42.308342 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:42.434788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:42.444160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:42.445691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:42.446847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ec21ba68-df11-4d41-bd2b-5273c2f8deb4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.152501 Aug 08 08:44:42.447398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 183/390] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:42 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:44:43.180597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-07199bb3-2d00-45d2-aa54-c63bf179adbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:43.181859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-07199bb3-2d00-45d2-aa54-c63bf179adbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:43.188190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07199bb3-2d00-45d2-aa54-c63bf179adbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:43.192733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07199bb3-2d00-45d2-aa54-c63bf179adbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:43.192733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07199bb3-2d00-45d2-aa54-c63bf179adbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:43.192733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07199bb3-2d00-45d2-aa54-c63bf179adbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:43.192733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07199bb3-2d00-45d2-aa54-c63bf179adbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:43.193102 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07199bb3-2d00-45d2-aa54-c63bf179adbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:43.269486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-07199bb3-2d00-45d2-aa54-c63bf179adbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:43.277790 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-07199bb3-2d00-45d2-aa54-c63bf179adbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1144 microversion: 2.1 time: 0.101520 Aug 08 08:44:43.278445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 208/391] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:43 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1144 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:43.471702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:43.472241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:43.479514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:43.479989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:43.480426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:43.481109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:43.481588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:43.482010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:43.629980 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:43.638783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:43.640340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:43.641591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-02150f8d-2b09-438d-87d0-c1a6473d435c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.174746 Aug 08 08:44:43.642143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 184/392] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:43 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:44.299790 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b6eb9060-0a31-4c80-9bc4-3e00adfdf669 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:44.303236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b6eb9060-0a31-4c80-9bc4-3e00adfdf669 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:44.310573 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6eb9060-0a31-4c80-9bc4-3e00adfdf669 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:44.312093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6eb9060-0a31-4c80-9bc4-3e00adfdf669 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:44.312750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6eb9060-0a31-4c80-9bc4-3e00adfdf669 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:44.313499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6eb9060-0a31-4c80-9bc4-3e00adfdf669 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:44.313998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6eb9060-0a31-4c80-9bc4-3e00adfdf669 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:44.314429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6eb9060-0a31-4c80-9bc4-3e00adfdf669 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:44.397704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b6eb9060-0a31-4c80-9bc4-3e00adfdf669 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:44.405745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b6eb9060-0a31-4c80-9bc4-3e00adfdf669 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1136 microversion: 2.1 time: 0.110012 Aug 08 08:44:44.406339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 209/393] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:44 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1136 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:44.665563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:44.666694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:44.673327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:44.676057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:44.676057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:44.676057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:44.676487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:44.677025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:44.815393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:44.824420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:44.825979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:44.827141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2f5b1240-b6ee-4574-a889-77165106e326 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.166371 Aug 08 08:44:44.827689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 185/394] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:44 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:44:45.428186 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-30179936-56bc-4239-97a7-62c85cb9eae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:45.428659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-30179936-56bc-4239-97a7-62c85cb9eae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:45.434224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30179936-56bc-4239-97a7-62c85cb9eae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:45.434645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30179936-56bc-4239-97a7-62c85cb9eae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:45.435267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30179936-56bc-4239-97a7-62c85cb9eae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:45.435942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30179936-56bc-4239-97a7-62c85cb9eae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:45.436402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30179936-56bc-4239-97a7-62c85cb9eae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:45.436827 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30179936-56bc-4239-97a7-62c85cb9eae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:45.440990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:45.509696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-30179936-56bc-4239-97a7-62c85cb9eae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:45.517591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-30179936-56bc-4239-97a7-62c85cb9eae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1200 microversion: 2.1 time: 0.094380 Aug 08 08:44:45.529174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 210/395] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:45 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1200 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:45.850973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:45.851647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:45.858344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:45.858929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:45.859365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:45.860051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:45.860501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:45.860929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:45.863488 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:46.074576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:46.083521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:46.085067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:46.086202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-55f22d9f-0dca-437a-8c4a-782ee80d7639 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.239810 Aug 08 08:44:46.086751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 186/396] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:45 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:46.540262 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-30e31d09-5d6d-44ba-b80a-36f1e5b205c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:46.540953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-30e31d09-5d6d-44ba-b80a-36f1e5b205c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:46.548445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30e31d09-5d6d-44ba-b80a-36f1e5b205c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:46.549088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30e31d09-5d6d-44ba-b80a-36f1e5b205c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:46.549759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30e31d09-5d6d-44ba-b80a-36f1e5b205c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:46.550466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30e31d09-5d6d-44ba-b80a-36f1e5b205c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:46.550921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30e31d09-5d6d-44ba-b80a-36f1e5b205c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:46.551972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30e31d09-5d6d-44ba-b80a-36f1e5b205c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:46.744017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-30e31d09-5d6d-44ba-b80a-36f1e5b205c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:46.758495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-30e31d09-5d6d-44ba-b80a-36f1e5b205c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1277 microversion: 2.1 time: 0.222444 Aug 08 08:44:46.759088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 211/397] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:46 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:47.109238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:47.109965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:47.117390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:47.117878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:47.118312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:47.119008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:47.119457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:47.119880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:47.434827 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-69faf9aa-e4bc-4562-a014-e9d2fa92d7fc req-d80eea5c-a438-4198-8152-c77a12b51553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa423dc-c608-40ed-a783-faf7a48d13c1", "name": "network-vif-plugged", "status": "completed", "tag": "22c96d99-e75c-4e18-bb06-3b7e1fc4519b"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:47.445752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-69faf9aa-e4bc-4562-a014-e9d2fa92d7fc req-d80eea5c-a438-4198-8152-c77a12b51553 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:47.446637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-69faf9aa-e4bc-4562-a014-e9d2fa92d7fc req-d80eea5c-a438-4198-8152-c77a12b51553 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:47.447341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-69faf9aa-e4bc-4562-a014-e9d2fa92d7fc req-d80eea5c-a438-4198-8152-c77a12b51553 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:47.460824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-69faf9aa-e4bc-4562-a014-e9d2fa92d7fc req-d80eea5c-a438-4198-8152-c77a12b51553 service nova] Creating event network-vif-plugged:22c96d99-e75c-4e18-bb06-3b7e1fc4519b for instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 on hv-cinder-83697 Aug 08 08:44:47.466268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-69faf9aa-e4bc-4562-a014-e9d2fa92d7fc req-d80eea5c-a438-4198-8152-c77a12b51553 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036060 Aug 08 08:44:47.467108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 212/398] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:47.586493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:47.595077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:47.596595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:47.597783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-981e8742-250d-459c-bdc3-24deefc95cb5 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.492630 Aug 08 08:44:47.600496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 187/399] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:47 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:47.780426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8890832a-c4f0-42ab-8cba-e574bc60f53d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:47.781033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8890832a-c4f0-42ab-8cba-e574bc60f53d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:47.787672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8890832a-c4f0-42ab-8cba-e574bc60f53d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:47.788152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8890832a-c4f0-42ab-8cba-e574bc60f53d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:47.788585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8890832a-c4f0-42ab-8cba-e574bc60f53d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:47.789294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8890832a-c4f0-42ab-8cba-e574bc60f53d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:47.789749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8890832a-c4f0-42ab-8cba-e574bc60f53d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:47.790173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8890832a-c4f0-42ab-8cba-e574bc60f53d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:47.816199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-75156ac6-69b9-499f-b428-355245bf1fb2 req-78a86f3d-65d9-4025-a6de-dbc356cdc761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817d5956-5363-4c2c-be67-9c273e9cc34b", "tag": "3165d13a-8b89-4c30-9db1-51f00d58b1b4"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:47.826409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-75156ac6-69b9-499f-b428-355245bf1fb2 req-78a86f3d-65d9-4025-a6de-dbc356cdc761 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:47.827007 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-75156ac6-69b9-499f-b428-355245bf1fb2 req-78a86f3d-65d9-4025-a6de-dbc356cdc761 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:47.827517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-75156ac6-69b9-499f-b428-355245bf1fb2 req-78a86f3d-65d9-4025-a6de-dbc356cdc761 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:47.838967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-75156ac6-69b9-499f-b428-355245bf1fb2 req-78a86f3d-65d9-4025-a6de-dbc356cdc761 service nova] Creating event network-changed:3165d13a-8b89-4c30-9db1-51f00d58b1b4 for instance 817d5956-5363-4c2c-be67-9c273e9cc34b on hv-cinder-83697 Aug 08 08:44:47.844019 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-75156ac6-69b9-499f-b428-355245bf1fb2 req-78a86f3d-65d9-4025-a6de-dbc356cdc761 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031472 Aug 08 08:44:47.844632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 188/400] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:48.012934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8890832a-c4f0-42ab-8cba-e574bc60f53d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:48.018816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f4c9ec80-5ad4-455f-a403-079df7fb9251 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:48.019630 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f4c9ec80-5ad4-455f-a403-079df7fb9251 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:48.021567 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8890832a-c4f0-42ab-8cba-e574bc60f53d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.245311 Aug 08 08:44:48.023862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 213/401] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:47 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:48.028714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4c9ec80-5ad4-455f-a403-079df7fb9251 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:48.028714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4c9ec80-5ad4-455f-a403-079df7fb9251 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:48.028714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4c9ec80-5ad4-455f-a403-079df7fb9251 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:48.028714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4c9ec80-5ad4-455f-a403-079df7fb9251 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:48.029047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4c9ec80-5ad4-455f-a403-079df7fb9251 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:48.029505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4c9ec80-5ad4-455f-a403-079df7fb9251 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:48.062744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f4c9ec80-5ad4-455f-a403-079df7fb9251 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653/ips" status: 200 len: 151 microversion: 2.1 time: 0.048150 Aug 08 08:44:48.063230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 189/402] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 08:44:48 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:48.075064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54c7e29e-bc0e-4575-82b9-9914d2a89a1d"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:48.077402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:48.083323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:48.083812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:48.086111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:48.086111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:48.086111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:48.086111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:48.167085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Invalid volume: volume 54c7e29e-bc0e-4575-82b9-9914d2a89a1d is already attached to instances: fff4ce16-ea8e-4710-accb-cd6e5a31960a Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: POST /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653/os-volume_attachments HTTP/1.1 Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 74 Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:44:48.168895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {"volumeAttachment": {"volumeId": "54c7e29e-bc0e-4575-82b9-9914d2a89a1d"}} Aug 08 08:44:48.173778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Invalid volume: volume 54c7e29e-bc0e-4575-82b9-9914d2a89a1d is already attached to instances: fff4ce16-ea8e-4710-accb-cd6e5a31960a Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'server_id': 'f62f454f-de08-4ed1-b767-cce30f0af653', 'body': {'volumeAttachment': {'volumeId': '54c7e29e-bc0e-4575-82b9-9914d2a89a1d'}}} Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 54c7e29e-bc0e-4575-82b9-9914d2a89a1d is already attached to instances: fff4ce16-ea8e-4710-accb-cd6e5a31960a Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:44:48.174663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 54c7e29e-bc0e-4575-82b9-9914d2a89a1d is already attached to instances: fff4ce16-ea8e-4710-accb-cd6e5a31960a Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:44:48.176103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:44:48.178394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:44:48.178394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:44:48.178394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:44:48.178394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 54c7e29e-bc0e-4575-82b9-9914d2a89a1d is already attached to instances: fff4ce16-ea8e-4710-accb-cd6e5a31960a Aug 08 08:44:48.178394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:44:48.178394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 400 to user: Invalid volume: volume 54c7e29e-bc0e-4575-82b9-9914d2a89a1d is already attached to instances: fff4ce16-ea8e-4710-accb-cd6e5a31960a {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:44:48.178394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9d17283a-e515-41a3-92f0-8ff77da298a3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099376 Aug 08 08:44:48.178394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 214/403] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:44:48 2022] POST /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 08:44:48.182120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0194ce3b-c6e6-4071-a907-edf877a6ce92 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:48.182809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0194ce3b-c6e6-4071-a907-edf877a6ce92 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:48.196895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0194ce3b-c6e6-4071-a907-edf877a6ce92 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:48.196895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0194ce3b-c6e6-4071-a907-edf877a6ce92 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:48.196895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0194ce3b-c6e6-4071-a907-edf877a6ce92 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:48.197247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0194ce3b-c6e6-4071-a907-edf877a6ce92 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:48.197709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0194ce3b-c6e6-4071-a907-edf877a6ce92 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:48.198349 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0194ce3b-c6e6-4071-a907-edf877a6ce92 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:48.225691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0194ce3b-c6e6-4071-a907-edf877a6ce92 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Going to try to terminate instance {{(pid=124673) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:44:48.540930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0194ce3b-c6e6-4071-a907-edf877a6ce92 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 204 len: 0 microversion: 2.1 time: 0.363013 Aug 08 08:44:48.541556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 190/404] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:44:48 2022] DELETE /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:44:48.549803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bcd2e5e1-e92b-45ad-a1a8-9ac23d75e87f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:48.550469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bcd2e5e1-e92b-45ad-a1a8-9ac23d75e87f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:48.552714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:48.558357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcd2e5e1-e92b-45ad-a1a8-9ac23d75e87f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:48.558829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcd2e5e1-e92b-45ad-a1a8-9ac23d75e87f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:48.559511 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcd2e5e1-e92b-45ad-a1a8-9ac23d75e87f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:48.559942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcd2e5e1-e92b-45ad-a1a8-9ac23d75e87f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:48.560395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcd2e5e1-e92b-45ad-a1a8-9ac23d75e87f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:48.560820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcd2e5e1-e92b-45ad-a1a8-9ac23d75e87f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:48.622259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:48.622966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:48.629134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:48.630411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:48.630858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:48.631563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:48.632020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:48.632449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:48.750181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bcd2e5e1-e92b-45ad-a1a8-9ac23d75e87f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:48.759984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bcd2e5e1-e92b-45ad-a1a8-9ac23d75e87f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1683 microversion: 2.1 time: 0.214095 Aug 08 08:44:48.760593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 215/405] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:48 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:48.797061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:48.806368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:48.807899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:48.809098 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5c507762-d8e6-40af-aac7-2b311865070c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.191087 Aug 08 08:44:48.809670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 191/406] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:48 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:44:49.047897 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e419db61-ddb0-4e72-8f2c-19e82b0ec876 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:49.048528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e419db61-ddb0-4e72-8f2c-19e82b0ec876 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:49.050469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=8 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:49.055938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e419db61-ddb0-4e72-8f2c-19e82b0ec876 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:49.056421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e419db61-ddb0-4e72-8f2c-19e82b0ec876 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:49.057318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e419db61-ddb0-4e72-8f2c-19e82b0ec876 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:49.057667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e419db61-ddb0-4e72-8f2c-19e82b0ec876 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:49.058129 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e419db61-ddb0-4e72-8f2c-19e82b0ec876 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:49.058558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e419db61-ddb0-4e72-8f2c-19e82b0ec876 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:49.190239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e419db61-ddb0-4e72-8f2c-19e82b0ec876 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:49.197834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e419db61-ddb0-4e72-8f2c-19e82b0ec876 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.153887 Aug 08 08:44:49.198394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 216/407] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:49 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:49.781619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f83418fc-730c-4d24-b433-4b9fba67cf34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:49.782236 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f83418fc-730c-4d24-b433-4b9fba67cf34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:49.789098 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f83418fc-730c-4d24-b433-4b9fba67cf34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:49.789725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f83418fc-730c-4d24-b433-4b9fba67cf34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:49.790171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f83418fc-730c-4d24-b433-4b9fba67cf34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:49.790873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f83418fc-730c-4d24-b433-4b9fba67cf34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:49.791337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f83418fc-730c-4d24-b433-4b9fba67cf34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:49.791791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f83418fc-730c-4d24-b433-4b9fba67cf34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:49.831806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:49.832487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:49.839093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:49.839715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:49.840147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:49.840838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:49.841318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:49.841746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:49.977061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f83418fc-730c-4d24-b433-4b9fba67cf34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:49.984761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f83418fc-730c-4d24-b433-4b9fba67cf34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1683 microversion: 2.1 time: 0.207209 Aug 08 08:44:49.985354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 192/408] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:49 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1683 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:50.004056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:50.012920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:50.014438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:50.015574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e4bb076e-836f-4519-98b4-12043f3a996c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.187656 Aug 08 08:44:50.016117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 217/409] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:49 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:44:50.218412 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b7652331-076f-4085-b77f-fce4cc61ea36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:50.219022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b7652331-076f-4085-b77f-fce4cc61ea36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:50.225095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7652331-076f-4085-b77f-fce4cc61ea36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:50.225557 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7652331-076f-4085-b77f-fce4cc61ea36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:50.225997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7652331-076f-4085-b77f-fce4cc61ea36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:50.226684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7652331-076f-4085-b77f-fce4cc61ea36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:50.227142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7652331-076f-4085-b77f-fce4cc61ea36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:50.227575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7652331-076f-4085-b77f-fce4cc61ea36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:50.424033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b7652331-076f-4085-b77f-fce4cc61ea36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:50.432208 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b7652331-076f-4085-b77f-fce4cc61ea36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.217868 Aug 08 08:44:50.432765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 193/410] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:50 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:51.005789 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3ba61712-4e1a-4c4a-85ed-8ee71db6e9a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:51.006392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3ba61712-4e1a-4c4a-85ed-8ee71db6e9a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:51.012645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ba61712-4e1a-4c4a-85ed-8ee71db6e9a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:51.013181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ba61712-4e1a-4c4a-85ed-8ee71db6e9a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:51.013633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ba61712-4e1a-4c4a-85ed-8ee71db6e9a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:51.014354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ba61712-4e1a-4c4a-85ed-8ee71db6e9a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:51.014815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ba61712-4e1a-4c4a-85ed-8ee71db6e9a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:51.015246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ba61712-4e1a-4c4a-85ed-8ee71db6e9a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:51.039881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:51.040530 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:51.047631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:51.048356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:51.048795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:51.049525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:51.049983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:51.050409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:51.241657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3ba61712-4e1a-4c4a-85ed-8ee71db6e9a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:51.253017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3ba61712-4e1a-4c4a-85ed-8ee71db6e9a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1683 microversion: 2.1 time: 0.250981 Aug 08 08:44:51.265251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 218/411] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:51 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1683 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:51.270392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:51.279679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:51.280822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:51.282043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8cb85705-bb47-4bb5-866e-31b0b132f798 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.247039 Aug 08 08:44:51.282881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 194/412] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:51 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:44:51.452912 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0afd9a29-fd40-4e27-b499-e4f4782bb93c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:51.454048 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0afd9a29-fd40-4e27-b499-e4f4782bb93c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:51.461456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0afd9a29-fd40-4e27-b499-e4f4782bb93c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:51.467954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0afd9a29-fd40-4e27-b499-e4f4782bb93c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:51.467954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0afd9a29-fd40-4e27-b499-e4f4782bb93c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:51.467954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0afd9a29-fd40-4e27-b499-e4f4782bb93c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:51.467954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0afd9a29-fd40-4e27-b499-e4f4782bb93c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:51.468332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0afd9a29-fd40-4e27-b499-e4f4782bb93c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:51.608761 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0afd9a29-fd40-4e27-b499-e4f4782bb93c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:51.617470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0afd9a29-fd40-4e27-b499-e4f4782bb93c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.168187 Aug 08 08:44:51.618070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 219/413] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:51 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:51.720641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-5a38c162-389b-4a0e-8570-42554c1b38d6 req-fcab1211-a224-424c-b340-c6748d8ac1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62f454f-de08-4ed1-b767-cce30f0af653", "name": "network-vif-deleted", "tag": "bf74583c-a89c-4fe1-8d42-8e25aafa9a58"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:44:51.731323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-5a38c162-389b-4a0e-8570-42554c1b38d6 req-fcab1211-a224-424c-b340-c6748d8ac1d9 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:51.731821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-5a38c162-389b-4a0e-8570-42554c1b38d6 req-fcab1211-a224-424c-b340-c6748d8ac1d9 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:51.732248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-5a38c162-389b-4a0e-8570-42554c1b38d6 req-fcab1211-a224-424c-b340-c6748d8ac1d9 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:51.743682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-5a38c162-389b-4a0e-8570-42554c1b38d6 req-fcab1211-a224-424c-b340-c6748d8ac1d9 service nova] Creating event network-vif-deleted:bf74583c-a89c-4fe1-8d42-8e25aafa9a58 for instance f62f454f-de08-4ed1-b767-cce30f0af653 on hv-cinder-83697 Aug 08 08:44:51.749101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-5a38c162-389b-4a0e-8570-42554c1b38d6 req-fcab1211-a224-424c-b340-c6748d8ac1d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032022 Aug 08 08:44:51.749874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 195/414] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:52.277462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:52.278912 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:52.286905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:52.287542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:52.288255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:52.289238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:52.289811 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:52.290419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:52.306256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:52.314874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:52.314874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:52.314874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:52.314874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:52.315890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:52.316506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:52.317756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:52.327012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:52.327505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:52.328209 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:52.328791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lazy-loading 'fault' on Instance uuid f62f454f-de08-4ed1-b767-cce30f0af653 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:44:52.388779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:52.400606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fb593a25-8918-4c53-b443-195ab031d450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 200 len: 1331 microversion: 2.1 time: 0.126862 Aug 08 08:44:52.401116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 220/415] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:52 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:52.549053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:52.559424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:52.561112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:52.562375 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-97bca075-1cdf-4540-863b-f50398964810 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1807 microversion: 2.20 time: 0.260881 Aug 08 08:44:52.562920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 196/416] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:52 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1807 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:44:52.638483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f72ce6c9-37ff-444b-94e3-4118eed7cbe8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:52.639199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f72ce6c9-37ff-444b-94e3-4118eed7cbe8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:52.646816 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f72ce6c9-37ff-444b-94e3-4118eed7cbe8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:52.647390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f72ce6c9-37ff-444b-94e3-4118eed7cbe8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:52.647896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f72ce6c9-37ff-444b-94e3-4118eed7cbe8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:52.648595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f72ce6c9-37ff-444b-94e3-4118eed7cbe8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:52.649046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f72ce6c9-37ff-444b-94e3-4118eed7cbe8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:52.649526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f72ce6c9-37ff-444b-94e3-4118eed7cbe8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:52.815385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f72ce6c9-37ff-444b-94e3-4118eed7cbe8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:52.825459 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f72ce6c9-37ff-444b-94e3-4118eed7cbe8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.190853 Aug 08 08:44:52.829756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 221/417] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:52 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:53.421735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:53.422348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:53.428969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:53.429509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:53.429945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:53.430632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:53.431083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:53.431534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:53.444884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 HTTP/1.1 Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:44:53.446551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:44:53.448018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': 'f62f454f-de08-4ed1-b767-cce30f0af653'} Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:44:53.448897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:44:53.450311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:44:53.451554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:44:53.451554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-25e6d695-51a7-409b-9105-e5315cdfe2cb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 404 len: 111 microversion: 2.1 time: 0.030026 Aug 08 08:44:53.451554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 197/418] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:53 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:44:53.456832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8110cc16-78a0-44d6-81ad-cf56612f8450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '.version_select at 0x7f4795cc34c0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:53.530522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8110cc16-78a0-44d6-81ad-cf56612f8450 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-149055267" status: 202 len: 0 microversion: 2.1 time: 0.077299 Aug 08 08:44:53.531031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 222/419] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Aug 8 08:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-149055267 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:44:53.589170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:53.589783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:53.606316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:53.606941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:53.607377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:53.608257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:53.608717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:53.609170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:53.772881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:53.786225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:53.786225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:53.786225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-137d6618-d6a0-43dd-a14d-13f7bf1c28d1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1794 microversion: 2.20 time: 0.201778 Aug 08 08:44:53.786565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 198/420] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:44:53 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1794 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:44:53.846554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8b6ab5ca-76c7-4200-b0cb-5471975e07c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:53.849267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8b6ab5ca-76c7-4200-b0cb-5471975e07c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:53.857110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b6ab5ca-76c7-4200-b0cb-5471975e07c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:53.857742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b6ab5ca-76c7-4200-b0cb-5471975e07c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:53.859064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b6ab5ca-76c7-4200-b0cb-5471975e07c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:53.859333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b6ab5ca-76c7-4200-b0cb-5471975e07c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:53.859888 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b6ab5ca-76c7-4200-b0cb-5471975e07c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:53.860459 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b6ab5ca-76c7-4200-b0cb-5471975e07c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:54.123202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8b6ab5ca-76c7-4200-b0cb-5471975e07c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:54.130614 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8b6ab5ca-76c7-4200-b0cb-5471975e07c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.288648 Aug 08 08:44:54.131176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 223/421] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:53 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:54.527753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6d916ec5-be27-4d71-8c88-2e59f61ef6c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:54.528272 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6d916ec5-be27-4d71-8c88-2e59f61ef6c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:54.534553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d916ec5-be27-4d71-8c88-2e59f61ef6c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:54.535028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d916ec5-be27-4d71-8c88-2e59f61ef6c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:54.536190 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d916ec5-be27-4d71-8c88-2e59f61ef6c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:54.536754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d916ec5-be27-4d71-8c88-2e59f61ef6c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:54.537227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d916ec5-be27-4d71-8c88-2e59f61ef6c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:54.537650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d916ec5-be27-4d71-8c88-2e59f61ef6c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:54.661531 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-6d916ec5-be27-4d71-8c88-2e59f61ef6c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lazy-loading 'services' on Instance uuid fff4ce16-ea8e-4710-accb-cd6e5a31960a {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:44:54.894669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6d916ec5-be27-4d71-8c88-2e59f61ef6c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-volume_attachments/54c7e29e-bc0e-4575-82b9-9914d2a89a1d" status: 202 len: 0 microversion: 2.1 time: 0.370492 Aug 08 08:44:54.895670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 199/422] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:44:54 2022] DELETE /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-volume_attachments/54c7e29e-bc0e-4575-82b9-9914d2a89a1d => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:44:54.904173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c9c91071-958a-4ecd-8129-fb1f42c4ddf8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:54.906504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c9c91071-958a-4ecd-8129-fb1f42c4ddf8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:54.913369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9c91071-958a-4ecd-8129-fb1f42c4ddf8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:54.913863 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9c91071-958a-4ecd-8129-fb1f42c4ddf8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:54.914304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9c91071-958a-4ecd-8129-fb1f42c4ddf8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:54.915009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9c91071-958a-4ecd-8129-fb1f42c4ddf8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:54.915469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9c91071-958a-4ecd-8129-fb1f42c4ddf8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:54.915897 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9c91071-958a-4ecd-8129-fb1f42c4ddf8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:54.945004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c9c91071-958a-4ecd-8129-fb1f42c4ddf8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044862 Aug 08 08:44:54.945575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 224/423] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:44:54 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:55.152226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-34d27710-65a1-4656-b5c5-d57fac186e39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:55.152868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-34d27710-65a1-4656-b5c5-d57fac186e39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:55.159221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34d27710-65a1-4656-b5c5-d57fac186e39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:55.159742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34d27710-65a1-4656-b5c5-d57fac186e39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:55.160196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34d27710-65a1-4656-b5c5-d57fac186e39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:55.160895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34d27710-65a1-4656-b5c5-d57fac186e39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:55.161401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34d27710-65a1-4656-b5c5-d57fac186e39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:55.161835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34d27710-65a1-4656-b5c5-d57fac186e39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:55.290143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-34d27710-65a1-4656-b5c5-d57fac186e39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:55.297440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-34d27710-65a1-4656-b5c5-d57fac186e39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.149474 Aug 08 08:44:55.297994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 200/424] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:55 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:55.957696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ae2a2a73-e116-4de4-93fb-a5cc82641cbe tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:55.960542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ae2a2a73-e116-4de4-93fb-a5cc82641cbe tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:55.962491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:55.967329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae2a2a73-e116-4de4-93fb-a5cc82641cbe tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:55.967821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae2a2a73-e116-4de4-93fb-a5cc82641cbe tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:55.968328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae2a2a73-e116-4de4-93fb-a5cc82641cbe tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:55.969055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae2a2a73-e116-4de4-93fb-a5cc82641cbe tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:55.969580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae2a2a73-e116-4de4-93fb-a5cc82641cbe tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:55.970002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae2a2a73-e116-4de4-93fb-a5cc82641cbe tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:56.001967 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ae2a2a73-e116-4de4-93fb-a5cc82641cbe tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048500 Aug 08 08:44:56.002521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 225/425] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:44:55 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:44:56.317912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9b377df3-638a-48d4-a14a-aa95f6eed306 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:56.318442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9b377df3-638a-48d4-a14a-aa95f6eed306 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:56.324377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b377df3-638a-48d4-a14a-aa95f6eed306 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:56.324855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b377df3-638a-48d4-a14a-aa95f6eed306 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:56.325332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b377df3-638a-48d4-a14a-aa95f6eed306 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:56.326016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b377df3-638a-48d4-a14a-aa95f6eed306 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:56.326469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b377df3-638a-48d4-a14a-aa95f6eed306 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:56.326890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b377df3-638a-48d4-a14a-aa95f6eed306 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:56.453702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9b377df3-638a-48d4-a14a-aa95f6eed306 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:56.461623 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9b377df3-638a-48d4-a14a-aa95f6eed306 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.147838 Aug 08 08:44:56.462344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 201/426] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:56 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:57.014909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-18204cdd-ded2-4592-bd14-5d5ecd0298c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:57.017110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-18204cdd-ded2-4592-bd14-5d5ecd0298c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:57.023482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18204cdd-ded2-4592-bd14-5d5ecd0298c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:57.023970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18204cdd-ded2-4592-bd14-5d5ecd0298c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:57.024414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18204cdd-ded2-4592-bd14-5d5ecd0298c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:57.025139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18204cdd-ded2-4592-bd14-5d5ecd0298c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:57.025667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18204cdd-ded2-4592-bd14-5d5ecd0298c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:57.026084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18204cdd-ded2-4592-bd14-5d5ecd0298c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:57.056347 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-18204cdd-ded2-4592-bd14-5d5ecd0298c5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045712 Aug 08 08:44:57.056908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 226/427] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:44:57 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 08:44:57.121560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b059a7cb-d18b-45e1-98be-cf95fda47e75 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:57.122054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b059a7cb-d18b-45e1-98be-cf95fda47e75 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:57.127951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b059a7cb-d18b-45e1-98be-cf95fda47e75 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:57.128426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b059a7cb-d18b-45e1-98be-cf95fda47e75 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:57.128858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b059a7cb-d18b-45e1-98be-cf95fda47e75 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:57.129573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b059a7cb-d18b-45e1-98be-cf95fda47e75 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:57.130027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b059a7cb-d18b-45e1-98be-cf95fda47e75 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:57.130455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b059a7cb-d18b-45e1-98be-cf95fda47e75 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:57.155703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b059a7cb-d18b-45e1-98be-cf95fda47e75 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Going to try to terminate instance {{(pid=124673) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:44:57.158521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:57.409757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b059a7cb-d18b-45e1-98be-cf95fda47e75 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 204 len: 0 microversion: 2.1 time: 0.291644 Aug 08 08:44:57.410662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 202/428] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:44:57 2022] DELETE /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:44:57.418882 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8dbff39a-3df0-41a0-b884-57c4acbb11df tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:57.419587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8dbff39a-3df0-41a0-b884-57c4acbb11df tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:57.425852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8dbff39a-3df0-41a0-b884-57c4acbb11df tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:57.427345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8dbff39a-3df0-41a0-b884-57c4acbb11df tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:57.427954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8dbff39a-3df0-41a0-b884-57c4acbb11df tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:57.428701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8dbff39a-3df0-41a0-b884-57c4acbb11df tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:57.429303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8dbff39a-3df0-41a0-b884-57c4acbb11df tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:57.429624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8dbff39a-3df0-41a0-b884-57c4acbb11df tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:57.482620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-48ea5ceb-764d-419d-9142-2ff492c3e62d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:57.483317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-48ea5ceb-764d-419d-9142-2ff492c3e62d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:57.489339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48ea5ceb-764d-419d-9142-2ff492c3e62d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:57.489819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48ea5ceb-764d-419d-9142-2ff492c3e62d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:57.490411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48ea5ceb-764d-419d-9142-2ff492c3e62d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:57.491099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48ea5ceb-764d-419d-9142-2ff492c3e62d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:57.491548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48ea5ceb-764d-419d-9142-2ff492c3e62d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:57.491966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48ea5ceb-764d-419d-9142-2ff492c3e62d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:57.612711 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8dbff39a-3df0-41a0-b884-57c4acbb11df tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:57.621138 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8dbff39a-3df0-41a0-b884-57c4acbb11df tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1682 microversion: 2.1 time: 0.206199 Aug 08 08:44:57.621750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 227/429] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:57 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:44:57.651225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-48ea5ceb-764d-419d-9142-2ff492c3e62d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:57.658671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-48ea5ceb-764d-419d-9142-2ff492c3e62d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.180581 Aug 08 08:44:57.659219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 203/430] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:57 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:44:58.642756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-647e26b2-71c9-4622-b217-d68721e6f06e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:58.643365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-647e26b2-71c9-4622-b217-d68721e6f06e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:58.649517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-647e26b2-71c9-4622-b217-d68721e6f06e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:58.650005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-647e26b2-71c9-4622-b217-d68721e6f06e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:58.650443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-647e26b2-71c9-4622-b217-d68721e6f06e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:58.651132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-647e26b2-71c9-4622-b217-d68721e6f06e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:58.651589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-647e26b2-71c9-4622-b217-d68721e6f06e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:58.652018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-647e26b2-71c9-4622-b217-d68721e6f06e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:58.655962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:44:58.679374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5c1e3ff2-1f76-407f-b86e-cbe0a5114a3f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:58.679903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5c1e3ff2-1f76-407f-b86e-cbe0a5114a3f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:58.686437 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c1e3ff2-1f76-407f-b86e-cbe0a5114a3f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:58.687092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c1e3ff2-1f76-407f-b86e-cbe0a5114a3f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:58.687685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c1e3ff2-1f76-407f-b86e-cbe0a5114a3f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:58.688388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c1e3ff2-1f76-407f-b86e-cbe0a5114a3f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:58.688839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c1e3ff2-1f76-407f-b86e-cbe0a5114a3f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:58.689292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c1e3ff2-1f76-407f-b86e-cbe0a5114a3f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:58.856794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-647e26b2-71c9-4622-b217-d68721e6f06e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:58.861299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5c1e3ff2-1f76-407f-b86e-cbe0a5114a3f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:44:58.864576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-647e26b2-71c9-4622-b217-d68721e6f06e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1682 microversion: 2.1 time: 0.225737 Aug 08 08:44:58.865206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 228/431] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:58 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:44:58.869497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5c1e3ff2-1f76-407f-b86e-cbe0a5114a3f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.194425 Aug 08 08:44:58.870054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 204/432] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:58 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:44:59.894828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-54938538-30e4-4b68-b647-b2d598df4e10 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:59.895815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5cca9d67-4c03-429b-8183-d10d7bafac3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:44:59.899135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5cca9d67-4c03-429b-8183-d10d7bafac3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:59.902957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-54938538-30e4-4b68-b647-b2d598df4e10 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:44:59.909115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54938538-30e4-4b68-b647-b2d598df4e10 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:59.910090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54938538-30e4-4b68-b647-b2d598df4e10 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:59.910736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54938538-30e4-4b68-b647-b2d598df4e10 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:59.911648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54938538-30e4-4b68-b647-b2d598df4e10 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:59.913083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5cca9d67-4c03-429b-8183-d10d7bafac3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:59.913786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5cca9d67-4c03-429b-8183-d10d7bafac3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:59.914168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54938538-30e4-4b68-b647-b2d598df4e10 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:59.914372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5cca9d67-4c03-429b-8183-d10d7bafac3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:59.914993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54938538-30e4-4b68-b647-b2d598df4e10 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:59.915106 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5cca9d67-4c03-429b-8183-d10d7bafac3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:44:59.915588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5cca9d67-4c03-429b-8183-d10d7bafac3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:44:59.916785 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5cca9d67-4c03-429b-8183-d10d7bafac3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:44:59.998191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-54938538-30e4-4b68-b647-b2d598df4e10 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:00.008690 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-54938538-30e4-4b68-b647-b2d598df4e10 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1614 microversion: 2.1 time: 0.126116 Aug 08 08:45:00.009661 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 229/433] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:59 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1614 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:00.102914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5cca9d67-4c03-429b-8183-d10d7bafac3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:00.111387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5cca9d67-4c03-429b-8183-d10d7bafac3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.224926 Aug 08 08:45:00.112120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 205/434] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:44:59 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:00.182791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-b67173d9-cc68-44a2-9626-411f6a6b1eb7 req-25c2ba34-cbb4-454c-badf-c9156edfebd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff4ce16-ea8e-4710-accb-cd6e5a31960a", "name": "network-vif-deleted", "tag": "0ff18534-8066-4dea-9370-fd1122cb8da2"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:00.192396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-b67173d9-cc68-44a2-9626-411f6a6b1eb7 req-25c2ba34-cbb4-454c-badf-c9156edfebd1 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:00.192870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-b67173d9-cc68-44a2-9626-411f6a6b1eb7 req-25c2ba34-cbb4-454c-badf-c9156edfebd1 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:00.207857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-b67173d9-cc68-44a2-9626-411f6a6b1eb7 req-25c2ba34-cbb4-454c-badf-c9156edfebd1 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:00.207857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-b67173d9-cc68-44a2-9626-411f6a6b1eb7 req-25c2ba34-cbb4-454c-badf-c9156edfebd1 service nova] Creating event network-vif-deleted:0ff18534-8066-4dea-9370-fd1122cb8da2 for instance fff4ce16-ea8e-4710-accb-cd6e5a31960a on hv-cinder-83697 Aug 08 08:45:00.211362 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-b67173d9-cc68-44a2-9626-411f6a6b1eb7 req-25c2ba34-cbb4-454c-badf-c9156edfebd1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032281 Aug 08 08:45:00.211974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 230/435] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:01.030018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:01.030558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:01.038184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:01.038886 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:01.039366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:01.040124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:01.040590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:01.041043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:01.075940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:01.076431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:01.076873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:01.077373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lazy-loading 'fault' on Instance uuid fff4ce16-ea8e-4710-accb-cd6e5a31960a {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:45:01.119689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:01.126697 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2ef0ab5b-a86a-40d3-adb4-e1003aa75ef4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 200 len: 1330 microversion: 2.1 time: 0.100703 Aug 08 08:45:01.137517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 206/436] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:01 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:01.142000 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-162cd168-30ab-4e5f-bc81-ebb3f3d8271b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:01.142731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-162cd168-30ab-4e5f-bc81-ebb3f3d8271b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:01.155695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162cd168-30ab-4e5f-bc81-ebb3f3d8271b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:01.156227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162cd168-30ab-4e5f-bc81-ebb3f3d8271b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:01.156708 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162cd168-30ab-4e5f-bc81-ebb3f3d8271b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:01.157461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162cd168-30ab-4e5f-bc81-ebb3f3d8271b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:01.157917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162cd168-30ab-4e5f-bc81-ebb3f3d8271b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:01.158338 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-162cd168-30ab-4e5f-bc81-ebb3f3d8271b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:01.295210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-162cd168-30ab-4e5f-bc81-ebb3f3d8271b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:01.303686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-162cd168-30ab-4e5f-bc81-ebb3f3d8271b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.174621 Aug 08 08:45:01.304260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 231/437] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:01 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:01.552447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-85f6dada-aace-4c60-9598-13ab832de196 req-88903582-7881-4deb-9291-040f88ee5a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817d5956-5363-4c2c-be67-9c273e9cc34b", "name": "network-vif-plugged", "status": "completed", "tag": "3165d13a-8b89-4c30-9db1-51f00d58b1b4"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:01.558312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-85f6dada-aace-4c60-9598-13ab832de196 req-88903582-7881-4deb-9291-040f88ee5a2e service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:01.558787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-85f6dada-aace-4c60-9598-13ab832de196 req-88903582-7881-4deb-9291-040f88ee5a2e service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:01.559216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-85f6dada-aace-4c60-9598-13ab832de196 req-88903582-7881-4deb-9291-040f88ee5a2e service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:01.569830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-85f6dada-aace-4c60-9598-13ab832de196 req-88903582-7881-4deb-9291-040f88ee5a2e service nova] Creating event network-vif-plugged:3165d13a-8b89-4c30-9db1-51f00d58b1b4 for instance 817d5956-5363-4c2c-be67-9c273e9cc34b on hv-cinder-83697 Aug 08 08:45:01.574840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-85f6dada-aace-4c60-9598-13ab832de196 req-88903582-7881-4deb-9291-040f88ee5a2e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029838 Aug 08 08:45:01.575473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 207/438] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:02.148070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:02.148691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:02.154588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:02.155073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:02.155507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:02.156195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:02.156652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:02.157080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:02.170287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a HTTP/1.1 Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:45:02.171930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:45:02.173460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'fff4ce16-ea8e-4710-accb-cd6e5a31960a'} Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:45:02.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:45:02.175947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:45:02.177960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:45:02.177960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8999652e-c9e3-4515-942a-5e742686f72b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 404 len: 111 microversion: 2.1 time: 0.029229 Aug 08 08:45:02.177960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 232/439] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:02 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:45:02.183564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ede9d760-033b-488b-8828-d10de87c001c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '.version_select at 0x7f4795bb8550>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:02.279199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ede9d760-033b-488b-8828-d10de87c001c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585694645" status: 202 len: 0 microversion: 2.1 time: 0.100160 Aug 08 08:45:02.279695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 208/440] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Aug 8 08:45:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585694645 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:45:02.324530 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-154ddc40-4e1f-4778-8880-1e71d02d8ef1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:02.325193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-154ddc40-4e1f-4778-8880-1e71d02d8ef1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:02.331314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-154ddc40-4e1f-4778-8880-1e71d02d8ef1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:02.331809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-154ddc40-4e1f-4778-8880-1e71d02d8ef1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:02.332246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-154ddc40-4e1f-4778-8880-1e71d02d8ef1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:02.333077 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-154ddc40-4e1f-4778-8880-1e71d02d8ef1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:02.333569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-154ddc40-4e1f-4778-8880-1e71d02d8ef1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:02.334000 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-154ddc40-4e1f-4778-8880-1e71d02d8ef1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:02.475033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-154ddc40-4e1f-4778-8880-1e71d02d8ef1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:02.480073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-154ddc40-4e1f-4778-8880-1e71d02d8ef1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.159431 Aug 08 08:45:02.480639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 233/441] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:02 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:02.493716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6f5d61ae-b952-4f14-8788-898a0094cc02 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:02.494196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6f5d61ae-b952-4f14-8788-898a0094cc02 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:02.501307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f5d61ae-b952-4f14-8788-898a0094cc02 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:02.502054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f5d61ae-b952-4f14-8788-898a0094cc02 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:02.502501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f5d61ae-b952-4f14-8788-898a0094cc02 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:02.503198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f5d61ae-b952-4f14-8788-898a0094cc02 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:02.503657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f5d61ae-b952-4f14-8788-898a0094cc02 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:02.504158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f5d61ae-b952-4f14-8788-898a0094cc02 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:02.587040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-6f5d61ae-b952-4f14-8788-898a0094cc02 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lazy-loading 'services' on Instance uuid 8117a4bb-5bfc-41a1-a874-72c1266a8955 {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:45:02.780716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6f5d61ae-b952-4f14-8788-898a0094cc02 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/os-volume_attachments/172a9f30-3127-45ea-a62c-69ed1d99547b" status: 202 len: 0 microversion: 2.1 time: 0.294648 Aug 08 08:45:02.781714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 209/442] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:45:02 2022] DELETE /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/os-volume_attachments/172a9f30-3127-45ea-a62c-69ed1d99547b => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 08:45:03.020105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2cfc1451-7d31-49ba-b20b-51bda586d53d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: .version_select at 0x7f4795c11550>, body: {"keypair": {"name": "tempest-keypair-1068401885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRFYZh9qHRLKXdPhAMOgwZXNKBeen/J3vuHLWqRb8mwQEym4VlMrWsyk7dMGc956xTaCQSQSaffLJ+LxQxlk2Y5IonEmoq5JY3jH2wwdUX96OlS1dIsQGS7CYg6e0oxwA=="}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:03.035712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-2cfc1451-7d31-49ba-b20b-51bda586d53d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:45:03.041039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-2cfc1451-7d31-49ba-b20b-51bda586d53d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for user 32dcdc2e24e44a07ade44d1da330a77e and project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:45:03.113585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2cfc1451-7d31-49ba-b20b-51bda586d53d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097308 Aug 08 08:45:03.114176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 234/443] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 08:45:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:03.501346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7f502636-5f54-4c01-84b5-566ed1800a78 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:03.502074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7f502636-5f54-4c01-84b5-566ed1800a78 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:03.508632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f502636-5f54-4c01-84b5-566ed1800a78 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:03.509122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f502636-5f54-4c01-84b5-566ed1800a78 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:03.509600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f502636-5f54-4c01-84b5-566ed1800a78 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:03.510337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f502636-5f54-4c01-84b5-566ed1800a78 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:03.510792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f502636-5f54-4c01-84b5-566ed1800a78 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:03.511223 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f502636-5f54-4c01-84b5-566ed1800a78 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:03.659931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7f502636-5f54-4c01-84b5-566ed1800a78 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:03.668181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7f502636-5f54-4c01-84b5-566ed1800a78 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1265 microversion: 2.1 time: 0.171773 Aug 08 08:45:03.668725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 210/444] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:03 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:04.689970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e8d7f7c3-3b2f-4f96-98ed-e253b88ed63c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:04.690508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e8d7f7c3-3b2f-4f96-98ed-e253b88ed63c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:04.697118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8d7f7c3-3b2f-4f96-98ed-e253b88ed63c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:04.697634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8d7f7c3-3b2f-4f96-98ed-e253b88ed63c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:04.698072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8d7f7c3-3b2f-4f96-98ed-e253b88ed63c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:04.698777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8d7f7c3-3b2f-4f96-98ed-e253b88ed63c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:04.699235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8d7f7c3-3b2f-4f96-98ed-e253b88ed63c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:04.699666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8d7f7c3-3b2f-4f96-98ed-e253b88ed63c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:04.837097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e8d7f7c3-3b2f-4f96-98ed-e253b88ed63c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:04.847186 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e8d7f7c3-3b2f-4f96-98ed-e253b88ed63c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1452 microversion: 2.1 time: 0.158921 Aug 08 08:45:04.847186 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 235/445] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:04 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:04.864933 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4caa7bd8-da52-4561-99b9-b544e668cf5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:04.865613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4caa7bd8-da52-4561-99b9-b544e668cf5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:04.871974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4caa7bd8-da52-4561-99b9-b544e668cf5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:04.878111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4caa7bd8-da52-4561-99b9-b544e668cf5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:04.878111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4caa7bd8-da52-4561-99b9-b544e668cf5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:04.878111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4caa7bd8-da52-4561-99b9-b544e668cf5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:04.878111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4caa7bd8-da52-4561-99b9-b544e668cf5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:04.878479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4caa7bd8-da52-4561-99b9-b544e668cf5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:04.970111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c996e586-6e22-4e67-8244-3e59eafe2acc tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:04.976432 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c996e586-6e22-4e67-8244-3e59eafe2acc tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:04.977042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c996e586-6e22-4e67-8244-3e59eafe2acc tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:04.978429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c996e586-6e22-4e67-8244-3e59eafe2acc tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:05.003129 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c996e586-6e22-4e67-8244-3e59eafe2acc tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Going to try to stop instance {{(pid=124672) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 08:45:05.013165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4caa7bd8-da52-4561-99b9-b544e668cf5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:05.023459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4caa7bd8-da52-4561-99b9-b544e668cf5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1452 microversion: 2.1 time: 0.162282 Aug 08 08:45:05.024091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 211/446] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:04 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:05.172552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c996e586-6e22-4e67-8244-3e59eafe2acc tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "POST /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/action" status: 202 len: 0 microversion: 2.1 time: 0.206631 Aug 08 08:45:05.173425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 236/447] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:45:04 2022] POST /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 08:45:05.186555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-853458f9-f4fa-480d-a98e-d6c7c2b562a1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:05.187180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-853458f9-f4fa-480d-a98e-d6c7c2b562a1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:05.195138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-853458f9-f4fa-480d-a98e-d6c7c2b562a1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:05.195646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-853458f9-f4fa-480d-a98e-d6c7c2b562a1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:05.196308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-853458f9-f4fa-480d-a98e-d6c7c2b562a1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:05.197411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-853458f9-f4fa-480d-a98e-d6c7c2b562a1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:05.197969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-853458f9-f4fa-480d-a98e-d6c7c2b562a1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:05.198913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-853458f9-f4fa-480d-a98e-d6c7c2b562a1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:05.344822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-853458f9-f4fa-480d-a98e-d6c7c2b562a1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:05.352523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-853458f9-f4fa-480d-a98e-d6c7c2b562a1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1678 microversion: 2.1 time: 0.175069 Aug 08 08:45:05.353088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 212/448] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:05 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:45:05.445092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-706713363", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fbd2a5d-fa4b-468d-80da-6dad72f31b93"}], "security_groups": [{"name": "tempest-securitygroup--1464945404"}], "key_name": "tempest-keypair-1068401885", "user_data": "}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:05.550338 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] validate_networks() for [('0fbd2a5d-fa4b-468d-80da-6dad72f31b93', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:45:05.924565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:45:05.925178 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:45:05.925485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:45:05.925889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:45:05.926681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:45:05.935802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:05.936287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:05.936719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:05.937470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:05.937925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:05.938385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:05.956128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:45:05.960251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for user 32dcdc2e24e44a07ade44d1da330a77e and project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:45:05.971341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:45:05.974704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:45:06.092970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e03e648d-119b-4779-955a-f564ad152539 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.652939 Aug 08 08:45:06.095293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 237/449] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:45:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:45:06.107881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-857aaf43-8b58-476c-a873-b537ca4e78f9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:06.109196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-857aaf43-8b58-476c-a873-b537ca4e78f9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:06.165595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-857aaf43-8b58-476c-a873-b537ca4e78f9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:06.173125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-857aaf43-8b58-476c-a873-b537ca4e78f9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1241 microversion: 2.1 time: 0.070090 Aug 08 08:45:06.173732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 213/450] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:06 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:06.373754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dbf3b226-b26c-44d7-b827-82320e2a095a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:06.374528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dbf3b226-b26c-44d7-b827-82320e2a095a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:06.381919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbf3b226-b26c-44d7-b827-82320e2a095a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:06.382530 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbf3b226-b26c-44d7-b827-82320e2a095a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:06.383043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbf3b226-b26c-44d7-b827-82320e2a095a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:06.383817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbf3b226-b26c-44d7-b827-82320e2a095a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:06.384353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbf3b226-b26c-44d7-b827-82320e2a095a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:06.384850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbf3b226-b26c-44d7-b827-82320e2a095a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:06.531045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dbf3b226-b26c-44d7-b827-82320e2a095a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:06.541292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dbf3b226-b26c-44d7-b827-82320e2a095a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1678 microversion: 2.1 time: 0.169089 Aug 08 08:45:06.541292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 238/451] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:06 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:07.194186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ff4e37cb-e692-4382-8760-0c1a48929820 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:07.195009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ff4e37cb-e692-4382-8760-0c1a48929820 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:07.202377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4e37cb-e692-4382-8760-0c1a48929820 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:07.203490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4e37cb-e692-4382-8760-0c1a48929820 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:07.203935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4e37cb-e692-4382-8760-0c1a48929820 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:07.204668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4e37cb-e692-4382-8760-0c1a48929820 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:07.205125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4e37cb-e692-4382-8760-0c1a48929820 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:07.205589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4e37cb-e692-4382-8760-0c1a48929820 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:07.266133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ff4e37cb-e692-4382-8760-0c1a48929820 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:07.273628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ff4e37cb-e692-4382-8760-0c1a48929820 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1245 microversion: 2.1 time: 0.083354 Aug 08 08:45:07.274193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 214/452] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:07 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:07.425935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-f084662f-3514-419e-a5d9-ecdd03f58441 req-094dec18-516c-41ce-94d8-9b71bdfcafb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817d5956-5363-4c2c-be67-9c273e9cc34b", "tag": "3165d13a-8b89-4c30-9db1-51f00d58b1b4"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:07.437091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-f084662f-3514-419e-a5d9-ecdd03f58441 req-094dec18-516c-41ce-94d8-9b71bdfcafb9 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:07.437994 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-f084662f-3514-419e-a5d9-ecdd03f58441 req-094dec18-516c-41ce-94d8-9b71bdfcafb9 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:07.438544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-f084662f-3514-419e-a5d9-ecdd03f58441 req-094dec18-516c-41ce-94d8-9b71bdfcafb9 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:07.450918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-f084662f-3514-419e-a5d9-ecdd03f58441 req-094dec18-516c-41ce-94d8-9b71bdfcafb9 service nova] Creating event network-changed:3165d13a-8b89-4c30-9db1-51f00d58b1b4 for instance 817d5956-5363-4c2c-be67-9c273e9cc34b on hv-cinder-83697 Aug 08 08:45:07.456336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-f084662f-3514-419e-a5d9-ecdd03f58441 req-094dec18-516c-41ce-94d8-9b71bdfcafb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039011 Aug 08 08:45:07.457337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 239/453] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:07.560472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ab266e38-f311-41fc-acbb-08b398f509fe tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:07.561296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ab266e38-f311-41fc-acbb-08b398f509fe tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:07.567396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab266e38-f311-41fc-acbb-08b398f509fe tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:07.568145 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab266e38-f311-41fc-acbb-08b398f509fe tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:07.568686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab266e38-f311-41fc-acbb-08b398f509fe tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:07.569527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab266e38-f311-41fc-acbb-08b398f509fe tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:07.570231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab266e38-f311-41fc-acbb-08b398f509fe tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:07.570762 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab266e38-f311-41fc-acbb-08b398f509fe tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:07.704109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ab266e38-f311-41fc-acbb-08b398f509fe tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:07.712210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ab266e38-f311-41fc-acbb-08b398f509fe tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1678 microversion: 2.1 time: 0.156637 Aug 08 08:45:07.712769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 215/454] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:07 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:08.295201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1bf58363-ea74-404c-945f-5471807a8de9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:08.295898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1bf58363-ea74-404c-945f-5471807a8de9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:08.304521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1bf58363-ea74-404c-945f-5471807a8de9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:08.305112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1bf58363-ea74-404c-945f-5471807a8de9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:08.306017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1bf58363-ea74-404c-945f-5471807a8de9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:08.306500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1bf58363-ea74-404c-945f-5471807a8de9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:08.306961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1bf58363-ea74-404c-945f-5471807a8de9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:08.307389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1bf58363-ea74-404c-945f-5471807a8de9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:08.388519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1bf58363-ea74-404c-945f-5471807a8de9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:08.401947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1bf58363-ea74-404c-945f-5471807a8de9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1301 microversion: 2.1 time: 0.111010 Aug 08 08:45:08.402532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 240/455] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:08 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:08.735156 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ce5f929d-07a0-4d55-bc58-80b320ef69bd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:08.735890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ce5f929d-07a0-4d55-bc58-80b320ef69bd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:08.742945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce5f929d-07a0-4d55-bc58-80b320ef69bd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:08.743452 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce5f929d-07a0-4d55-bc58-80b320ef69bd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:08.743931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce5f929d-07a0-4d55-bc58-80b320ef69bd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:08.744639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce5f929d-07a0-4d55-bc58-80b320ef69bd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:08.745102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce5f929d-07a0-4d55-bc58-80b320ef69bd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:08.745562 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce5f929d-07a0-4d55-bc58-80b320ef69bd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:09.149850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ce5f929d-07a0-4d55-bc58-80b320ef69bd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:09.155901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ce5f929d-07a0-4d55-bc58-80b320ef69bd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1678 microversion: 2.1 time: 0.425133 Aug 08 08:45:09.156473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 216/456] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:08 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1678 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:09.423427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-961c5ee4-c2e1-4f69-a58d-cc3d905f2405 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:09.424101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-961c5ee4-c2e1-4f69-a58d-cc3d905f2405 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:09.431293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-961c5ee4-c2e1-4f69-a58d-cc3d905f2405 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:09.431772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-961c5ee4-c2e1-4f69-a58d-cc3d905f2405 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:09.432212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-961c5ee4-c2e1-4f69-a58d-cc3d905f2405 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:09.432916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-961c5ee4-c2e1-4f69-a58d-cc3d905f2405 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:09.433408 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-961c5ee4-c2e1-4f69-a58d-cc3d905f2405 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:09.433839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-961c5ee4-c2e1-4f69-a58d-cc3d905f2405 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:09.675356 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-961c5ee4-c2e1-4f69-a58d-cc3d905f2405 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:09.683271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-961c5ee4-c2e1-4f69-a58d-cc3d905f2405 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1367 microversion: 2.1 time: 0.263691 Aug 08 08:45:09.685457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 241/457] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:09 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:10.177603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2b0b066c-d272-4972-9e05-60d2e9a7ee8d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:10.178314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2b0b066c-d272-4972-9e05-60d2e9a7ee8d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:10.184996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b0b066c-d272-4972-9e05-60d2e9a7ee8d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:10.185508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b0b066c-d272-4972-9e05-60d2e9a7ee8d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:10.185984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b0b066c-d272-4972-9e05-60d2e9a7ee8d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:10.186631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b0b066c-d272-4972-9e05-60d2e9a7ee8d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:10.187081 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b0b066c-d272-4972-9e05-60d2e9a7ee8d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:10.187502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b0b066c-d272-4972-9e05-60d2e9a7ee8d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:10.202542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-5161c526-6e60-49a4-b541-89e7690b87f2 req-ef8bfa4a-02e1-4702-893b-002058e63868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a63eae-e877-4736-8882-261c5d7766b2", "tag": "83650a4d-2742-4f7f-b99b-c9e82946cf55"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:10.213086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-5161c526-6e60-49a4-b541-89e7690b87f2 req-ef8bfa4a-02e1-4702-893b-002058e63868 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:10.214244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-5161c526-6e60-49a4-b541-89e7690b87f2 req-ef8bfa4a-02e1-4702-893b-002058e63868 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:10.218250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-5161c526-6e60-49a4-b541-89e7690b87f2 req-ef8bfa4a-02e1-4702-893b-002058e63868 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:10.227413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-5161c526-6e60-49a4-b541-89e7690b87f2 req-ef8bfa4a-02e1-4702-893b-002058e63868 service nova] Creating event network-changed:83650a4d-2742-4f7f-b99b-c9e82946cf55 for instance 78a63eae-e877-4736-8882-261c5d7766b2 on hv-cinder-83697 Aug 08 08:45:10.233321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-5161c526-6e60-49a4-b541-89e7690b87f2 req-ef8bfa4a-02e1-4702-893b-002058e63868 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035361 Aug 08 08:45:10.234135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 242/458] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:45:10.438963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2b0b066c-d272-4972-9e05-60d2e9a7ee8d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:10.446880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2b0b066c-d272-4972-9e05-60d2e9a7ee8d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1678 microversion: 2.1 time: 0.272985 Aug 08 08:45:10.447454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 217/459] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:10 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1678 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:10.711616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-81b1f48b-0583-4723-83b1-89dfa9dc109d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:10.712309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-81b1f48b-0583-4723-83b1-89dfa9dc109d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:10.718517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81b1f48b-0583-4723-83b1-89dfa9dc109d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:10.719001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81b1f48b-0583-4723-83b1-89dfa9dc109d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:10.719433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81b1f48b-0583-4723-83b1-89dfa9dc109d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:10.720121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81b1f48b-0583-4723-83b1-89dfa9dc109d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:10.720576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81b1f48b-0583-4723-83b1-89dfa9dc109d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:10.721003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81b1f48b-0583-4723-83b1-89dfa9dc109d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:10.935136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-81b1f48b-0583-4723-83b1-89dfa9dc109d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:10.942551 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-81b1f48b-0583-4723-83b1-89dfa9dc109d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1367 microversion: 2.1 time: 0.235946 Aug 08 08:45:10.943666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 243/460] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:10 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:11.467731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1f2edeb6-4898-4b34-bbfa-558de43f134b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:11.468336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1f2edeb6-4898-4b34-bbfa-558de43f134b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:11.475662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f2edeb6-4898-4b34-bbfa-558de43f134b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:11.476143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f2edeb6-4898-4b34-bbfa-558de43f134b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:11.476577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f2edeb6-4898-4b34-bbfa-558de43f134b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:11.477317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f2edeb6-4898-4b34-bbfa-558de43f134b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:11.477773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f2edeb6-4898-4b34-bbfa-558de43f134b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:11.478197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f2edeb6-4898-4b34-bbfa-558de43f134b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:11.605689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1f2edeb6-4898-4b34-bbfa-558de43f134b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:11.612958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1f2edeb6-4898-4b34-bbfa-558de43f134b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1678 microversion: 2.1 time: 0.149058 Aug 08 08:45:11.613545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 218/461] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:11 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:11.969516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ee92683d-a9e8-4806-b4ca-e06a818fc199 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:11.970145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ee92683d-a9e8-4806-b4ca-e06a818fc199 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:11.976218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee92683d-a9e8-4806-b4ca-e06a818fc199 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:11.976696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee92683d-a9e8-4806-b4ca-e06a818fc199 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:11.977127 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee92683d-a9e8-4806-b4ca-e06a818fc199 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:11.977828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee92683d-a9e8-4806-b4ca-e06a818fc199 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:11.978330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee92683d-a9e8-4806-b4ca-e06a818fc199 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:11.978752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee92683d-a9e8-4806-b4ca-e06a818fc199 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:12.105441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ee92683d-a9e8-4806-b4ca-e06a818fc199 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:12.112793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ee92683d-a9e8-4806-b4ca-e06a818fc199 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1367 microversion: 2.1 time: 0.147210 Aug 08 08:45:12.113378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 244/462] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:11 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:12.633850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f82eb60c-bf95-4443-9719-46c80636c965 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:12.634460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f82eb60c-bf95-4443-9719-46c80636c965 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:12.636907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:12.641542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f82eb60c-bf95-4443-9719-46c80636c965 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:12.642028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f82eb60c-bf95-4443-9719-46c80636c965 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:12.642464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f82eb60c-bf95-4443-9719-46c80636c965 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:12.643148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f82eb60c-bf95-4443-9719-46c80636c965 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:12.643603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f82eb60c-bf95-4443-9719-46c80636c965 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:12.644025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f82eb60c-bf95-4443-9719-46c80636c965 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:12.659265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:12.775569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f82eb60c-bf95-4443-9719-46c80636c965 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:12.783396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f82eb60c-bf95-4443-9719-46c80636c965 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1678 microversion: 2.1 time: 0.153423 Aug 08 08:45:12.783961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 219/463] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:12 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:13.135046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7b3e17f5-e80c-4b18-83b5-25a2b1a68d1c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:13.135657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7b3e17f5-e80c-4b18-83b5-25a2b1a68d1c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:13.141649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b3e17f5-e80c-4b18-83b5-25a2b1a68d1c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:13.142128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b3e17f5-e80c-4b18-83b5-25a2b1a68d1c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:13.142558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b3e17f5-e80c-4b18-83b5-25a2b1a68d1c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:13.143239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b3e17f5-e80c-4b18-83b5-25a2b1a68d1c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:13.143692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b3e17f5-e80c-4b18-83b5-25a2b1a68d1c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:13.144112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b3e17f5-e80c-4b18-83b5-25a2b1a68d1c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:13.270951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7b3e17f5-e80c-4b18-83b5-25a2b1a68d1c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:13.279134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7b3e17f5-e80c-4b18-83b5-25a2b1a68d1c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1367 microversion: 2.1 time: 0.148673 Aug 08 08:45:13.279691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 245/464] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:13 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:13.805325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4e255c7d-42b4-4662-8dd0-80b80460aebb tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:13.805851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4e255c7d-42b4-4662-8dd0-80b80460aebb tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:13.812601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e255c7d-42b4-4662-8dd0-80b80460aebb tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:13.813088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e255c7d-42b4-4662-8dd0-80b80460aebb tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:13.813544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e255c7d-42b4-4662-8dd0-80b80460aebb tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:13.814231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e255c7d-42b4-4662-8dd0-80b80460aebb tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:13.814682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e255c7d-42b4-4662-8dd0-80b80460aebb tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:13.815104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e255c7d-42b4-4662-8dd0-80b80460aebb tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:13.946539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4e255c7d-42b4-4662-8dd0-80b80460aebb tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:13.954374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4e255c7d-42b4-4662-8dd0-80b80460aebb tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1678 microversion: 2.1 time: 0.153869 Aug 08 08:45:13.954945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 220/465] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:13 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:14.298940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3297a838-4216-4181-bcdd-0c9240f2b611 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:14.299549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3297a838-4216-4181-bcdd-0c9240f2b611 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:14.305880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3297a838-4216-4181-bcdd-0c9240f2b611 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:14.311919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3297a838-4216-4181-bcdd-0c9240f2b611 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:14.311919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3297a838-4216-4181-bcdd-0c9240f2b611 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:14.311919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3297a838-4216-4181-bcdd-0c9240f2b611 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:14.311919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3297a838-4216-4181-bcdd-0c9240f2b611 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:14.312268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3297a838-4216-4181-bcdd-0c9240f2b611 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:14.437736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3297a838-4216-4181-bcdd-0c9240f2b611 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:14.445094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3297a838-4216-4181-bcdd-0c9240f2b611 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1367 microversion: 2.1 time: 0.150168 Aug 08 08:45:14.445677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 246/466] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:14 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:14.976185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-29461caf-0b99-4ca0-b0f0-fd5683a8326d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:14.976818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-29461caf-0b99-4ca0-b0f0-fd5683a8326d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:14.983418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29461caf-0b99-4ca0-b0f0-fd5683a8326d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:14.983907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29461caf-0b99-4ca0-b0f0-fd5683a8326d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:14.984348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29461caf-0b99-4ca0-b0f0-fd5683a8326d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:14.985036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29461caf-0b99-4ca0-b0f0-fd5683a8326d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:14.985536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29461caf-0b99-4ca0-b0f0-fd5683a8326d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:14.985962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29461caf-0b99-4ca0-b0f0-fd5683a8326d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:15.116108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-29461caf-0b99-4ca0-b0f0-fd5683a8326d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:15.123536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-29461caf-0b99-4ca0-b0f0-fd5683a8326d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1678 microversion: 2.1 time: 0.151345 Aug 08 08:45:15.124099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 221/467] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:14 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:15.465407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ad9546f9-78ef-487e-ba0c-3d3cad598321 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:15.466048 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ad9546f9-78ef-487e-ba0c-3d3cad598321 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:15.472018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad9546f9-78ef-487e-ba0c-3d3cad598321 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:15.472506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad9546f9-78ef-487e-ba0c-3d3cad598321 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:15.472947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad9546f9-78ef-487e-ba0c-3d3cad598321 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:15.473669 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad9546f9-78ef-487e-ba0c-3d3cad598321 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:15.474620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad9546f9-78ef-487e-ba0c-3d3cad598321 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:15.475051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad9546f9-78ef-487e-ba0c-3d3cad598321 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:15.594055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-6374e035-278e-46dc-88b0-1656568f9b5a req-2ca31b65-dffe-47ef-9265-e0f0d63e6e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a63eae-e877-4736-8882-261c5d7766b2", "name": "network-vif-plugged", "status": "completed", "tag": "83650a4d-2742-4f7f-b99b-c9e82946cf55"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:15.606151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-6374e035-278e-46dc-88b0-1656568f9b5a req-2ca31b65-dffe-47ef-9265-e0f0d63e6e9c service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:15.606631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-6374e035-278e-46dc-88b0-1656568f9b5a req-2ca31b65-dffe-47ef-9265-e0f0d63e6e9c service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:15.607059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-6374e035-278e-46dc-88b0-1656568f9b5a req-2ca31b65-dffe-47ef-9265-e0f0d63e6e9c service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:15.613561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ad9546f9-78ef-487e-ba0c-3d3cad598321 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:15.618918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-6374e035-278e-46dc-88b0-1656568f9b5a req-2ca31b65-dffe-47ef-9265-e0f0d63e6e9c service nova] Creating event network-vif-plugged:83650a4d-2742-4f7f-b99b-c9e82946cf55 for instance 78a63eae-e877-4736-8882-261c5d7766b2 on hv-cinder-83697 Aug 08 08:45:15.621404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ad9546f9-78ef-487e-ba0c-3d3cad598321 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1367 microversion: 2.1 time: 0.159775 Aug 08 08:45:15.622077 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 247/468] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:15 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:15.624177 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-6374e035-278e-46dc-88b0-1656568f9b5a req-2ca31b65-dffe-47ef-9265-e0f0d63e6e9c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035138 Aug 08 08:45:15.624878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 222/469] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:16.144021 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-739fa552-c9ca-4b0e-b270-3271e7ae3a26 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:16.144632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-739fa552-c9ca-4b0e-b270-3271e7ae3a26 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:16.147254 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:16.147940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=10 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:16.152662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-739fa552-c9ca-4b0e-b270-3271e7ae3a26 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:16.153171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-739fa552-c9ca-4b0e-b270-3271e7ae3a26 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:16.153627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-739fa552-c9ca-4b0e-b270-3271e7ae3a26 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:16.154318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-739fa552-c9ca-4b0e-b270-3271e7ae3a26 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:16.154774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-739fa552-c9ca-4b0e-b270-3271e7ae3a26 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:16.155201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-739fa552-c9ca-4b0e-b270-3271e7ae3a26 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:16.162545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:16.288885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-739fa552-c9ca-4b0e-b270-3271e7ae3a26 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:16.296284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-739fa552-c9ca-4b0e-b270-3271e7ae3a26 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1655 microversion: 2.1 time: 0.156149 Aug 08 08:45:16.296845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 248/470] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:16 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:16.316593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-011d1ac1-5a59-42c4-9940-d33c67b93007 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:16.319649 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:16.324623 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-011d1ac1-5a59-42c4-9940-d33c67b93007 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:16.325110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-011d1ac1-5a59-42c4-9940-d33c67b93007 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:16.325592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-011d1ac1-5a59-42c4-9940-d33c67b93007 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:16.347893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-011d1ac1-5a59-42c4-9940-d33c67b93007 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Going to try to start instance {{(pid=124673) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 08:45:16.497871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-011d1ac1-5a59-42c4-9940-d33c67b93007 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "POST /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/action" status: 202 len: 0 microversion: 2.1 time: 0.185069 Aug 08 08:45:16.498463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 223/471] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:45:16 2022] POST /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:45:16.507460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4f9c4c4e-c1e4-4814-b802-db10b6d72643 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:16.508216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4f9c4c4e-c1e4-4814-b802-db10b6d72643 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:16.514580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f9c4c4e-c1e4-4814-b802-db10b6d72643 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:16.515065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f9c4c4e-c1e4-4814-b802-db10b6d72643 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:16.515510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f9c4c4e-c1e4-4814-b802-db10b6d72643 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:16.516200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f9c4c4e-c1e4-4814-b802-db10b6d72643 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:16.516657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f9c4c4e-c1e4-4814-b802-db10b6d72643 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:16.517085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f9c4c4e-c1e4-4814-b802-db10b6d72643 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:16.642956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-770cc33a-db89-4a43-8743-436431b92fe3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:16.643582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-770cc33a-db89-4a43-8743-436431b92fe3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:16.645832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4f9c4c4e-c1e4-4814-b802-db10b6d72643 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:16.649910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770cc33a-db89-4a43-8743-436431b92fe3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:16.650508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770cc33a-db89-4a43-8743-436431b92fe3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:16.650949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770cc33a-db89-4a43-8743-436431b92fe3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:16.651638 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770cc33a-db89-4a43-8743-436431b92fe3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:16.652089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770cc33a-db89-4a43-8743-436431b92fe3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:16.652616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-770cc33a-db89-4a43-8743-436431b92fe3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:16.653534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4f9c4c4e-c1e4-4814-b802-db10b6d72643 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1664 microversion: 2.1 time: 0.150829 Aug 08 08:45:16.654097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 249/472] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:16 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:16.786833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-770cc33a-db89-4a43-8743-436431b92fe3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:16.794979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-770cc33a-db89-4a43-8743-436431b92fe3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1367 microversion: 2.1 time: 0.156419 Aug 08 08:45:16.795536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 224/473] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:16 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:17.674438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-354d1331-6997-46f9-9a04-dec8630c68ff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:17.675053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-354d1331-6997-46f9-9a04-dec8630c68ff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:17.680963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-354d1331-6997-46f9-9a04-dec8630c68ff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:17.681558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-354d1331-6997-46f9-9a04-dec8630c68ff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:17.682003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-354d1331-6997-46f9-9a04-dec8630c68ff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:17.682697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-354d1331-6997-46f9-9a04-dec8630c68ff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:17.683166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-354d1331-6997-46f9-9a04-dec8630c68ff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:17.683593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-354d1331-6997-46f9-9a04-dec8630c68ff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:17.817247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d8d4911d-12bc-4381-b0a9-3ad692038a89 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:17.817860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d8d4911d-12bc-4381-b0a9-3ad692038a89 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:17.825162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d4911d-12bc-4381-b0a9-3ad692038a89 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:17.825651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d4911d-12bc-4381-b0a9-3ad692038a89 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:17.826084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d4911d-12bc-4381-b0a9-3ad692038a89 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:17.826771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d4911d-12bc-4381-b0a9-3ad692038a89 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:17.827223 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d4911d-12bc-4381-b0a9-3ad692038a89 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:17.828018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d4911d-12bc-4381-b0a9-3ad692038a89 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:17.919886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-354d1331-6997-46f9-9a04-dec8630c68ff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:17.927668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-354d1331-6997-46f9-9a04-dec8630c68ff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1664 microversion: 2.1 time: 0.257120 Aug 08 08:45:17.928238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 250/474] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:17 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1664 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:18.076083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d8d4911d-12bc-4381-b0a9-3ad692038a89 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:18.083543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d8d4911d-12bc-4381-b0a9-3ad692038a89 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1367 microversion: 2.1 time: 0.270185 Aug 08 08:45:18.084193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 225/475] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:17 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:45:18.949734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9e4604d7-6458-4863-a090-fb2900d26c8f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:18.950398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9e4604d7-6458-4863-a090-fb2900d26c8f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:18.956385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e4604d7-6458-4863-a090-fb2900d26c8f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:18.957379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e4604d7-6458-4863-a090-fb2900d26c8f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:18.957379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e4604d7-6458-4863-a090-fb2900d26c8f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:18.958143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e4604d7-6458-4863-a090-fb2900d26c8f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:18.958605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e4604d7-6458-4863-a090-fb2900d26c8f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:18.959029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e4604d7-6458-4863-a090-fb2900d26c8f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:19.085054 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9e4604d7-6458-4863-a090-fb2900d26c8f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:19.092830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9e4604d7-6458-4863-a090-fb2900d26c8f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1668 microversion: 2.1 time: 0.147001 Aug 08 08:45:19.097893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 251/476] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:18 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:19.109688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8e157eec-351c-4e6d-8f4d-2e17251cb805 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:19.111989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8e157eec-351c-4e6d-8f4d-2e17251cb805 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:19.117418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e157eec-351c-4e6d-8f4d-2e17251cb805 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:19.117902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e157eec-351c-4e6d-8f4d-2e17251cb805 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:19.118331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e157eec-351c-4e6d-8f4d-2e17251cb805 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:19.119017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e157eec-351c-4e6d-8f4d-2e17251cb805 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:19.119470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e157eec-351c-4e6d-8f4d-2e17251cb805 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:19.119890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e157eec-351c-4e6d-8f4d-2e17251cb805 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:19.247628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8e157eec-351c-4e6d-8f4d-2e17251cb805 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:19.255161 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8e157eec-351c-4e6d-8f4d-2e17251cb805 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1558 microversion: 2.1 time: 0.149403 Aug 08 08:45:19.255713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 226/477] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:19 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:19.274844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-93873bd3-0e6c-4a5d-a807-3902334a71bb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:19.275342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-93873bd3-0e6c-4a5d-a807-3902334a71bb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:19.281188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93873bd3-0e6c-4a5d-a807-3902334a71bb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:19.281679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93873bd3-0e6c-4a5d-a807-3902334a71bb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:19.282118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93873bd3-0e6c-4a5d-a807-3902334a71bb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:19.282807 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93873bd3-0e6c-4a5d-a807-3902334a71bb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:19.283264 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93873bd3-0e6c-4a5d-a807-3902334a71bb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:19.283689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93873bd3-0e6c-4a5d-a807-3902334a71bb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:19.362550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-93873bd3-0e6c-4a5d-a807-3902334a71bb tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091678 Aug 08 08:45:19.363139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 252/478] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 08:45:19 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:20.327160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-5e0dce1c-dadf-41bb-b9d0-73fdd66ce55c req-497d18f9-af65-478a-afc5-810204170c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a63eae-e877-4736-8882-261c5d7766b2", "tag": "83650a4d-2742-4f7f-b99b-c9e82946cf55"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:20.336826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-5e0dce1c-dadf-41bb-b9d0-73fdd66ce55c req-497d18f9-af65-478a-afc5-810204170c56 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:20.337413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-5e0dce1c-dadf-41bb-b9d0-73fdd66ce55c req-497d18f9-af65-478a-afc5-810204170c56 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:20.337839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-5e0dce1c-dadf-41bb-b9d0-73fdd66ce55c req-497d18f9-af65-478a-afc5-810204170c56 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:20.348357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-5e0dce1c-dadf-41bb-b9d0-73fdd66ce55c req-497d18f9-af65-478a-afc5-810204170c56 service nova] Creating event network-changed:83650a4d-2742-4f7f-b99b-c9e82946cf55 for instance 78a63eae-e877-4736-8882-261c5d7766b2 on hv-cinder-83697 Aug 08 08:45:20.353115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-5e0dce1c-dadf-41bb-b9d0-73fdd66ce55c req-497d18f9-af65-478a-afc5-810204170c56 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029608 Aug 08 08:45:20.353799 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 227/479] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:20.659582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-501b23af-a810-4aa5-b87d-08d713a3a81d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3fdeb34-2b6b-4c84-9d0e-dca12a809a09"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:20.661950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-501b23af-a810-4aa5-b87d-08d713a3a81d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:20.668643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-501b23af-a810-4aa5-b87d-08d713a3a81d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:20.669156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-501b23af-a810-4aa5-b87d-08d713a3a81d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:20.677981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-501b23af-a810-4aa5-b87d-08d713a3a81d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:20.677981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-501b23af-a810-4aa5-b87d-08d713a3a81d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:20.677981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-501b23af-a810-4aa5-b87d-08d713a3a81d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:20.677981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-501b23af-a810-4aa5-b87d-08d713a3a81d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:21.374018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-501b23af-a810-4aa5-b87d-08d713a3a81d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "POST /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.718218 Aug 08 08:45:21.375176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 253/480] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:45:20 2022] POST /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:28.897640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-51803c61-b85a-472c-9870-e7c37e403d07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:28.900078 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-51803c61-b85a-472c-9870-e7c37e403d07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:28.906118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51803c61-b85a-472c-9870-e7c37e403d07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:28.906598 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51803c61-b85a-472c-9870-e7c37e403d07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:28.907032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51803c61-b85a-472c-9870-e7c37e403d07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:28.907710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51803c61-b85a-472c-9870-e7c37e403d07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:28.908162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51803c61-b85a-472c-9870-e7c37e403d07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:28.908583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51803c61-b85a-472c-9870-e7c37e403d07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:28.934179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-51803c61-b85a-472c-9870-e7c37e403d07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lazy-loading 'flavor' on Instance uuid 79aff6d2-7210-4da9-8624-b1fa9f66350a {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:45:29.253319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-51803c61-b85a-472c-9870-e7c37e403d07 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "POST /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/action" status: 200 len: 32 microversion: 2.1 time: 0.361208 Aug 08 08:45:29.254091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 228/481] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:45:28 2022] POST /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 08:45:29.264806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-32eab8f7-c1b3-4f8f-8381-5d445051b590 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:29.265702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-32eab8f7-c1b3-4f8f-8381-5d445051b590 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:29.268633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:29.273429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32eab8f7-c1b3-4f8f-8381-5d445051b590 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:29.273915 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32eab8f7-c1b3-4f8f-8381-5d445051b590 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:29.274373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32eab8f7-c1b3-4f8f-8381-5d445051b590 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:29.275067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32eab8f7-c1b3-4f8f-8381-5d445051b590 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:29.275607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32eab8f7-c1b3-4f8f-8381-5d445051b590 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:29.276033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32eab8f7-c1b3-4f8f-8381-5d445051b590 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:29.496749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-32eab8f7-c1b3-4f8f-8381-5d445051b590 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:29.504786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-32eab8f7-c1b3-4f8f-8381-5d445051b590 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.244176 Aug 08 08:45:29.505666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 254/482] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:29 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:30.526346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a7982f2b-cc04-4c93-928a-2c217fe6176d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:30.527038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a7982f2b-cc04-4c93-928a-2c217fe6176d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:30.534296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7982f2b-cc04-4c93-928a-2c217fe6176d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:30.534776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7982f2b-cc04-4c93-928a-2c217fe6176d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:30.535209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7982f2b-cc04-4c93-928a-2c217fe6176d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:30.535901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7982f2b-cc04-4c93-928a-2c217fe6176d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:30.536351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7982f2b-cc04-4c93-928a-2c217fe6176d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:30.536775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7982f2b-cc04-4c93-928a-2c217fe6176d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:30.661678 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a7982f2b-cc04-4c93-928a-2c217fe6176d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:30.670152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a7982f2b-cc04-4c93-928a-2c217fe6176d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.148230 Aug 08 08:45:30.670702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 229/483] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:30 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:31.690369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-48756cec-dadf-4c63-b4c0-755e239ca7da tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:31.690906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-48756cec-dadf-4c63-b4c0-755e239ca7da tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:31.697774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48756cec-dadf-4c63-b4c0-755e239ca7da tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:31.698255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48756cec-dadf-4c63-b4c0-755e239ca7da tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:31.698691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48756cec-dadf-4c63-b4c0-755e239ca7da tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:31.699371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48756cec-dadf-4c63-b4c0-755e239ca7da tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:31.699820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48756cec-dadf-4c63-b4c0-755e239ca7da tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:31.700243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48756cec-dadf-4c63-b4c0-755e239ca7da tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:31.831226 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-48756cec-dadf-4c63-b4c0-755e239ca7da tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:31.839829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-48756cec-dadf-4c63-b4c0-755e239ca7da tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.153332 Aug 08 08:45:31.840399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 255/484] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:31 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:32.861377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3e94150d-e09a-4ed5-957f-3a78e16af22f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:32.861935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3e94150d-e09a-4ed5-957f-3a78e16af22f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:32.868417 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e94150d-e09a-4ed5-957f-3a78e16af22f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:32.868893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e94150d-e09a-4ed5-957f-3a78e16af22f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:32.869353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e94150d-e09a-4ed5-957f-3a78e16af22f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:32.870029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e94150d-e09a-4ed5-957f-3a78e16af22f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:32.870506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e94150d-e09a-4ed5-957f-3a78e16af22f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:32.870923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e94150d-e09a-4ed5-957f-3a78e16af22f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:32.997454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3e94150d-e09a-4ed5-957f-3a78e16af22f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:33.005266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3e94150d-e09a-4ed5-957f-3a78e16af22f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.147825 Aug 08 08:45:33.005991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 230/485] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:32 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:34.026718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0db9664c-19f8-4286-a48a-c1f6e8e748b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:34.027333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0db9664c-19f8-4286-a48a-c1f6e8e748b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:34.033800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0db9664c-19f8-4286-a48a-c1f6e8e748b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:34.034291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0db9664c-19f8-4286-a48a-c1f6e8e748b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:34.034737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0db9664c-19f8-4286-a48a-c1f6e8e748b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:34.035456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0db9664c-19f8-4286-a48a-c1f6e8e748b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:34.035919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0db9664c-19f8-4286-a48a-c1f6e8e748b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:34.036347 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0db9664c-19f8-4286-a48a-c1f6e8e748b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:34.168892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0db9664c-19f8-4286-a48a-c1f6e8e748b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:34.176788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0db9664c-19f8-4286-a48a-c1f6e8e748b3 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.153977 Aug 08 08:45:34.177386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 256/486] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:34 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:35.198481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-700e9b86-ce68-4b46-8a4a-196e77ab9ed8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:35.199112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-700e9b86-ce68-4b46-8a4a-196e77ab9ed8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:35.205582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-700e9b86-ce68-4b46-8a4a-196e77ab9ed8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:35.206067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-700e9b86-ce68-4b46-8a4a-196e77ab9ed8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:35.206504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-700e9b86-ce68-4b46-8a4a-196e77ab9ed8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:35.207193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-700e9b86-ce68-4b46-8a4a-196e77ab9ed8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:35.207674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-700e9b86-ce68-4b46-8a4a-196e77ab9ed8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:35.208098 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-700e9b86-ce68-4b46-8a4a-196e77ab9ed8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:35.334509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-700e9b86-ce68-4b46-8a4a-196e77ab9ed8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:35.342389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-700e9b86-ce68-4b46-8a4a-196e77ab9ed8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.147767 Aug 08 08:45:35.342945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 231/487] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:35 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:36.246980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fdf48708-9000-4ddb-ae39-519a6e05eadb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:36.247565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fdf48708-9000-4ddb-ae39-519a6e05eadb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:36.253933 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fdf48708-9000-4ddb-ae39-519a6e05eadb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:36.258785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fdf48708-9000-4ddb-ae39-519a6e05eadb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:36.258785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fdf48708-9000-4ddb-ae39-519a6e05eadb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:36.258785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fdf48708-9000-4ddb-ae39-519a6e05eadb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:36.258785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fdf48708-9000-4ddb-ae39-519a6e05eadb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:36.259162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fdf48708-9000-4ddb-ae39-519a6e05eadb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:36.287738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fdf48708-9000-4ddb-ae39-519a6e05eadb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments/855bfe0f-64e4-4048-a273-f7f8fcbe41b0" status: 200 len: 194 microversion: 2.20 time: 0.044769 Aug 08 08:45:36.288313 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 257/488] 10.222.0.33 () {60 vars in 1454 bytes} [Mon Aug 8 08:45:36 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments/855bfe0f-64e4-4048-a273-f7f8fcbe41b0 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:45:36.355124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c9fbe5c0-c689-4ce3-a273-ba8a6f9e71ba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:36.355624 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c9fbe5c0-c689-4ce3-a273-ba8a6f9e71ba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:36.361932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5c0-c689-4ce3-a273-ba8a6f9e71ba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:36.362414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5c0-c689-4ce3-a273-ba8a6f9e71ba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:36.362855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5c0-c689-4ce3-a273-ba8a6f9e71ba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:36.363204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d18a8c16-8578-4ae3-a564-e90176eb36ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:36.363542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5c0-c689-4ce3-a273-ba8a6f9e71ba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:36.363823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d18a8c16-8578-4ae3-a564-e90176eb36ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:36.363999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5c0-c689-4ce3-a273-ba8a6f9e71ba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:36.364428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9fbe5c0-c689-4ce3-a273-ba8a6f9e71ba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:36.369797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d18a8c16-8578-4ae3-a564-e90176eb36ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:36.370279 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d18a8c16-8578-4ae3-a564-e90176eb36ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:36.370709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d18a8c16-8578-4ae3-a564-e90176eb36ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:36.371394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d18a8c16-8578-4ae3-a564-e90176eb36ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:36.371847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d18a8c16-8578-4ae3-a564-e90176eb36ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:36.372267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d18a8c16-8578-4ae3-a564-e90176eb36ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:36.449747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-c9fbe5c0-c689-4ce3-a273-ba8a6f9e71ba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lazy-loading 'services' on Instance uuid 9aa423dc-c608-40ed-a783-faf7a48d13c1 {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:45:36.504512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d18a8c16-8578-4ae3-a564-e90176eb36ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:36.513259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d18a8c16-8578-4ae3-a564-e90176eb36ac tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.153861 Aug 08 08:45:36.513812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 258/489] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:36 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:45:36.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c9fbe5c0-c689-4ce3-a273-ba8a6f9e71ba tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments/855bfe0f-64e4-4048-a273-f7f8fcbe41b0" status: 202 len: 0 microversion: 2.20 time: 0.269202 Aug 08 08:45:36.620880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 232/490] 10.222.0.33 () {60 vars in 1457 bytes} [Mon Aug 8 08:45:36 2022] DELETE /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments/855bfe0f-64e4-4048-a273-f7f8fcbe41b0 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:45:36.629273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d5a5dbcc-0c68-4fa8-a421-a60929ddddeb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:36.635148 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d5a5dbcc-0c68-4fa8-a421-a60929ddddeb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:36.637762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5a5dbcc-0c68-4fa8-a421-a60929ddddeb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:36.638246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5a5dbcc-0c68-4fa8-a421-a60929ddddeb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:36.638679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5a5dbcc-0c68-4fa8-a421-a60929ddddeb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:36.639457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5a5dbcc-0c68-4fa8-a421-a60929ddddeb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:36.639914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5a5dbcc-0c68-4fa8-a421-a60929ddddeb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:36.640339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5a5dbcc-0c68-4fa8-a421-a60929ddddeb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:36.669975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d5a5dbcc-0c68-4fa8-a421-a60929ddddeb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044725 Aug 08 08:45:36.670509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 259/491] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Aug 8 08:45:36 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 08:45:37.534170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9e934360-3da2-43e3-af44-b938fc690e35 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:37.534869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9e934360-3da2-43e3-af44-b938fc690e35 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:37.541985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e934360-3da2-43e3-af44-b938fc690e35 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:37.542472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e934360-3da2-43e3-af44-b938fc690e35 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:37.542910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e934360-3da2-43e3-af44-b938fc690e35 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:37.543604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e934360-3da2-43e3-af44-b938fc690e35 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:37.544058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e934360-3da2-43e3-af44-b938fc690e35 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:37.544486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e934360-3da2-43e3-af44-b938fc690e35 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:37.675771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9e934360-3da2-43e3-af44-b938fc690e35 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:37.678268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:37.682580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a6320006-5c1e-40ac-b2ad-c96a50eb1a11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:37.684754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9e934360-3da2-43e3-af44-b938fc690e35 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.154697 Aug 08 08:45:37.684875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a6320006-5c1e-40ac-b2ad-c96a50eb1a11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:37.685440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 233/492] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:37 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:37.690859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6320006-5c1e-40ac-b2ad-c96a50eb1a11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:37.691348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6320006-5c1e-40ac-b2ad-c96a50eb1a11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:37.691787 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6320006-5c1e-40ac-b2ad-c96a50eb1a11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:37.692609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6320006-5c1e-40ac-b2ad-c96a50eb1a11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:37.693067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6320006-5c1e-40ac-b2ad-c96a50eb1a11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:37.693521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6320006-5c1e-40ac-b2ad-c96a50eb1a11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:37.722870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a6320006-5c1e-40ac-b2ad-c96a50eb1a11 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044331 Aug 08 08:45:37.723418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 260/493] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Aug 8 08:45:37 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 08:45:38.706763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-effb8a12-666c-48e5-9e71-e228e71e2e91 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:38.707385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-effb8a12-666c-48e5-9e71-e228e71e2e91 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:38.714938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-effb8a12-666c-48e5-9e71-e228e71e2e91 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:38.715419 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-effb8a12-666c-48e5-9e71-e228e71e2e91 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:38.715854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-effb8a12-666c-48e5-9e71-e228e71e2e91 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:38.716549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-effb8a12-666c-48e5-9e71-e228e71e2e91 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:38.717004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-effb8a12-666c-48e5-9e71-e228e71e2e91 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:38.717457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-effb8a12-666c-48e5-9e71-e228e71e2e91 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:38.735480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a38e7b84-fc90-486f-915d-44cd48f5992a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:38.737753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a38e7b84-fc90-486f-915d-44cd48f5992a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:38.744433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a38e7b84-fc90-486f-915d-44cd48f5992a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:38.746207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a38e7b84-fc90-486f-915d-44cd48f5992a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:38.746207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a38e7b84-fc90-486f-915d-44cd48f5992a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:38.746207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a38e7b84-fc90-486f-915d-44cd48f5992a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:38.746615 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a38e7b84-fc90-486f-915d-44cd48f5992a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:38.746961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a38e7b84-fc90-486f-915d-44cd48f5992a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:38.779420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a38e7b84-fc90-486f-915d-44cd48f5992a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047844 Aug 08 08:45:38.780333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 261/494] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Aug 8 08:45:38 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:45:38.847182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0a37145e-d926-4c0e-92d4-b481eed77018 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:38.847676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0a37145e-d926-4c0e-92d4-b481eed77018 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:38.854892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a37145e-d926-4c0e-92d4-b481eed77018 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:38.855370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a37145e-d926-4c0e-92d4-b481eed77018 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:38.855800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a37145e-d926-4c0e-92d4-b481eed77018 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:38.856487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a37145e-d926-4c0e-92d4-b481eed77018 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:38.856939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a37145e-d926-4c0e-92d4-b481eed77018 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:38.857422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a37145e-d926-4c0e-92d4-b481eed77018 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:38.877358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-effb8a12-666c-48e5-9e71-e228e71e2e91 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:38.881948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0a37145e-d926-4c0e-92d4-b481eed77018 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:45:38.885370 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-effb8a12-666c-48e5-9e71-e228e71e2e91 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.182594 Aug 08 08:45:38.885941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 234/495] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:38 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:38.916329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:39.192232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0a37145e-d926-4c0e-92d4-b481eed77018 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 204 len: 0 microversion: 2.20 time: 0.348959 Aug 08 08:45:39.192819 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 262/496] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Aug 8 08:45:38 2022] DELETE /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 08 08:45:39.202200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:39.202814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:39.208974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:39.209494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:39.209933 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:39.210623 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:39.211739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:39.212155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:39.340457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:39.348277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:39.349811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:39.350954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8eecf29f-a1d4-4fd3-8a49-b0c386affd71 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.152750 Aug 08 08:45:39.351544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 235/497] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:39 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:39.907189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ab499fc9-2fcc-47fd-842c-a087f673ef61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:39.907903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ab499fc9-2fcc-47fd-842c-a087f673ef61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:39.914373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab499fc9-2fcc-47fd-842c-a087f673ef61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:39.915348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab499fc9-2fcc-47fd-842c-a087f673ef61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:39.915923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab499fc9-2fcc-47fd-842c-a087f673ef61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:39.916632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab499fc9-2fcc-47fd-842c-a087f673ef61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:39.917110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab499fc9-2fcc-47fd-842c-a087f673ef61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:39.917553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab499fc9-2fcc-47fd-842c-a087f673ef61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:40.047336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ab499fc9-2fcc-47fd-842c-a087f673ef61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:40.056188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ab499fc9-2fcc-47fd-842c-a087f673ef61 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.152491 Aug 08 08:45:40.056762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 263/498] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:39 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:40.373915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:40.374572 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:40.385242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:40.385754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:40.386188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:40.386879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:40.387326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:40.387746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:40.515132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:40.523071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:40.525225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:40.526386 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6118b02e-0279-4cb7-b7c9-e758efc6f1d2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.156344 Aug 08 08:45:40.526980 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 236/499] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:40 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:41.086193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8cd44da6-94aa-4126-9a6f-e964ef117be5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:41.086859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8cd44da6-94aa-4126-9a6f-e964ef117be5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:41.093260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd44da6-94aa-4126-9a6f-e964ef117be5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:41.093749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd44da6-94aa-4126-9a6f-e964ef117be5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:41.094192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd44da6-94aa-4126-9a6f-e964ef117be5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:41.094883 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd44da6-94aa-4126-9a6f-e964ef117be5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:41.095338 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd44da6-94aa-4126-9a6f-e964ef117be5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:41.095764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd44da6-94aa-4126-9a6f-e964ef117be5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:41.312977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8cd44da6-94aa-4126-9a6f-e964ef117be5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:41.321971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8cd44da6-94aa-4126-9a6f-e964ef117be5 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.238975 Aug 08 08:45:41.322760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 264/500] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:41 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:41.550878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:41.551473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:41.558463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:41.558956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:41.559389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:41.560094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:41.560545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:41.560971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:41.888116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:41.896058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:41.897577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:41.898730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-729c2b5d-fdc0-4722-8f94-f3a7f74b3eee tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1722 microversion: 2.20 time: 0.351767 Aug 08 08:45:41.899339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 237/501] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:41 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:42.342993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d797d5f6-09e2-47b4-95fe-bcd68880d467 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:42.343568 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d797d5f6-09e2-47b4-95fe-bcd68880d467 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:42.350487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d797d5f6-09e2-47b4-95fe-bcd68880d467 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:42.350976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d797d5f6-09e2-47b4-95fe-bcd68880d467 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:42.351408 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d797d5f6-09e2-47b4-95fe-bcd68880d467 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:42.355348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d797d5f6-09e2-47b4-95fe-bcd68880d467 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:42.355843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d797d5f6-09e2-47b4-95fe-bcd68880d467 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:42.356287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d797d5f6-09e2-47b4-95fe-bcd68880d467 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:42.358284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-702c6c17-83b9-4842-8666-41a5e3e180b8 req-5cde04fb-3720-4bc5-927c-a72511bcc28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa423dc-c608-40ed-a783-faf7a48d13c1", "name": "network-vif-deleted", "tag": "22c96d99-e75c-4e18-bb06-3b7e1fc4519b"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:42.367730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-702c6c17-83b9-4842-8666-41a5e3e180b8 req-5cde04fb-3720-4bc5-927c-a72511bcc28f service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:42.369136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-702c6c17-83b9-4842-8666-41a5e3e180b8 req-5cde04fb-3720-4bc5-927c-a72511bcc28f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:42.369651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-702c6c17-83b9-4842-8666-41a5e3e180b8 req-5cde04fb-3720-4bc5-927c-a72511bcc28f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:42.381396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-702c6c17-83b9-4842-8666-41a5e3e180b8 req-5cde04fb-3720-4bc5-927c-a72511bcc28f service nova] Creating event network-vif-deleted:22c96d99-e75c-4e18-bb06-3b7e1fc4519b for instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 on hv-cinder-83697 Aug 08 08:45:42.386708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-702c6c17-83b9-4842-8666-41a5e3e180b8 req-5cde04fb-3720-4bc5-927c-a72511bcc28f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032965 Aug 08 08:45:42.387674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 238/502] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:42.507765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d797d5f6-09e2-47b4-95fe-bcd68880d467 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:42.517364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d797d5f6-09e2-47b4-95fe-bcd68880d467 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.178102 Aug 08 08:45:42.528195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 265/503] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:42 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:42.922594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:42.923391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:42.929524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:42.930006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:42.930441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:42.933104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:42.933104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:42.933104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:42.964644 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:42.965127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:42.965582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:42.966025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lazy-loading 'fault' on Instance uuid 9aa423dc-c608-40ed-a783-faf7a48d13c1 {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:45:43.007271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:43.016069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:43.017581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:43.018733 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bed74086-caa2-4b87-9891-a0d833d2e453 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 200 len: 1370 microversion: 2.20 time: 0.100821 Aug 08 08:45:43.019286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 239/504] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:42 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:43.540078 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-81dc0506-e05c-4b16-b54a-92689237b34e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:43.540755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-81dc0506-e05c-4b16-b54a-92689237b34e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:43.547180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81dc0506-e05c-4b16-b54a-92689237b34e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:43.547664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81dc0506-e05c-4b16-b54a-92689237b34e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:43.548101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81dc0506-e05c-4b16-b54a-92689237b34e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:43.553381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81dc0506-e05c-4b16-b54a-92689237b34e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:43.553381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81dc0506-e05c-4b16-b54a-92689237b34e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:43.553381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81dc0506-e05c-4b16-b54a-92689237b34e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:43.683004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-81dc0506-e05c-4b16-b54a-92689237b34e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:43.690866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-81dc0506-e05c-4b16-b54a-92689237b34e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1737 microversion: 2.1 time: 0.154884 Aug 08 08:45:43.691429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 266/505] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:43 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:44.043231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:44.043953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:44.046341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=44 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:44.051054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:44.051531 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:44.051965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:44.052772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:44.053257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:44.053680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:44.067112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] HTTP exception thrown: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Request method failure captured: Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 HTTP/1.1 Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxCD_D-fDiqjHbDESOQq8js8YHCFkEfzJpwnv3nBUyaBTTpOFyGcKDrzi1eJ9AGLTHZuDrWIv6U6Ra02kzwRBH_vCdOd1U5mJiwf17_dPBJULLFw1YZVi1KTU27c4xrNk39CGaTPVLe3UwGm3BPEOqn_8ywEXV_5F2sGXtvuA5FpW4 Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:45:44.068702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: b3e5a78c3b6c48d9a4aed7d36fd54736 Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:45:44.070338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '9aa423dc-c608-40ed-a783-faf7a48d13c1'} Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:45:44.071827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:45:44.073477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:45:44.074949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Returning 404 to user: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:45:44.074949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3f4a81e0-2e9c-4785-8268-09ece813873e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 404 len: 111 microversion: 2.20 time: 0.031035 Aug 08 08:45:44.074949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 240/506] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:44 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 08:45:44.079798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3b77d96c-5e55-4ebd-9ad4-3d46aa7a220e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '.version_select at 0x7f4795c383a0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:44.158086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3b77d96c-5e55-4ebd-9ad4-3d46aa7a220e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-544979144" status: 204 len: 0 microversion: 2.20 time: 0.082144 Aug 08 08:45:44.158660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 267/507] 10.222.0.33 () {60 vars in 1259 bytes} [Mon Aug 8 08:45:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-544979144 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 08:45:44.712031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8cd3db32-d1ba-4772-826f-e9b985c075e6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:44.712686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8cd3db32-d1ba-4772-826f-e9b985c075e6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:44.718847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cd3db32-d1ba-4772-826f-e9b985c075e6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:44.719352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cd3db32-d1ba-4772-826f-e9b985c075e6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:44.719787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cd3db32-d1ba-4772-826f-e9b985c075e6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:44.720475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cd3db32-d1ba-4772-826f-e9b985c075e6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:44.720930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cd3db32-d1ba-4772-826f-e9b985c075e6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:44.721387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cd3db32-d1ba-4772-826f-e9b985c075e6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:44.877507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8cd3db32-d1ba-4772-826f-e9b985c075e6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:44.877507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8cd3db32-d1ba-4772-826f-e9b985c075e6 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1717 microversion: 2.1 time: 0.157768 Aug 08 08:45:44.877507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 241/508] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:44 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:44.900713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1ce0827b-8eaa-4c91-b0ff-27fbf4a0230c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Action: 'create', calling method: .version_select at 0x7f4795bde940>, body: {"keypair": {"name": "tempest-keypair-1818017601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+CTQK9ipPLRVoMrIC1lmYsus7zINeWmm3Lu3T4xcLO+DCqwB99WPfiuUGxjk3u0dVs3buI7qYVdDTMXQlNOMalRKgRpPKDOs1VNfEVU9/kxYZimXlufm1GQ+McTszyPA=="}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:44.916841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-1ce0827b-8eaa-4c91-b0ff-27fbf4a0230c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Getting quotas for project 2841a629bc1f4885a356218c2d0721b7. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:45:44.920786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-1ce0827b-8eaa-4c91-b0ff-27fbf4a0230c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Getting quotas for user b3e5a78c3b6c48d9a4aed7d36fd54736 and project 2841a629bc1f4885a356218c2d0721b7. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:45:44.976618 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:44.977797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:44.984070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:44.990834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:44.990834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:44.990834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:44.990834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:44.991203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:45.033570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1ce0827b-8eaa-4c91-b0ff-27fbf4a0230c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.137703 Aug 08 08:45:45.034194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 268/509] 10.222.0.33 () {62 vars in 1200 bytes} [Mon Aug 8 08:45:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 08:45:45.070352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] HTTP exception thrown: Cannot 'detach_volume' instance 79aff6d2-7210-4da9-8624-b1fa9f66350a while it is in vm_state rescued Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Request method failure captured: Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments/f3fdeb34-2b6b-4c84-9d0e-dca12a809a09 HTTP/1.1 Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxL2F7ZuGskPSxhai7x0oCP1vO9ils3SnaQq8McZIlcSa0VOxLWO6VilcGbV94Kh5zwVgCfUYE97a1dvb13NYbQkeUAJAoUQrR8y52k20in8oG8jaOnuESYqYBI_dUu-rSkgOop2uVpELpc5_TxTQGz7w12k7peMHSN-XCHDlBqsUo Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 2a4e5c5a950c4047b15749aace25f46d Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:45:45.073028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:45:45.074549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:45:45.074549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:45:45.074549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 2a4e5c5a950c4047b15749aace25f46d Aug 08 08:45:45.074549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:45:45.074549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-ServerRescueNegativeTestJSON-7596386-project Aug 08 08:45:45.074549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:45:45.074549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:45:45.074549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 00e07188d3df4d958ce83085b7bb141a Aug 08 08:45:45.074549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-ServerRescueNegativeTestJSON-7596386-project Aug 08 08:45:45.074549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:45:45.074549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Cannot 'detach_volume' instance 79aff6d2-7210-4da9-8624-b1fa9f66350a while it is in vm_state rescued Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'server_id': '79aff6d2-7210-4da9-8624-b1fa9f66350a', 'id': 'f3fdeb34-2b6b-4c84-9d0e-dca12a809a09'} Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 79aff6d2-7210-4da9-8624-b1fa9f66350a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:45:45.075364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 79aff6d2-7210-4da9-8624-b1fa9f66350a while it is in vm_state rescued Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 79aff6d2-7210-4da9-8624-b1fa9f66350a while it is in vm_state rescued Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:45:45.076575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Returning 409 to user: Cannot 'detach_volume' instance 79aff6d2-7210-4da9-8624-b1fa9f66350a while it is in vm_state rescued {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:45:45.077884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-616f2ed3-99c4-43c2-be10-d0c1f46e7dd0 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "DELETE /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments/f3fdeb34-2b6b-4c84-9d0e-dca12a809a09" status: 409 len: 152 microversion: 2.1 time: 0.100724 Aug 08 08:45:45.077884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 242/510] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:45:44 2022] DELETE /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments/f3fdeb34-2b6b-4c84-9d0e-dca12a809a09 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 08 08:45:45.082102 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-30b5d2c0-5257-4811-ac1c-c1083274c61e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:45.082631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-30b5d2c0-5257-4811-ac1c-c1083274c61e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:45.088982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30b5d2c0-5257-4811-ac1c-c1083274c61e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:45.089506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30b5d2c0-5257-4811-ac1c-c1083274c61e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:45.089942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30b5d2c0-5257-4811-ac1c-c1083274c61e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:45.090620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30b5d2c0-5257-4811-ac1c-c1083274c61e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:45.091072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30b5d2c0-5257-4811-ac1c-c1083274c61e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:45.091495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30b5d2c0-5257-4811-ac1c-c1083274c61e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:45.252925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-30b5d2c0-5257-4811-ac1c-c1083274c61e tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "POST /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/action" status: 202 len: 0 microversion: 2.1 time: 0.174234 Aug 08 08:45:45.254349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 269/511] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:45:45 2022] POST /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:45:45.262413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-22a2ff32-44c1-4d77-91c7-dd1117349501 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:45.263174 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-22a2ff32-44c1-4d77-91c7-dd1117349501 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:45.271790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a2ff32-44c1-4d77-91c7-dd1117349501 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:45.271790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a2ff32-44c1-4d77-91c7-dd1117349501 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:45.271790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a2ff32-44c1-4d77-91c7-dd1117349501 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:45.271790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a2ff32-44c1-4d77-91c7-dd1117349501 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:45.272334 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a2ff32-44c1-4d77-91c7-dd1117349501 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:45.272712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a2ff32-44c1-4d77-91c7-dd1117349501 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:45.478280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-22a2ff32-44c1-4d77-91c7-dd1117349501 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:45.490569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-22a2ff32-44c1-4d77-91c7-dd1117349501 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1725 microversion: 2.1 time: 0.228400 Aug 08 08:45:45.490569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 243/512] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:45 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:45:46.509217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-17f309b5-1a42-45ed-9154-9c9026706a6f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:46.509918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-17f309b5-1a42-45ed-9154-9c9026706a6f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:46.516042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17f309b5-1a42-45ed-9154-9c9026706a6f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:46.516526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17f309b5-1a42-45ed-9154-9c9026706a6f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:46.516957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17f309b5-1a42-45ed-9154-9c9026706a6f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:46.517684 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17f309b5-1a42-45ed-9154-9c9026706a6f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:46.518144 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17f309b5-1a42-45ed-9154-9c9026706a6f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:46.518553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17f309b5-1a42-45ed-9154-9c9026706a6f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:46.659706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-17f309b5-1a42-45ed-9154-9c9026706a6f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:46.668680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-17f309b5-1a42-45ed-9154-9c9026706a6f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1725 microversion: 2.1 time: 0.165036 Aug 08 08:45:46.677181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 270/513] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:46 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:45:46.999891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2119461491", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39fe2d0c-de1b-4433-9585-22bf5be0307a"}], "security_groups": [{"name": "tempest-securitygroup--842222183"}], "key_name": "tempest-keypair-1818017601", "user_data": "}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:47.100178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.network.neutron [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] validate_networks() for [('39fe2d0c-de1b-4433-9585-22bf5be0307a', None, None, None, None, None)] {{(pid=124673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:45:47.534083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Flavor limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:45:47.534585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Image limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:45:47.535071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Flavor pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:45:47.535487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Image pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:45:47.535903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:45:47.544530 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:47.545013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:47.545487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:47.546309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:47.546768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:47.547199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:47.563845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Getting quotas for project 2841a629bc1f4885a356218c2d0721b7. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:45:47.567776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Getting quotas for user b3e5a78c3b6c48d9a4aed7d36fd54736 and project 2841a629bc1f4885a356218c2d0721b7. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:45:47.579216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Going to run 1 instances... {{(pid=124673) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:45:47.581504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:45:47.689031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d2ae9589-ea86-45bf-aed2-6d0665b411b8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:47.689677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d2ae9589-ea86-45bf-aed2-6d0665b411b8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:47.696537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ae9589-ea86-45bf-aed2-6d0665b411b8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:47.697021 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ae9589-ea86-45bf-aed2-6d0665b411b8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:47.697481 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ae9589-ea86-45bf-aed2-6d0665b411b8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:47.698169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ae9589-ea86-45bf-aed2-6d0665b411b8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:47.698622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ae9589-ea86-45bf-aed2-6d0665b411b8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:47.699042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ae9589-ea86-45bf-aed2-6d0665b411b8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:47.719323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-62e61382-2ea0-418b-8bb3-fb67d3059a84 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.723704 Aug 08 08:45:47.719964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 244/514] 10.222.0.33 () {62 vars in 1188 bytes} [Mon Aug 8 08:45:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 08:45:47.731383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3607256c-b059-414a-8d2d-bd7e0a94de64 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:47.732149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3607256c-b059-414a-8d2d-bd7e0a94de64 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:47.807330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3607256c-b059-414a-8d2d-bd7e0a94de64 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:47.818615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3607256c-b059-414a-8d2d-bd7e0a94de64 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:47.820636 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3607256c-b059-414a-8d2d-bd7e0a94de64 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:47.822152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3607256c-b059-414a-8d2d-bd7e0a94de64 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1282 microversion: 2.20 time: 0.095303 Aug 08 08:45:47.823301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 245/515] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:47 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:47.871142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d2ae9589-ea86-45bf-aed2-6d0665b411b8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:47.879239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d2ae9589-ea86-45bf-aed2-6d0665b411b8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1725 microversion: 2.1 time: 0.194039 Aug 08 08:45:47.879797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 271/516] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:47 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:45:48.844396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:48.844946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:48.851385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:48.851868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:48.852307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:48.853006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:48.854570 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:48.854844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:48.901060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-696b347d-fe17-4bf2-a99d-95bc69890e3f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:48.902312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-696b347d-fe17-4bf2-a99d-95bc69890e3f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:48.909265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-696b347d-fe17-4bf2-a99d-95bc69890e3f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:48.909751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-696b347d-fe17-4bf2-a99d-95bc69890e3f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:48.910189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-696b347d-fe17-4bf2-a99d-95bc69890e3f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:48.910885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-696b347d-fe17-4bf2-a99d-95bc69890e3f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:48.911342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-696b347d-fe17-4bf2-a99d-95bc69890e3f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:48.911856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-696b347d-fe17-4bf2-a99d-95bc69890e3f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:48.917397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:48.929011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:48.932444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:48.933180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-63d83507-4bf3-4b0b-beea-83ff5e27355d tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1286 microversion: 2.20 time: 0.092261 Aug 08 08:45:48.934461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 246/517] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:48 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:49.068278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-696b347d-fe17-4bf2-a99d-95bc69890e3f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:49.076444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-696b347d-fe17-4bf2-a99d-95bc69890e3f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1731 microversion: 2.1 time: 0.179343 Aug 08 08:45:49.077001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 272/518] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:45:48 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:45:49.096952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e7c53b9f-f905-42d0-8ef9-fcc914a2ea52 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:49.097415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e7c53b9f-f905-42d0-8ef9-fcc914a2ea52 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:49.103323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c53b9f-f905-42d0-8ef9-fcc914a2ea52 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:49.104752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c53b9f-f905-42d0-8ef9-fcc914a2ea52 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:49.105220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c53b9f-f905-42d0-8ef9-fcc914a2ea52 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:49.105916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c53b9f-f905-42d0-8ef9-fcc914a2ea52 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:49.106373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c53b9f-f905-42d0-8ef9-fcc914a2ea52 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:49.106801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c53b9f-f905-42d0-8ef9-fcc914a2ea52 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:49.183583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e7c53b9f-f905-42d0-8ef9-fcc914a2ea52 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090447 Aug 08 08:45:49.184171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 247/519] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 08:45:49 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:49.956591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:49.957122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:49.964126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:49.964605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:49.965051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:49.965876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:49.966335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:49.966933 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:50.049535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:50.057686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:50.059184 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:50.060282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5df1669f-eec3-414d-980d-4e49f5ccc238 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1334 microversion: 2.20 time: 0.108088 Aug 08 08:45:50.060830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 273/520] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:49 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1334 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:50.226258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-2a0ea31c-a27c-45e4-ba05-89073428613c req-53a8d5f5-de07-4aa3-99be-5db6388481a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79aff6d2-7210-4da9-8624-b1fa9f66350a", "tag": "354f0823-fe90-4acf-b32b-47d5aa7bebb5"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:50.254889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-2a0ea31c-a27c-45e4-ba05-89073428613c req-53a8d5f5-de07-4aa3-99be-5db6388481a3 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:50.255610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-2a0ea31c-a27c-45e4-ba05-89073428613c req-53a8d5f5-de07-4aa3-99be-5db6388481a3 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:50.257418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-2a0ea31c-a27c-45e4-ba05-89073428613c req-53a8d5f5-de07-4aa3-99be-5db6388481a3 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:50.282584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-2a0ea31c-a27c-45e4-ba05-89073428613c req-53a8d5f5-de07-4aa3-99be-5db6388481a3 service nova] Creating event network-changed:354f0823-fe90-4acf-b32b-47d5aa7bebb5 for instance 79aff6d2-7210-4da9-8624-b1fa9f66350a on hv-cinder-83697 Aug 08 08:45:50.288036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-2a0ea31c-a27c-45e4-ba05-89073428613c req-53a8d5f5-de07-4aa3-99be-5db6388481a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065814 Aug 08 08:45:50.289885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 248/521] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:51.083298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:51.083908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:51.090911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:51.091392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:51.092011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:51.092709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:51.093175 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:51.093766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:51.166401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:51.177360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:51.178859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:51.180018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-56ac6fce-c67d-4b31-94e2-553ae7b7a8cc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1340 microversion: 2.20 time: 0.100598 Aug 08 08:45:51.180569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 274/522] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:51 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1340 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:52.205012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:52.205830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:52.211839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:52.212319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:52.213490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:52.214401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:52.214657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:52.215083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:52.312872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-7c3c71a4-49a8-404f-b2fd-a2957c7a1466 req-88bc78c2-0e05-457a-beb9-814ccf110464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79aff6d2-7210-4da9-8624-b1fa9f66350a", "tag": "354f0823-fe90-4acf-b32b-47d5aa7bebb5"}, {"name": "network-changed", "server_uuid": "c2e00a03-eab8-4b60-bb8d-84093fbe9b22", "tag": "259d0741-4693-45fb-b135-1c29ea66a183"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:52.323667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-7c3c71a4-49a8-404f-b2fd-a2957c7a1466 req-88bc78c2-0e05-457a-beb9-814ccf110464 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:52.324821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-7c3c71a4-49a8-404f-b2fd-a2957c7a1466 req-88bc78c2-0e05-457a-beb9-814ccf110464 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:52.324821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-7c3c71a4-49a8-404f-b2fd-a2957c7a1466 req-88bc78c2-0e05-457a-beb9-814ccf110464 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:52.337398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-7c3c71a4-49a8-404f-b2fd-a2957c7a1466 req-88bc78c2-0e05-457a-beb9-814ccf110464 service nova] Creating event network-changed:354f0823-fe90-4acf-b32b-47d5aa7bebb5 for instance 79aff6d2-7210-4da9-8624-b1fa9f66350a on hv-cinder-83697 Aug 08 08:45:52.338051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-7c3c71a4-49a8-404f-b2fd-a2957c7a1466 req-88bc78c2-0e05-457a-beb9-814ccf110464 service nova] Creating event network-changed:259d0741-4693-45fb-b135-1c29ea66a183 for instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 on hv-cinder-83697 Aug 08 08:45:52.344645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-7c3c71a4-49a8-404f-b2fd-a2957c7a1466 req-88bc78c2-0e05-457a-beb9-814ccf110464 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035402 Aug 08 08:45:52.345352 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 275/523] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:45:52.433479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:52.442632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:52.444129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:52.445251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-47fc2ff0-eb57-4909-bd05-db660ef1b63b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1407 microversion: 2.20 time: 0.245084 Aug 08 08:45:52.446003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 249/524] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:52 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:53.468893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:53.469620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:53.475773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:53.476263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:53.476726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:53.477462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:53.477925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:53.478846 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:53.607181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:53.615443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:53.616948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:53.618081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5c532feb-e048-4195-a124-1cf09e78e2f4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1407 microversion: 2.20 time: 0.153901 Aug 08 08:45:53.618633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 276/525] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:53 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:45:54.640839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:54.641626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:54.648026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:54.648555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:54.648989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:54.649703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:54.650667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:54.651091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:54.779255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:54.787062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:54.788561 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:54.789699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d7ca1385-6adc-4dac-bad6-7a419e1428ff tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1407 microversion: 2.20 time: 0.152796 Aug 08 08:45:54.790252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 250/526] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:54 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:55.812473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:55.813073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:55.815530 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=4 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:55.820339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:55.820825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:55.821290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:55.822719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:55.823163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:55.823396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:55.949892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:55.957902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:55.960736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:55.960736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c75d8b83-60b7-4294-9fdd-fe90e8589cd2 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1407 microversion: 2.20 time: 0.152071 Aug 08 08:45:55.961272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 277/527] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:55 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:56.984663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:56.985353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:56.991335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:56.993253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:56.993253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:56.993253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:56.993626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:56.994241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:57.123809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:57.131686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:57.133219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:57.134895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-92d475cc-6442-44ec-941b-a817de1caacd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1407 microversion: 2.20 time: 0.153917 Aug 08 08:45:57.135739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 251/528] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:56 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:45:57.752214 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-43d177db-9a45-41f3-9e69-e89b5d32b81a req-db20423e-3fc4-4805-ae89-d08a0db0ab21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2e00a03-eab8-4b60-bb8d-84093fbe9b22", "name": "network-vif-plugged", "status": "completed", "tag": "259d0741-4693-45fb-b135-1c29ea66a183"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:45:57.762792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-43d177db-9a45-41f3-9e69-e89b5d32b81a req-db20423e-3fc4-4805-ae89-d08a0db0ab21 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:57.763375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-43d177db-9a45-41f3-9e69-e89b5d32b81a req-db20423e-3fc4-4805-ae89-d08a0db0ab21 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:57.763736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-43d177db-9a45-41f3-9e69-e89b5d32b81a req-db20423e-3fc4-4805-ae89-d08a0db0ab21 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:57.776569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-43d177db-9a45-41f3-9e69-e89b5d32b81a req-db20423e-3fc4-4805-ae89-d08a0db0ab21 service nova] Creating event network-vif-plugged:259d0741-4693-45fb-b135-1c29ea66a183 for instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 on hv-cinder-83697 Aug 08 08:45:57.781491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-43d177db-9a45-41f3-9e69-e89b5d32b81a req-db20423e-3fc4-4805-ae89-d08a0db0ab21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032990 Aug 08 08:45:57.782090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 278/529] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:45:58.157291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:58.157900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:58.159844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:58.160539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=8 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:45:58.166449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:58.166937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:58.167378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:58.168080 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:58.168528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:58.168953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:58.299159 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:58.306998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:58.308526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:58.309646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-63c024c9-72fe-42ef-a871-a73eae5cdb1c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1407 microversion: 2.20 time: 0.156369 Aug 08 08:45:58.310196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 252/530] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:58 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:45:59.332830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:45:59.333463 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:45:59.339529 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:59.340009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:59.340439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:59.341120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:45:59.341598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:45:59.342017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:45:59.469054 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:59.477112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:59.479539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:45:59.480637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-acb15738-3c02-4fae-94b4-e1afe4727245 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1407 microversion: 2.20 time: 0.152764 Aug 08 08:45:59.481205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 279/531] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:45:59 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:00.502946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:00.503551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:00.509956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:00.510434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:00.510866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:00.511545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:00.511992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:00.512412 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:00.643684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:00.652118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:00.653636 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:00.654784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3b11cf08-44cb-4f44-a1ce-a4861b94546c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1599 microversion: 2.20 time: 0.155789 Aug 08 08:46:00.655341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 253/532] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:00 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:00.677058 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4434dc36-89bc-48b5-82a2-0ac1f02cd4c9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:00.677598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4434dc36-89bc-48b5-82a2-0ac1f02cd4c9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:00.679932 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:00.684572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4434dc36-89bc-48b5-82a2-0ac1f02cd4c9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:00.690052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4434dc36-89bc-48b5-82a2-0ac1f02cd4c9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:00.690052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4434dc36-89bc-48b5-82a2-0ac1f02cd4c9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:00.690052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4434dc36-89bc-48b5-82a2-0ac1f02cd4c9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:00.690052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4434dc36-89bc-48b5-82a2-0ac1f02cd4c9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:00.690424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4434dc36-89bc-48b5-82a2-0ac1f02cd4c9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:00.763174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4434dc36-89bc-48b5-82a2-0ac1f02cd4c9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090026 Aug 08 08:46:00.763772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 280/533] 10.222.0.33 () {60 vars in 1316 bytes} [Mon Aug 8 08:46:00 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:46:01.720114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-d1aba2ad-d8fc-4446-bcc5-df39d09584a7 req-bf270ee2-a9b3-4568-aa78-2d851c75ceaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2e00a03-eab8-4b60-bb8d-84093fbe9b22", "tag": "259d0741-4693-45fb-b135-1c29ea66a183"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:01.730281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-d1aba2ad-d8fc-4446-bcc5-df39d09584a7 req-bf270ee2-a9b3-4568-aa78-2d851c75ceaa service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:01.730760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-d1aba2ad-d8fc-4446-bcc5-df39d09584a7 req-bf270ee2-a9b3-4568-aa78-2d851c75ceaa service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:01.731193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-d1aba2ad-d8fc-4446-bcc5-df39d09584a7 req-bf270ee2-a9b3-4568-aa78-2d851c75ceaa service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:01.735243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:01.742249 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-d1aba2ad-d8fc-4446-bcc5-df39d09584a7 req-bf270ee2-a9b3-4568-aa78-2d851c75ceaa service nova] Creating event network-changed:259d0741-4693-45fb-b135-1c29ea66a183 for instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 on hv-cinder-83697 Aug 08 08:46:01.748521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-d1aba2ad-d8fc-4446-bcc5-df39d09584a7 req-bf270ee2-a9b3-4568-aa78-2d851c75ceaa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031976 Aug 08 08:46:01.749366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 254/534] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:04.813055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4fa94a80-8e7f-4310-b5dc-9e5e10dace97 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:04.813639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4fa94a80-8e7f-4310-b5dc-9e5e10dace97 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:04.822543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fa94a80-8e7f-4310-b5dc-9e5e10dace97 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:04.824336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fa94a80-8e7f-4310-b5dc-9e5e10dace97 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:04.824336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fa94a80-8e7f-4310-b5dc-9e5e10dace97 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:04.824336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fa94a80-8e7f-4310-b5dc-9e5e10dace97 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:04.824802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fa94a80-8e7f-4310-b5dc-9e5e10dace97 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:04.825260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4fa94a80-8e7f-4310-b5dc-9e5e10dace97 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:04.844171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:04.851729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4fa94a80-8e7f-4310-b5dc-9e5e10dace97 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/ips" status: 200 len: 151 microversion: 2.1 time: 0.045077 Aug 08 08:46:04.852997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 281/535] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 08:46:04 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:06.433430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-96780303-6cdc-42c9-9aa3-ce5b01d3e458 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b79b7c9-c198-478b-a81b-f4319903e0bf"}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:06.435790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-96780303-6cdc-42c9-9aa3-ce5b01d3e458 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:06.441910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96780303-6cdc-42c9-9aa3-ce5b01d3e458 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:06.442396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96780303-6cdc-42c9-9aa3-ce5b01d3e458 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:06.442837 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96780303-6cdc-42c9-9aa3-ce5b01d3e458 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:06.443519 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96780303-6cdc-42c9-9aa3-ce5b01d3e458 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:06.443976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96780303-6cdc-42c9-9aa3-ce5b01d3e458 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:06.444408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96780303-6cdc-42c9-9aa3-ce5b01d3e458 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:07.051551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-96780303-6cdc-42c9-9aa3-ce5b01d3e458 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623021 Aug 08 08:46:07.052145 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 255/536] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:46:06 2022] POST /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:14.567466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b79b7c9-c198-478b-a81b-f4319903e0bf"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:14.569825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:14.577119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:14.577630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:14.578069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:14.578765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:14.579230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:14.579659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:14.658222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Invalid volume: volume 3b79b7c9-c198-478b-a81b-f4319903e0bf is already attached to instances: 78a63eae-e877-4736-8882-261c5d7766b2 Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: POST /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-volume_attachments HTTP/1.1 Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 74 Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:46:14.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {"volumeAttachment": {"volumeId": "3b79b7c9-c198-478b-a81b-f4319903e0bf"}} Aug 08 08:46:14.661489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Invalid volume: volume 3b79b7c9-c198-478b-a81b-f4319903e0bf is already attached to instances: 78a63eae-e877-4736-8882-261c5d7766b2 Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'server_id': '78a63eae-e877-4736-8882-261c5d7766b2', 'body': {'volumeAttachment': {'volumeId': '3b79b7c9-c198-478b-a81b-f4319903e0bf'}}} Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3b79b7c9-c198-478b-a81b-f4319903e0bf is already attached to instances: 78a63eae-e877-4736-8882-261c5d7766b2 Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:14.662368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3b79b7c9-c198-478b-a81b-f4319903e0bf is already attached to instances: 78a63eae-e877-4736-8882-261c5d7766b2 Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:14.663805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:14.665179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:14.665179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:46:14.665179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:46:14.665179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3b79b7c9-c198-478b-a81b-f4319903e0bf is already attached to instances: 78a63eae-e877-4736-8882-261c5d7766b2 Aug 08 08:46:14.665179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:14.665179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 400 to user: Invalid volume: volume 3b79b7c9-c198-478b-a81b-f4319903e0bf is already attached to instances: 78a63eae-e877-4736-8882-261c5d7766b2 {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:14.665179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e818c033-fd1e-41b2-a896-0914422ad5a9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098191 Aug 08 08:46:14.665179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 282/537] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:46:14 2022] POST /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 08:46:14.727170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4b47f036-24c0-4ba4-889d-140450449df6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:14.727757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4b47f036-24c0-4ba4-889d-140450449df6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:14.730008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:14.734903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b47f036-24c0-4ba4-889d-140450449df6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:14.740574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b47f036-24c0-4ba4-889d-140450449df6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:14.740574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b47f036-24c0-4ba4-889d-140450449df6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:14.740574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b47f036-24c0-4ba4-889d-140450449df6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:14.740574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b47f036-24c0-4ba4-889d-140450449df6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:14.740913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b47f036-24c0-4ba4-889d-140450449df6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:14.816160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-4b47f036-24c0-4ba4-889d-140450449df6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lazy-loading 'services' on Instance uuid 78a63eae-e877-4736-8882-261c5d7766b2 {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:46:15.047217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4b47f036-24c0-4ba4-889d-140450449df6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-volume_attachments/3b79b7c9-c198-478b-a81b-f4319903e0bf" status: 202 len: 0 microversion: 2.1 time: 0.324785 Aug 08 08:46:15.047949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 256/538] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:46:14 2022] DELETE /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-volume_attachments/3b79b7c9-c198-478b-a81b-f4319903e0bf => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:46:15.056331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-df18165d-9575-4a6e-afb8-7cf6666eb32d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:15.058626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-df18165d-9575-4a6e-afb8-7cf6666eb32d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:15.065086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df18165d-9575-4a6e-afb8-7cf6666eb32d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:15.065796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df18165d-9575-4a6e-afb8-7cf6666eb32d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:15.066273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df18165d-9575-4a6e-afb8-7cf6666eb32d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:15.066918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df18165d-9575-4a6e-afb8-7cf6666eb32d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:15.067368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df18165d-9575-4a6e-afb8-7cf6666eb32d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:15.067788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df18165d-9575-4a6e-afb8-7cf6666eb32d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:15.098787 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-df18165d-9575-4a6e-afb8-7cf6666eb32d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046322 Aug 08 08:46:15.099334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 283/539] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:46:15 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:46:16.112776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e9413d4a-bf5b-44b6-8b03-7e1389ed93cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:16.115247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e9413d4a-bf5b-44b6-8b03-7e1389ed93cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:16.121929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9413d4a-bf5b-44b6-8b03-7e1389ed93cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:16.122464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9413d4a-bf5b-44b6-8b03-7e1389ed93cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:16.122891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9413d4a-bf5b-44b6-8b03-7e1389ed93cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:16.123603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9413d4a-bf5b-44b6-8b03-7e1389ed93cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:16.124056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9413d4a-bf5b-44b6-8b03-7e1389ed93cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:16.124482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9413d4a-bf5b-44b6-8b03-7e1389ed93cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:16.153171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e9413d4a-bf5b-44b6-8b03-7e1389ed93cf tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044936 Aug 08 08:46:16.157526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 257/540] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:46:16 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 08:46:16.218370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e728cff3-3d46-4097-9be8-9cad1635e56c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:16.218883 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e728cff3-3d46-4097-9be8-9cad1635e56c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:16.225275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e728cff3-3d46-4097-9be8-9cad1635e56c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:16.225766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e728cff3-3d46-4097-9be8-9cad1635e56c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:16.226210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e728cff3-3d46-4097-9be8-9cad1635e56c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:16.226908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e728cff3-3d46-4097-9be8-9cad1635e56c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:16.227368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e728cff3-3d46-4097-9be8-9cad1635e56c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:16.227821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e728cff3-3d46-4097-9be8-9cad1635e56c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:16.252838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e728cff3-3d46-4097-9be8-9cad1635e56c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:46:16.487832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e728cff3-3d46-4097-9be8-9cad1635e56c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 204 len: 0 microversion: 2.1 time: 0.273644 Aug 08 08:46:16.488454 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 284/541] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:46:16 2022] DELETE /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:46:16.496594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-29b8a750-703d-4b5f-a36a-98959c434b13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:16.497745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-29b8a750-703d-4b5f-a36a-98959c434b13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:16.503692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29b8a750-703d-4b5f-a36a-98959c434b13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:16.504173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29b8a750-703d-4b5f-a36a-98959c434b13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:16.504639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29b8a750-703d-4b5f-a36a-98959c434b13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:16.505363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29b8a750-703d-4b5f-a36a-98959c434b13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:16.505820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29b8a750-703d-4b5f-a36a-98959c434b13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:16.506251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-29b8a750-703d-4b5f-a36a-98959c434b13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:16.633646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-29b8a750-703d-4b5f-a36a-98959c434b13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:16.641808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-29b8a750-703d-4b5f-a36a-98959c434b13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1683 microversion: 2.1 time: 0.149177 Aug 08 08:46:16.642366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 258/542] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:16 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:17.663707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c66d3884-140e-4c97-a35f-4d18ec250d16 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:17.664396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c66d3884-140e-4c97-a35f-4d18ec250d16 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:17.670903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c66d3884-140e-4c97-a35f-4d18ec250d16 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:17.671328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c66d3884-140e-4c97-a35f-4d18ec250d16 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:17.671760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c66d3884-140e-4c97-a35f-4d18ec250d16 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:17.672446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c66d3884-140e-4c97-a35f-4d18ec250d16 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:17.672900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c66d3884-140e-4c97-a35f-4d18ec250d16 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:17.673366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c66d3884-140e-4c97-a35f-4d18ec250d16 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:17.808013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c66d3884-140e-4c97-a35f-4d18ec250d16 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:17.815475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c66d3884-140e-4c97-a35f-4d18ec250d16 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1683 microversion: 2.1 time: 0.156004 Aug 08 08:46:17.816034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 285/543] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:17 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:18.837796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-17af26b7-e160-49e8-9e97-ebf36c3468f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:18.838426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-17af26b7-e160-49e8-9e97-ebf36c3468f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:18.845382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17af26b7-e160-49e8-9e97-ebf36c3468f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:18.845872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17af26b7-e160-49e8-9e97-ebf36c3468f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:18.846313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17af26b7-e160-49e8-9e97-ebf36c3468f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:18.847007 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17af26b7-e160-49e8-9e97-ebf36c3468f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:18.847464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17af26b7-e160-49e8-9e97-ebf36c3468f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:18.847892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17af26b7-e160-49e8-9e97-ebf36c3468f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:18.910273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-17af26b7-e160-49e8-9e97-ebf36c3468f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:18.918507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-17af26b7-e160-49e8-9e97-ebf36c3468f1 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1615 microversion: 2.1 time: 0.085764 Aug 08 08:46:18.919670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 259/544] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:18 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1615 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:19.088688 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-26f75e3c-ffaa-4c2b-9a27-7fe95d7b03dc req-585d1b4b-a74a-4697-9022-89bf858f0645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a63eae-e877-4736-8882-261c5d7766b2", "name": "network-vif-deleted", "tag": "83650a4d-2742-4f7f-b99b-c9e82946cf55"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:19.099420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-26f75e3c-ffaa-4c2b-9a27-7fe95d7b03dc req-585d1b4b-a74a-4697-9022-89bf858f0645 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:19.103197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-26f75e3c-ffaa-4c2b-9a27-7fe95d7b03dc req-585d1b4b-a74a-4697-9022-89bf858f0645 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:19.103197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-26f75e3c-ffaa-4c2b-9a27-7fe95d7b03dc req-585d1b4b-a74a-4697-9022-89bf858f0645 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:19.112464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-26f75e3c-ffaa-4c2b-9a27-7fe95d7b03dc req-585d1b4b-a74a-4697-9022-89bf858f0645 service nova] Creating event network-vif-deleted:83650a4d-2742-4f7f-b99b-c9e82946cf55 for instance 78a63eae-e877-4736-8882-261c5d7766b2 on hv-cinder-83697 Aug 08 08:46:19.117485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-26f75e3c-ffaa-4c2b-9a27-7fe95d7b03dc req-585d1b4b-a74a-4697-9022-89bf858f0645 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032402 Aug 08 08:46:19.118300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 286/545] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:19.940104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:19.940847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:19.947441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:19.948184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:19.948685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:19.949503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:19.949956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:19.950943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:19.987093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:19.987650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:19.988195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:19.988753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lazy-loading 'fault' on Instance uuid 78a63eae-e877-4736-8882-261c5d7766b2 {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:46:20.031235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:20.038311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-02014310-cc52-45f2-bb83-5f338ffdafe0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 200 len: 1331 microversion: 2.1 time: 0.102140 Aug 08 08:46:20.038884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 260/546] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:19 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:21.061451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:21.062181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:21.068463 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:21.068959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:21.069433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:21.070152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:21.070611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:21.071039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:21.084842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 HTTP/1.1 Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:46:21.086472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:46:21.087696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '78a63eae-e877-4736-8882-261c5d7766b2'} Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:21.088405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:46:21.089781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:21.091262 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:21.091262 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c6697740-e576-47cc-8bda-253f774ffa01 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 404 len: 111 microversion: 2.1 time: 0.031941 Aug 08 08:46:21.091262 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 287/547] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:21 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:46:21.096627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-84573021-7af1-4c2d-a34d-2d0ee10e12ae tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '.version_select at 0x7f4795c55310>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:21.163124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-84573021-7af1-4c2d-a34d-2d0ee10e12ae tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1068401885" status: 202 len: 0 microversion: 2.1 time: 0.070150 Aug 08 08:46:21.163735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 261/548] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Aug 8 08:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1068401885 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:46:21.867554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-30bbb737-b2e8-493d-84a3-40e7526119e7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: .version_select at 0x7f4795c11160>, body: {"keypair": {"name": "tempest-keypair-1899082831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4S6tN37kyFm9xOdB05CB8q8w+LjcsBHcHqzOQhpxHD0ovge+aOpddBcVhokFuNihbID/iawUnRfrppkjsGcLzRp9FVBzL3EZG1VHeBPaJGtyrR4GiLhX2P9FnVUt9+6g=="}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:21.883521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-30bbb737-b2e8-493d-84a3-40e7526119e7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:46:21.887442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-30bbb737-b2e8-493d-84a3-40e7526119e7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for user 32dcdc2e24e44a07ade44d1da330a77e and project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:46:21.969410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-30bbb737-b2e8-493d-84a3-40e7526119e7 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105536 Aug 08 08:46:21.969924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 288/549] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 08:46:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:22.246390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6ebda19c-00d9-4c96-b0a7-809e1fe1c721 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:22.248901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6ebda19c-00d9-4c96-b0a7-809e1fe1c721 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:22.255628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ebda19c-00d9-4c96-b0a7-809e1fe1c721 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:22.256091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ebda19c-00d9-4c96-b0a7-809e1fe1c721 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:22.256532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ebda19c-00d9-4c96-b0a7-809e1fe1c721 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:22.257250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ebda19c-00d9-4c96-b0a7-809e1fe1c721 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:22.257711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ebda19c-00d9-4c96-b0a7-809e1fe1c721 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:22.258139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ebda19c-00d9-4c96-b0a7-809e1fe1c721 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:22.286767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6ebda19c-00d9-4c96-b0a7-809e1fe1c721 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044958 Aug 08 08:46:22.287340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 262/550] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:46:22 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 08:46:22.350433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c7a72a39-b1b6-4235-b3bd-048f0972489b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:22.350951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c7a72a39-b1b6-4235-b3bd-048f0972489b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:22.358832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7a72a39-b1b6-4235-b3bd-048f0972489b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:22.359372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7a72a39-b1b6-4235-b3bd-048f0972489b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:22.359815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7a72a39-b1b6-4235-b3bd-048f0972489b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:22.360519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7a72a39-b1b6-4235-b3bd-048f0972489b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:22.360983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7a72a39-b1b6-4235-b3bd-048f0972489b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:22.361444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7a72a39-b1b6-4235-b3bd-048f0972489b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:22.386593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c7a72a39-b1b6-4235-b3bd-048f0972489b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:46:22.670965 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c7a72a39-b1b6-4235-b3bd-048f0972489b tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 204 len: 0 microversion: 2.1 time: 0.324533 Aug 08 08:46:22.671606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 289/551] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:46:22 2022] DELETE /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:46:22.679924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4162e1a7-bea4-49d0-b54c-422347bbbd27 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:22.680539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4162e1a7-bea4-49d0-b54c-422347bbbd27 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:22.686533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4162e1a7-bea4-49d0-b54c-422347bbbd27 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:22.687020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4162e1a7-bea4-49d0-b54c-422347bbbd27 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:22.687460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4162e1a7-bea4-49d0-b54c-422347bbbd27 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:22.688147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4162e1a7-bea4-49d0-b54c-422347bbbd27 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:22.688603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4162e1a7-bea4-49d0-b54c-422347bbbd27 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:22.689031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4162e1a7-bea4-49d0-b54c-422347bbbd27 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:22.818802 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4162e1a7-bea4-49d0-b54c-422347bbbd27 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:22.827465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4162e1a7-bea4-49d0-b54c-422347bbbd27 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1674 microversion: 2.1 time: 0.151417 Aug 08 08:46:22.828038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 263/552] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:22 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:23.848794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f16fed1b-e1c0-44b5-9125-b3bd0614b4a0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:23.849541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f16fed1b-e1c0-44b5-9125-b3bd0614b4a0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:23.856206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f16fed1b-e1c0-44b5-9125-b3bd0614b4a0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:23.856679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f16fed1b-e1c0-44b5-9125-b3bd0614b4a0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:23.857332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f16fed1b-e1c0-44b5-9125-b3bd0614b4a0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:23.858042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f16fed1b-e1c0-44b5-9125-b3bd0614b4a0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:23.858506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f16fed1b-e1c0-44b5-9125-b3bd0614b4a0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:23.860074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f16fed1b-e1c0-44b5-9125-b3bd0614b4a0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:23.993064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f16fed1b-e1c0-44b5-9125-b3bd0614b4a0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:24.001580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f16fed1b-e1c0-44b5-9125-b3bd0614b4a0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1674 microversion: 2.1 time: 0.157195 Aug 08 08:46:24.002143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 290/553] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:23 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:46:24.056403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2121212122", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fbd2a5d-fa4b-468d-80da-6dad72f31b93"}], "security_groups": [{"name": "tempest-securitygroup--1263918630"}], "key_name": "tempest-keypair-1899082831", "user_data": "}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:24.160072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.network.neutron [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] validate_networks() for [('0fbd2a5d-fa4b-468d-80da-6dad72f31b93', None, None, None, None, None)] {{(pid=124673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:46:24.523825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Flavor limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:46:24.524248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Image limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:46:24.524727 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Flavor pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:46:24.525130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Image pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:46:24.525560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:46:24.534815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:24.535294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:24.535726 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:24.536448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:24.536898 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:24.537367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:24.553733 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:46:24.557582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Getting quotas for user 32dcdc2e24e44a07ade44d1da330a77e and project ce958d94ddc441e9bd10b5ae9638accc. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:46:24.568239 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Going to run 1 instances... {{(pid=124673) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:46:24.570519 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:46:24.700985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-37ca99af-18ec-4b6c-b23e-602ad0e2c40a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.648813 Aug 08 08:46:24.701663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 264/554] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:46:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:46:24.712304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a3cc37b1-53c4-4c6a-9d5b-b540ca6203d8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:24.712981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a3cc37b1-53c4-4c6a-9d5b-b540ca6203d8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:24.770304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a3cc37b1-53c4-4c6a-9d5b-b540ca6203d8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:24.776940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a3cc37b1-53c4-4c6a-9d5b-b540ca6203d8 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1242 microversion: 2.1 time: 0.068559 Aug 08 08:46:24.777537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 291/555] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:24 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:25.022799 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c0a73473-8aa1-4446-ac33-8edecb803c99 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:25.023414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c0a73473-8aa1-4446-ac33-8edecb803c99 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:25.030347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0a73473-8aa1-4446-ac33-8edecb803c99 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:25.030782 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0a73473-8aa1-4446-ac33-8edecb803c99 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:25.031232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0a73473-8aa1-4446-ac33-8edecb803c99 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:25.031964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0a73473-8aa1-4446-ac33-8edecb803c99 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:25.032428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0a73473-8aa1-4446-ac33-8edecb803c99 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:25.032859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0a73473-8aa1-4446-ac33-8edecb803c99 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:25.175439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c0a73473-8aa1-4446-ac33-8edecb803c99 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:25.193668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c0a73473-8aa1-4446-ac33-8edecb803c99 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1674 microversion: 2.1 time: 0.170865 Aug 08 08:46:25.193668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 265/556] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:25 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:25.798614 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8ddc8c52-4955-4256-b422-c5b86888ca13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:25.799337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8ddc8c52-4955-4256-b422-c5b86888ca13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:25.806205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8ddc8c52-4955-4256-b422-c5b86888ca13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:25.807718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8ddc8c52-4955-4256-b422-c5b86888ca13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:25.807718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8ddc8c52-4955-4256-b422-c5b86888ca13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:25.807987 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8ddc8c52-4955-4256-b422-c5b86888ca13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:25.808433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8ddc8c52-4955-4256-b422-c5b86888ca13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:25.808950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8ddc8c52-4955-4256-b422-c5b86888ca13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:25.882960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8ddc8c52-4955-4256-b422-c5b86888ca13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:25.896136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8ddc8c52-4955-4256-b422-c5b86888ca13 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1238 microversion: 2.1 time: 0.102437 Aug 08 08:46:25.899635 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 292/557] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:25 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1238 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:26.037999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-37fc2cfe-4cef-49c1-a817-d16a937fe4a0 req-2aefecc8-2fcc-49ff-98c6-fd55e71e1817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8117a4bb-5bfc-41a1-a874-72c1266a8955", "name": "network-vif-deleted", "tag": "45742616-a27a-4ad1-8004-5461bd902cbb"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:26.048626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-37fc2cfe-4cef-49c1-a817-d16a937fe4a0 req-2aefecc8-2fcc-49ff-98c6-fd55e71e1817 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:26.049413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-37fc2cfe-4cef-49c1-a817-d16a937fe4a0 req-2aefecc8-2fcc-49ff-98c6-fd55e71e1817 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:26.049867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-37fc2cfe-4cef-49c1-a817-d16a937fe4a0 req-2aefecc8-2fcc-49ff-98c6-fd55e71e1817 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:26.061811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-37fc2cfe-4cef-49c1-a817-d16a937fe4a0 req-2aefecc8-2fcc-49ff-98c6-fd55e71e1817 service nova] Creating event network-vif-deleted:45742616-a27a-4ad1-8004-5461bd902cbb for instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 on hv-cinder-83697 Aug 08 08:46:26.071084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-37fc2cfe-4cef-49c1-a817-d16a937fe4a0 req-2aefecc8-2fcc-49ff-98c6-fd55e71e1817 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032442 Aug 08 08:46:26.071084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 266/558] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:26.217926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-69179864-3d1f-4251-90f3-6be8a9aa8c59 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:26.217926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-69179864-3d1f-4251-90f3-6be8a9aa8c59 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:26.218741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69179864-3d1f-4251-90f3-6be8a9aa8c59 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:26.219219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69179864-3d1f-4251-90f3-6be8a9aa8c59 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:26.219718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69179864-3d1f-4251-90f3-6be8a9aa8c59 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:26.220412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69179864-3d1f-4251-90f3-6be8a9aa8c59 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:26.220873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69179864-3d1f-4251-90f3-6be8a9aa8c59 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:26.221330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69179864-3d1f-4251-90f3-6be8a9aa8c59 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:26.289507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-69179864-3d1f-4251-90f3-6be8a9aa8c59 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:26.297119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-69179864-3d1f-4251-90f3-6be8a9aa8c59 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 200 len: 1607 microversion: 2.1 time: 0.089668 Aug 08 08:46:26.299291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 293/559] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:26 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 1607 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:26.920643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2a44e165-e66f-4df4-bb6c-3c94680650f6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:26.922781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2a44e165-e66f-4df4-bb6c-3c94680650f6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:26.931878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a44e165-e66f-4df4-bb6c-3c94680650f6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:26.938292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a44e165-e66f-4df4-bb6c-3c94680650f6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:26.938292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a44e165-e66f-4df4-bb6c-3c94680650f6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:26.938292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a44e165-e66f-4df4-bb6c-3c94680650f6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:26.938292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a44e165-e66f-4df4-bb6c-3c94680650f6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:26.938709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2a44e165-e66f-4df4-bb6c-3c94680650f6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:27.013865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2a44e165-e66f-4df4-bb6c-3c94680650f6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:27.023686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2a44e165-e66f-4df4-bb6c-3c94680650f6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1312 microversion: 2.1 time: 0.107252 Aug 08 08:46:27.025294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 267/560] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:26 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:27.319533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:27.320277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:27.327343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:27.327838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:27.328280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:27.328986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:27.329556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:27.329891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:27.347212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] HTTP exception thrown: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Request method failure captured: Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 HTTP/1.1 Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxLzU3bRfFjcH6l16FZZFqNgO8CTVY2fyNZuAAJULBcQnw-w_wze6D5y9K-YIo8rp8oPjapmCVT4XSBbFXOmIwa6xavwtaxIqgKO3elVDxZKekSr2y4DAVV-4CfVNNKtxYWkvJ4X6-ZN8ONopiWEe3Ue8NE8ZwmoRXzsSl75fZty80 Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:46:27.348924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 81d6a9d89e394e63ba5c8182a12b4142 Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:46:27.350248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '8117a4bb-5bfc-41a1-a874-72c1266a8955'} Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:27.352381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:46:27.354885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:27.357202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Returning 404 to user: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:27.357202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b423b0fa-41be-4332-ba07-9459c35e65c8 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 404 len: 111 microversion: 2.1 time: 0.035020 Aug 08 08:46:27.357202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 294/561] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:27 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:46:27.362822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bac9bc19-7212-401a-9403-2dfa4d72f206 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '.version_select at 0x7f4795b6b5e0>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:27.448926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bac9bc19-7212-401a-9403-2dfa4d72f206 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-364068907" status: 202 len: 0 microversion: 2.1 time: 0.093088 Aug 08 08:46:27.449661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 268/562] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Aug 8 08:46:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-364068907 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:46:28.044736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6954a3da-a30d-4007-97d7-3ee1b6e7e77a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:28.045502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6954a3da-a30d-4007-97d7-3ee1b6e7e77a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:28.051664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6954a3da-a30d-4007-97d7-3ee1b6e7e77a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:28.052153 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6954a3da-a30d-4007-97d7-3ee1b6e7e77a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:28.052586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6954a3da-a30d-4007-97d7-3ee1b6e7e77a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:28.053307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6954a3da-a30d-4007-97d7-3ee1b6e7e77a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:28.053764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6954a3da-a30d-4007-97d7-3ee1b6e7e77a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:28.054185 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6954a3da-a30d-4007-97d7-3ee1b6e7e77a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:28.175116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-c30b6261-5e84-4751-bf25-d54fe9e61464 req-25ab9c1b-6ce3-480a-b171-66b63e35aa97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e76361-0be7-4cf0-a3e1-7ba5a1245905", "tag": "efcb8c59-959e-4f15-8786-52dcf3c27016"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:28.188085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-c30b6261-5e84-4751-bf25-d54fe9e61464 req-25ab9c1b-6ce3-480a-b171-66b63e35aa97 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:28.189292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-c30b6261-5e84-4751-bf25-d54fe9e61464 req-25ab9c1b-6ce3-480a-b171-66b63e35aa97 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:28.189739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-c30b6261-5e84-4751-bf25-d54fe9e61464 req-25ab9c1b-6ce3-480a-b171-66b63e35aa97 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:28.202304 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-c30b6261-5e84-4751-bf25-d54fe9e61464 req-25ab9c1b-6ce3-480a-b171-66b63e35aa97 service nova] Creating event network-changed:efcb8c59-959e-4f15-8786-52dcf3c27016 for instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 on hv-cinder-83697 Aug 08 08:46:28.207688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-c30b6261-5e84-4751-bf25-d54fe9e61464 req-25ab9c1b-6ce3-480a-b171-66b63e35aa97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040627 Aug 08 08:46:28.209091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 269/563] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:46:28.279824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ff4982fb-3737-48bc-868a-7e7f332e0e86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:28.280712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ff4982fb-3737-48bc-868a-7e7f332e0e86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:28.287241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4982fb-3737-48bc-868a-7e7f332e0e86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:28.287753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4982fb-3737-48bc-868a-7e7f332e0e86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:28.288173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4982fb-3737-48bc-868a-7e7f332e0e86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:28.288877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4982fb-3737-48bc-868a-7e7f332e0e86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:28.289379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4982fb-3737-48bc-868a-7e7f332e0e86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:28.289801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4982fb-3737-48bc-868a-7e7f332e0e86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:28.380923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-ff4982fb-3737-48bc-868a-7e7f332e0e86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lazy-loading 'services' on Instance uuid 79aff6d2-7210-4da9-8624-b1fa9f66350a {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:46:28.516271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6954a3da-a30d-4007-97d7-3ee1b6e7e77a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:28.529313 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6954a3da-a30d-4007-97d7-3ee1b6e7e77a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1368 microversion: 2.1 time: 0.489140 Aug 08 08:46:28.529895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 295/564] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:28 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1368 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:46:28.534469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e4dd5c0e-9945-42e9-86ad-9c8281feeb46 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Action: 'create', calling method: .version_select at 0x7f4795c38040>, body: {"keypair": {"name": "tempest-keypair-2000362586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObtiRkyD2pP2SAZtRgXqqF6cmivHlwQLz2OtwCkqcQme5gv69/FTXhk/7MLUuCSC0bR5+x42YWtg4d40w1hcE8/USHoFs0kjrpjz+ucSpleUks00EhqQy3Sx0xsSL4YqA=="}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:28.550815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-e4dd5c0e-9945-42e9-86ad-9c8281feeb46 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Getting quotas for project 734d6a79fd5845f19569b2c2825fb38c. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:46:28.554785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-e4dd5c0e-9945-42e9-86ad-9c8281feeb46 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Getting quotas for user 81d6a9d89e394e63ba5c8182a12b4142 and project 734d6a79fd5845f19569b2c2825fb38c. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:46:28.629354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ff4982fb-3737-48bc-868a-7e7f332e0e86 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "DELETE /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments/f3fdeb34-2b6b-4c84-9d0e-dca12a809a09" status: 202 len: 0 microversion: 2.1 time: 0.354775 Aug 08 08:46:28.630242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 270/565] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:46:28 2022] DELETE /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments/f3fdeb34-2b6b-4c84-9d0e-dca12a809a09 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 08:46:28.638552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0b4ed1f4-f762-4e01-9211-75dadd87619c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:28.640875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0b4ed1f4-f762-4e01-9211-75dadd87619c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:28.647408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b4ed1f4-f762-4e01-9211-75dadd87619c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:28.647904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b4ed1f4-f762-4e01-9211-75dadd87619c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:28.648340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b4ed1f4-f762-4e01-9211-75dadd87619c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:28.649055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b4ed1f4-f762-4e01-9211-75dadd87619c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:28.649562 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b4ed1f4-f762-4e01-9211-75dadd87619c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:28.649997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b4ed1f4-f762-4e01-9211-75dadd87619c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:28.660371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e4dd5c0e-9945-42e9-86ad-9c8281feeb46 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121648 Aug 08 08:46:28.660371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 296/566] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 08:46:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:28.683348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0b4ed1f4-f762-4e01-9211-75dadd87619c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048856 Aug 08 08:46:28.684101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 271/567] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:46:28 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:46:29.554095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f4c4b531-c40d-4c83-aea8-0a08efa9764e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:29.554709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f4c4b531-c40d-4c83-aea8-0a08efa9764e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:29.560743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4c4b531-c40d-4c83-aea8-0a08efa9764e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:29.561257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4c4b531-c40d-4c83-aea8-0a08efa9764e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:29.561697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4c4b531-c40d-4c83-aea8-0a08efa9764e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:29.562382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4c4b531-c40d-4c83-aea8-0a08efa9764e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:29.562840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4c4b531-c40d-4c83-aea8-0a08efa9764e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:29.563260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4c4b531-c40d-4c83-aea8-0a08efa9764e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:29.696329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f2a205ce-5634-43ed-be12-2c4d5c5e13f7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:29.698588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f2a205ce-5634-43ed-be12-2c4d5c5e13f7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:29.699503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f4c4b531-c40d-4c83-aea8-0a08efa9764e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:29.708115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2a205ce-5634-43ed-be12-2c4d5c5e13f7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:29.708115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2a205ce-5634-43ed-be12-2c4d5c5e13f7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:29.708115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2a205ce-5634-43ed-be12-2c4d5c5e13f7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:29.708374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2a205ce-5634-43ed-be12-2c4d5c5e13f7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:29.708721 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2a205ce-5634-43ed-be12-2c4d5c5e13f7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:29.709153 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2a205ce-5634-43ed-be12-2c4d5c5e13f7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:29.709354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f4c4b531-c40d-4c83-aea8-0a08efa9764e tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1368 microversion: 2.1 time: 0.159309 Aug 08 08:46:29.710012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 297/568] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:29 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:29.733347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:29.748801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f2a205ce-5634-43ed-be12-2c4d5c5e13f7 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056702 Aug 08 08:46:29.749405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 272/569] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:46:29 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:46:30.731488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-57399c99-246c-466e-8747-4ec2bdae7675 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:30.732173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-57399c99-246c-466e-8747-4ec2bdae7675 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:30.738531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-57399c99-246c-466e-8747-4ec2bdae7675 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:30.739010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-57399c99-246c-466e-8747-4ec2bdae7675 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:30.739444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-57399c99-246c-466e-8747-4ec2bdae7675 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:30.740125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-57399c99-246c-466e-8747-4ec2bdae7675 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:30.740576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-57399c99-246c-466e-8747-4ec2bdae7675 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:30.740998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-57399c99-246c-466e-8747-4ec2bdae7675 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:30.761367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d0a82fc3-61cb-4dc4-a07f-299a2529b9a8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:30.763662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d0a82fc3-61cb-4dc4-a07f-299a2529b9a8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:30.770515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d0a82fc3-61cb-4dc4-a07f-299a2529b9a8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:30.771019 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d0a82fc3-61cb-4dc4-a07f-299a2529b9a8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:30.771457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d0a82fc3-61cb-4dc4-a07f-299a2529b9a8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:30.772151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d0a82fc3-61cb-4dc4-a07f-299a2529b9a8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:30.772602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d0a82fc3-61cb-4dc4-a07f-299a2529b9a8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:30.773021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d0a82fc3-61cb-4dc4-a07f-299a2529b9a8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:30.808330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d0a82fc3-61cb-4dc4-a07f-299a2529b9a8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049136 Aug 08 08:46:30.808330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 273/570] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:46:30 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 08:46:30.880140 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-243181b6-18b6-40b4-922f-3d27734ababf tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:30.880676 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-243181b6-18b6-40b4-922f-3d27734ababf tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:30.888025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-243181b6-18b6-40b4-922f-3d27734ababf tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:30.888844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-243181b6-18b6-40b4-922f-3d27734ababf tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:30.889312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-243181b6-18b6-40b4-922f-3d27734ababf tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:30.890015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-243181b6-18b6-40b4-922f-3d27734ababf tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:30.890468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-243181b6-18b6-40b4-922f-3d27734ababf tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:30.890979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-243181b6-18b6-40b4-922f-3d27734ababf tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:30.916377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-243181b6-18b6-40b4-922f-3d27734ababf tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Going to try to terminate instance {{(pid=124673) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:46:31.003423 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-57399c99-246c-466e-8747-4ec2bdae7675 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:31.010854 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-57399c99-246c-466e-8747-4ec2bdae7675 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1368 microversion: 2.1 time: 0.284091 Aug 08 08:46:31.011410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 298/571] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:30 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:31.016882 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1460292861", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ad159e5-3ad2-4e99-b7fd-ee716dcb6c9e"}], "security_groups": [{"name": "tempest-securitygroup--1604134240"}], "key_name": "tempest-keypair-2000362586", "user_data": "}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:31.120686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] validate_networks() for [('6ad159e5-3ad2-4e99-b7fd-ee716dcb6c9e', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:46:31.190169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-243181b6-18b6-40b4-922f-3d27734ababf tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "DELETE /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 204 len: 0 microversion: 2.1 time: 0.313550 Aug 08 08:46:31.190756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 274/572] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:46:30 2022] DELETE /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 08:46:31.199217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d351b52e-8dc8-4fe1-9587-532f27fbd81c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:31.199969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d351b52e-8dc8-4fe1-9587-532f27fbd81c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:31.209574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d351b52e-8dc8-4fe1-9587-532f27fbd81c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:31.210067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d351b52e-8dc8-4fe1-9587-532f27fbd81c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:31.210566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d351b52e-8dc8-4fe1-9587-532f27fbd81c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:31.211274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d351b52e-8dc8-4fe1-9587-532f27fbd81c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:31.211725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d351b52e-8dc8-4fe1-9587-532f27fbd81c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:31.212148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d351b52e-8dc8-4fe1-9587-532f27fbd81c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:31.496147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d351b52e-8dc8-4fe1-9587-532f27fbd81c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:31.504133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d351b52e-8dc8-4fe1-9587-532f27fbd81c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1691 microversion: 2.1 time: 0.308846 Aug 08 08:46:31.504724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 275/573] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:31 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1691 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:46:31.573663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:46:31.574095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:46:31.575210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:46:31.575629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:46:31.576065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:46:31.584770 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:31.585290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:31.585732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:31.586463 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:31.586920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:31.587348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:31.603627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Getting quotas for project 734d6a79fd5845f19569b2c2825fb38c. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:46:31.607969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Getting quotas for user 81d6a9d89e394e63ba5c8182a12b4142 and project 734d6a79fd5845f19569b2c2825fb38c. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:46:31.618900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:46:31.621122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:46:31.724056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d5b8aefb-da26-47d6-86d1-bf8b8d104042 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.711620 Aug 08 08:46:31.724972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 299/574] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:46:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:46:31.744451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ea0ccd27-43f7-4c9f-84d9-84b1f3a63365 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:31.744952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ea0ccd27-43f7-4c9f-84d9-84b1f3a63365 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:31.798893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ea0ccd27-43f7-4c9f-84d9-84b1f3a63365 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:31.807311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ea0ccd27-43f7-4c9f-84d9-84b1f3a63365 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1238 microversion: 2.1 time: 0.066269 Aug 08 08:46:31.815832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 276/575] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:31 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:32.032995 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a042bf89-7461-455b-bf67-aecffef0e990 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:32.033897 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a042bf89-7461-455b-bf67-aecffef0e990 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:32.041099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a042bf89-7461-455b-bf67-aecffef0e990 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:32.041723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a042bf89-7461-455b-bf67-aecffef0e990 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:32.042274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a042bf89-7461-455b-bf67-aecffef0e990 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:32.043958 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a042bf89-7461-455b-bf67-aecffef0e990 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:32.044522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a042bf89-7461-455b-bf67-aecffef0e990 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:32.045666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a042bf89-7461-455b-bf67-aecffef0e990 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:32.180095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a042bf89-7461-455b-bf67-aecffef0e990 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:32.183626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:32.188502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a042bf89-7461-455b-bf67-aecffef0e990 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1368 microversion: 2.1 time: 0.160483 Aug 08 08:46:32.189067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 300/576] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:32 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:32.525447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c7bdb3bd-a81f-48db-9175-f4941a41c57f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:32.526067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c7bdb3bd-a81f-48db-9175-f4941a41c57f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:32.533258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7bdb3bd-a81f-48db-9175-f4941a41c57f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:32.533749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7bdb3bd-a81f-48db-9175-f4941a41c57f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:32.534192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7bdb3bd-a81f-48db-9175-f4941a41c57f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:32.534885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7bdb3bd-a81f-48db-9175-f4941a41c57f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:32.535344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7bdb3bd-a81f-48db-9175-f4941a41c57f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:32.535771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7bdb3bd-a81f-48db-9175-f4941a41c57f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:32.662643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c7bdb3bd-a81f-48db-9175-f4941a41c57f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:32.670414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c7bdb3bd-a81f-48db-9175-f4941a41c57f tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1691 microversion: 2.1 time: 0.148867 Aug 08 08:46:32.670921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 277/577] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:32 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:32.828585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f5053533-851b-4530-b764-575ab9068fff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:32.829203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f5053533-851b-4530-b764-575ab9068fff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:32.835727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5053533-851b-4530-b764-575ab9068fff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:32.836210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5053533-851b-4530-b764-575ab9068fff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:32.836647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5053533-851b-4530-b764-575ab9068fff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:32.837362 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5053533-851b-4530-b764-575ab9068fff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:32.837821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5053533-851b-4530-b764-575ab9068fff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:32.838250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5053533-851b-4530-b764-575ab9068fff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:32.899946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f5053533-851b-4530-b764-575ab9068fff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:32.907818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f5053533-851b-4530-b764-575ab9068fff tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1242 microversion: 2.1 time: 0.083685 Aug 08 08:46:32.908382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 301/578] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:32 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:33.209227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6d6ecdc5-765b-483a-a594-adb81e51d081 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:33.209841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6d6ecdc5-765b-483a-a594-adb81e51d081 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:33.216263 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d6ecdc5-765b-483a-a594-adb81e51d081 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:33.216738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d6ecdc5-765b-483a-a594-adb81e51d081 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:33.217191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d6ecdc5-765b-483a-a594-adb81e51d081 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:33.217873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d6ecdc5-765b-483a-a594-adb81e51d081 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:33.218324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d6ecdc5-765b-483a-a594-adb81e51d081 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:33.218744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d6ecdc5-765b-483a-a594-adb81e51d081 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:33.350255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6d6ecdc5-765b-483a-a594-adb81e51d081 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:33.358818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6d6ecdc5-765b-483a-a594-adb81e51d081 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1368 microversion: 2.1 time: 0.153475 Aug 08 08:46:33.359375 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 278/579] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:33 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:33.691086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d2caa1f5-dd04-4f2d-93bd-743e7538b05c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:33.691695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d2caa1f5-dd04-4f2d-93bd-743e7538b05c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:33.698076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2caa1f5-dd04-4f2d-93bd-743e7538b05c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:33.698565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2caa1f5-dd04-4f2d-93bd-743e7538b05c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:33.699004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2caa1f5-dd04-4f2d-93bd-743e7538b05c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:33.699721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2caa1f5-dd04-4f2d-93bd-743e7538b05c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:33.700338 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2caa1f5-dd04-4f2d-93bd-743e7538b05c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:33.700770 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2caa1f5-dd04-4f2d-93bd-743e7538b05c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:33.837488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d2caa1f5-dd04-4f2d-93bd-743e7538b05c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:33.845572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d2caa1f5-dd04-4f2d-93bd-743e7538b05c tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1691 microversion: 2.1 time: 0.158281 Aug 08 08:46:33.846145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 302/580] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:33 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:33.927772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-381e781f-20dd-43fe-8704-8ff35dde57e7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:33.928387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-381e781f-20dd-43fe-8704-8ff35dde57e7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:33.934894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-381e781f-20dd-43fe-8704-8ff35dde57e7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:33.935415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-381e781f-20dd-43fe-8704-8ff35dde57e7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:33.935859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-381e781f-20dd-43fe-8704-8ff35dde57e7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:33.936555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-381e781f-20dd-43fe-8704-8ff35dde57e7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:33.937010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-381e781f-20dd-43fe-8704-8ff35dde57e7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:33.937469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-381e781f-20dd-43fe-8704-8ff35dde57e7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:33.954707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-1a4ff429-d5a3-4915-bc46-21d8ac924b5a req-b77c5e2e-a4c6-4b7b-81e7-50f5bf7df672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e76361-0be7-4cf0-a3e1-7ba5a1245905", "name": "network-vif-plugged", "status": "completed", "tag": "efcb8c59-959e-4f15-8786-52dcf3c27016"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:33.964579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-1a4ff429-d5a3-4915-bc46-21d8ac924b5a req-b77c5e2e-a4c6-4b7b-81e7-50f5bf7df672 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:33.965169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-1a4ff429-d5a3-4915-bc46-21d8ac924b5a req-b77c5e2e-a4c6-4b7b-81e7-50f5bf7df672 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:33.965973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-1a4ff429-d5a3-4915-bc46-21d8ac924b5a req-b77c5e2e-a4c6-4b7b-81e7-50f5bf7df672 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:33.980147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-1a4ff429-d5a3-4915-bc46-21d8ac924b5a req-b77c5e2e-a4c6-4b7b-81e7-50f5bf7df672 service nova] Creating event network-vif-plugged:efcb8c59-959e-4f15-8786-52dcf3c27016 for instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 on hv-cinder-83697 Aug 08 08:46:33.985736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-1a4ff429-d5a3-4915-bc46-21d8ac924b5a req-b77c5e2e-a4c6-4b7b-81e7-50f5bf7df672 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036171 Aug 08 08:46:33.986330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 303/581] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:46:34.001070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-381e781f-20dd-43fe-8704-8ff35dde57e7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:34.008523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-381e781f-20dd-43fe-8704-8ff35dde57e7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1242 microversion: 2.1 time: 0.084550 Aug 08 08:46:34.009082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 279/582] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:33 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:34.380390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3068d05b-b6b6-4b57-90c7-c3b0f0059e6b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:34.381090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3068d05b-b6b6-4b57-90c7-c3b0f0059e6b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:34.387377 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3068d05b-b6b6-4b57-90c7-c3b0f0059e6b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:34.387960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3068d05b-b6b6-4b57-90c7-c3b0f0059e6b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:34.388406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3068d05b-b6b6-4b57-90c7-c3b0f0059e6b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:34.389104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3068d05b-b6b6-4b57-90c7-c3b0f0059e6b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:34.390052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3068d05b-b6b6-4b57-90c7-c3b0f0059e6b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:34.390489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3068d05b-b6b6-4b57-90c7-c3b0f0059e6b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:34.537383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3068d05b-b6b6-4b57-90c7-c3b0f0059e6b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:34.545731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3068d05b-b6b6-4b57-90c7-c3b0f0059e6b tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1368 microversion: 2.1 time: 0.169587 Aug 08 08:46:34.546297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 304/583] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:34 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:34.867501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-be9df582-63fd-422e-9528-9afc54984ba4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:34.868110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-be9df582-63fd-422e-9528-9afc54984ba4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:34.870552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:34.875538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be9df582-63fd-422e-9528-9afc54984ba4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:34.876050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be9df582-63fd-422e-9528-9afc54984ba4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:34.876491 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be9df582-63fd-422e-9528-9afc54984ba4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:34.877215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be9df582-63fd-422e-9528-9afc54984ba4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:34.877741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be9df582-63fd-422e-9528-9afc54984ba4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:34.878149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be9df582-63fd-422e-9528-9afc54984ba4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:35.030675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f75ea902-496c-4d5f-88d4-5a8478c465f0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:35.031428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f75ea902-496c-4d5f-88d4-5a8478c465f0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:35.034955 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:35.038616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f75ea902-496c-4d5f-88d4-5a8478c465f0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:35.039113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f75ea902-496c-4d5f-88d4-5a8478c465f0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:35.039545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f75ea902-496c-4d5f-88d4-5a8478c465f0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:35.040831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f75ea902-496c-4d5f-88d4-5a8478c465f0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:35.041321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f75ea902-496c-4d5f-88d4-5a8478c465f0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:35.041898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f75ea902-496c-4d5f-88d4-5a8478c465f0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:35.049540 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-be9df582-63fd-422e-9528-9afc54984ba4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:35.062748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-be9df582-63fd-422e-9528-9afc54984ba4 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1691 microversion: 2.1 time: 0.199078 Aug 08 08:46:35.063573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 280/584] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:34 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1691 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:35.156705 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f75ea902-496c-4d5f-88d4-5a8478c465f0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:35.164789 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f75ea902-496c-4d5f-88d4-5a8478c465f0 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1234 microversion: 2.1 time: 0.138804 Aug 08 08:46:35.165554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 305/585] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:35 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1234 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:35.566178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-61a7f15f-ff8c-4568-8200-3969bec81778 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:35.566800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-61a7f15f-ff8c-4568-8200-3969bec81778 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:35.573124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61a7f15f-ff8c-4568-8200-3969bec81778 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:35.573680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61a7f15f-ff8c-4568-8200-3969bec81778 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:35.574132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61a7f15f-ff8c-4568-8200-3969bec81778 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:35.575556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61a7f15f-ff8c-4568-8200-3969bec81778 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:35.576104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61a7f15f-ff8c-4568-8200-3969bec81778 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:35.576540 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61a7f15f-ff8c-4568-8200-3969bec81778 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:35.764952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-61a7f15f-ff8c-4568-8200-3969bec81778 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:35.772458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-61a7f15f-ff8c-4568-8200-3969bec81778 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1368 microversion: 2.1 time: 0.210229 Aug 08 08:46:35.773006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 281/586] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:35 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:35.913852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-a2e90297-03b0-4468-b3ce-e2c1688315fd req-3658f864-4d4e-42dc-8421-70ce6d9ed062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79aff6d2-7210-4da9-8624-b1fa9f66350a", "name": "network-vif-deleted", "tag": "354f0823-fe90-4acf-b32b-47d5aa7bebb5"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:35.924788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-a2e90297-03b0-4468-b3ce-e2c1688315fd req-3658f864-4d4e-42dc-8421-70ce6d9ed062 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:35.925545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-a2e90297-03b0-4468-b3ce-e2c1688315fd req-3658f864-4d4e-42dc-8421-70ce6d9ed062 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:35.925813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-a2e90297-03b0-4468-b3ce-e2c1688315fd req-3658f864-4d4e-42dc-8421-70ce6d9ed062 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:35.938384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-a2e90297-03b0-4468-b3ce-e2c1688315fd req-3658f864-4d4e-42dc-8421-70ce6d9ed062 service nova] Creating event network-vif-deleted:354f0823-fe90-4acf-b32b-47d5aa7bebb5 for instance 79aff6d2-7210-4da9-8624-b1fa9f66350a on hv-cinder-83697 Aug 08 08:46:35.943876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-a2e90297-03b0-4468-b3ce-e2c1688315fd req-3658f864-4d4e-42dc-8421-70ce6d9ed062 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033464 Aug 08 08:46:35.944816 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 306/587] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:36.083778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3d09dd67-5062-4748-9587-85a96860d3e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:36.084543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3d09dd67-5062-4748-9587-85a96860d3e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:36.091892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d09dd67-5062-4748-9587-85a96860d3e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:36.092456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d09dd67-5062-4748-9587-85a96860d3e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:36.092895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d09dd67-5062-4748-9587-85a96860d3e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:36.093625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d09dd67-5062-4748-9587-85a96860d3e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:36.094076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d09dd67-5062-4748-9587-85a96860d3e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:36.094517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d09dd67-5062-4748-9587-85a96860d3e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:36.165251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3d09dd67-5062-4748-9587-85a96860d3e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:36.174457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3d09dd67-5062-4748-9587-85a96860d3e8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1331 microversion: 2.1 time: 0.094523 Aug 08 08:46:36.175025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 282/588] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:36 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:36.188634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a48c23ec-6c58-4c4c-a4ed-69d149be780f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:36.189687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a48c23ec-6c58-4c4c-a4ed-69d149be780f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:36.196287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a48c23ec-6c58-4c4c-a4ed-69d149be780f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:36.196942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a48c23ec-6c58-4c4c-a4ed-69d149be780f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:36.197474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a48c23ec-6c58-4c4c-a4ed-69d149be780f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:36.198343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a48c23ec-6c58-4c4c-a4ed-69d149be780f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:36.198834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a48c23ec-6c58-4c4c-a4ed-69d149be780f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:36.199594 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a48c23ec-6c58-4c4c-a4ed-69d149be780f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:36.263566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a48c23ec-6c58-4c4c-a4ed-69d149be780f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:36.271290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a48c23ec-6c58-4c4c-a4ed-69d149be780f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1290 microversion: 2.1 time: 0.087966 Aug 08 08:46:36.271890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 307/589] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:36 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:36.794047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-af4405bd-4ad2-43d8-a1d4-dac38a1d5645 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:36.794667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-af4405bd-4ad2-43d8-a1d4-dac38a1d5645 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:36.800885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4405bd-4ad2-43d8-a1d4-dac38a1d5645 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:36.801435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4405bd-4ad2-43d8-a1d4-dac38a1d5645 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:36.801873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4405bd-4ad2-43d8-a1d4-dac38a1d5645 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:36.802572 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4405bd-4ad2-43d8-a1d4-dac38a1d5645 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:36.803025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4405bd-4ad2-43d8-a1d4-dac38a1d5645 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:36.803587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af4405bd-4ad2-43d8-a1d4-dac38a1d5645 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:36.999484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-af4405bd-4ad2-43d8-a1d4-dac38a1d5645 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:37.008692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-af4405bd-4ad2-43d8-a1d4-dac38a1d5645 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1558 microversion: 2.1 time: 0.219043 Aug 08 08:46:37.035126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c03cc6e1-1935-4440-8eaf-6f07402c02e9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:37.038689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c03cc6e1-1935-4440-8eaf-6f07402c02e9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:37.038812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 283/590] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:36 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1558 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:37.065248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c03cc6e1-1935-4440-8eaf-6f07402c02e9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:37.067660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c03cc6e1-1935-4440-8eaf-6f07402c02e9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:37.068840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c03cc6e1-1935-4440-8eaf-6f07402c02e9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:37.072243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c03cc6e1-1935-4440-8eaf-6f07402c02e9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:37.072243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c03cc6e1-1935-4440-8eaf-6f07402c02e9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:37.075514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c03cc6e1-1935-4440-8eaf-6f07402c02e9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:37.195906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:37.196523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:37.203478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:37.203974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:37.204412 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:37.205112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:37.205595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:37.206025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:37.211548 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c03cc6e1-1935-4440-8eaf-6f07402c02e9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180348 Aug 08 08:46:37.229834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 308/591] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 08:46:37 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:46:37.271493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:37.272162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:37.272775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:37.273629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lazy-loading 'fault' on Instance uuid 79aff6d2-7210-4da9-8624-b1fa9f66350a {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:46:37.299345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0b443ce8-1075-49cf-9628-16cfbd245b14 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:37.299956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0b443ce8-1075-49cf-9628-16cfbd245b14 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:37.309044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b443ce8-1075-49cf-9628-16cfbd245b14 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:37.309574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b443ce8-1075-49cf-9628-16cfbd245b14 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:37.310015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b443ce8-1075-49cf-9628-16cfbd245b14 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:37.310716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b443ce8-1075-49cf-9628-16cfbd245b14 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:37.311185 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b443ce8-1075-49cf-9628-16cfbd245b14 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:37.311600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b443ce8-1075-49cf-9628-16cfbd245b14 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:37.331543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:37.340082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ab3a0b46-4f16-45e6-bc29-73b69e2d5040 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 200 len: 1336 microversion: 2.1 time: 0.148131 Aug 08 08:46:37.344456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 284/592] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:37 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 1336 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:37.380519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0b443ce8-1075-49cf-9628-16cfbd245b14 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:37.389599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0b443ce8-1075-49cf-9628-16cfbd245b14 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1296 microversion: 2.1 time: 0.094029 Aug 08 08:46:37.390179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 309/593] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:37 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:37.720820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b7b2820c-3306-478d-ad28-7637d9613008 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:37.721847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b7b2820c-3306-478d-ad28-7637d9613008 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:37.728567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7b2820c-3306-478d-ad28-7637d9613008 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:37.729338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7b2820c-3306-478d-ad28-7637d9613008 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:37.729971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7b2820c-3306-478d-ad28-7637d9613008 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:37.730766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7b2820c-3306-478d-ad28-7637d9613008 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:37.731229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7b2820c-3306-478d-ad28-7637d9613008 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:37.731799 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7b2820c-3306-478d-ad28-7637d9613008 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:37.763700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b7b2820c-3306-478d-ad28-7637d9613008 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/ips" status: 200 len: 152 microversion: 2.20 time: 0.046862 Aug 08 08:46:37.765089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 285/594] 10.222.0.33 () {60 vars in 1289 bytes} [Mon Aug 8 08:46:37 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:46:38.351423 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-1f78ef02-38b1-46bd-b836-74403b0f8c24 req-0b6befe2-8982-44da-bf4f-18b74b11fee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e76361-0be7-4cf0-a3e1-7ba5a1245905", "tag": "efcb8c59-959e-4f15-8786-52dcf3c27016"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:38.363808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:38.364428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 79aff6d2-7210-4da9-8624-b1fa9f66350a] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:38.385264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:38.385264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:38.385449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-1f78ef02-38b1-46bd-b836-74403b0f8c24 req-0b6befe2-8982-44da-bf4f-18b74b11fee2 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:38.385631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:38.385631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:38.385631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:38.385631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:38.385954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-1f78ef02-38b1-46bd-b836-74403b0f8c24 req-0b6befe2-8982-44da-bf4f-18b74b11fee2 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:38.385954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-1f78ef02-38b1-46bd-b836-74403b0f8c24 req-0b6befe2-8982-44da-bf4f-18b74b11fee2 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:38.405542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-1f78ef02-38b1-46bd-b836-74403b0f8c24 req-0b6befe2-8982-44da-bf4f-18b74b11fee2 service nova] Creating event network-changed:efcb8c59-959e-4f15-8786-52dcf3c27016 for instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 on hv-cinder-83697 Aug 08 08:46:38.419645 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] HTTP exception thrown: Instance 79aff6d2-7210-4da9-8624-b1fa9f66350a could not be found. Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Request method failure captured: Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a HTTP/1.1 Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxL2F7ZuGskPSxhai7x0oCP1vO9ils3SnaQq8McZIlcSa0VOxLWO6VilcGbV94Kh5zwVgCfUYE97a1dvb13NYbQkeUAJAoUQrR8y52k20in8oG8jaOnuESYqYBI_dUu-rSkgOop2uVpELpc5_TxTQGz7w12k7peMHSN-XCHDlBqsUo Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 2a4e5c5a950c4047b15749aace25f46d Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:46:38.421377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 2a4e5c5a950c4047b15749aace25f46d Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-ServerRescueNegativeTestJSON-7596386-project Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 00e07188d3df4d958ce83085b7bb141a Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-ServerRescueNegativeTestJSON-7596386-project Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 79aff6d2-7210-4da9-8624-b1fa9f66350a could not be found. Aug 08 08:46:38.422873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '79aff6d2-7210-4da9-8624-b1fa9f66350a'} Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79aff6d2-7210-4da9-8624-b1fa9f66350a could not be found. Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:38.423796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79aff6d2-7210-4da9-8624-b1fa9f66350a could not be found. Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79aff6d2-7210-4da9-8624-b1fa9f66350a could not be found. Aug 08 08:46:38.425683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:38.428022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Returning 404 to user: Instance 79aff6d2-7210-4da9-8624-b1fa9f66350a could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:38.428022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5ecdf8ea-bee9-430a-806a-fff77ffab643 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a" status: 404 len: 111 microversion: 2.1 time: 0.063217 Aug 08 08:46:38.428022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 286/595] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:38 2022] GET /compute/v2.1/servers/79aff6d2-7210-4da9-8624-b1fa9f66350a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 08:46:38.428466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-1f78ef02-38b1-46bd-b836-74403b0f8c24 req-0b6befe2-8982-44da-bf4f-18b74b11fee2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078860 Aug 08 08:46:38.428466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 310/596] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:38.432978 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9c4b8e0c-11b1-4808-9b78-4305d9784e65 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:38.433778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9c4b8e0c-11b1-4808-9b78-4305d9784e65 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:38.439197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-ebeaa0d4-4aa0-4882-bf78-dac8756c874b req-c417b10d-ad38-4eef-8a70-fbc26bc908db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a91ed7-306e-4904-8935-50892fa1e6c6", "tag": "eb94ab59-2c5c-4438-a1d2-1cf9c5097f71"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:38.456183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9c4b8e0c-11b1-4808-9b78-4305d9784e65 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:38.456701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9c4b8e0c-11b1-4808-9b78-4305d9784e65 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:38.457176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9c4b8e0c-11b1-4808-9b78-4305d9784e65 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:38.457876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9c4b8e0c-11b1-4808-9b78-4305d9784e65 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:38.458658 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9c4b8e0c-11b1-4808-9b78-4305d9784e65 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:38.459290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9c4b8e0c-11b1-4808-9b78-4305d9784e65 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:38.465287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-ebeaa0d4-4aa0-4882-bf78-dac8756c874b req-c417b10d-ad38-4eef-8a70-fbc26bc908db service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:38.467979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-ebeaa0d4-4aa0-4882-bf78-dac8756c874b req-c417b10d-ad38-4eef-8a70-fbc26bc908db service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:38.467979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-ebeaa0d4-4aa0-4882-bf78-dac8756c874b req-c417b10d-ad38-4eef-8a70-fbc26bc908db service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:38.501340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-ebeaa0d4-4aa0-4882-bf78-dac8756c874b req-c417b10d-ad38-4eef-8a70-fbc26bc908db service nova] Creating event network-changed:eb94ab59-2c5c-4438-a1d2-1cf9c5097f71 for instance 32a91ed7-306e-4904-8935-50892fa1e6c6 on hv-cinder-83697 Aug 08 08:46:38.506384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-ebeaa0d4-4aa0-4882-bf78-dac8756c874b req-c417b10d-ad38-4eef-8a70-fbc26bc908db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077852 Aug 08 08:46:38.507529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 287/597] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:38.513655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-eb47c908-c482-4d2b-9385-fa6891929770 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '.version_select at 0x7f4795a90280>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:38.598999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-eb47c908-c482-4d2b-9385-fa6891929770 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244088946" status: 202 len: 0 microversion: 2.1 time: 0.089826 Aug 08 08:46:38.599668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 288/598] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Aug 8 08:46:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244088946 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:46:38.766516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9c4b8e0c-11b1-4808-9b78-4305d9784e65 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:38.774520 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9c4b8e0c-11b1-4808-9b78-4305d9784e65 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1364 microversion: 2.1 time: 0.346451 Aug 08 08:46:38.775775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 311/599] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:38 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1364 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:39.795400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9ea07747-d4b8-486e-856e-9e7e626c4e74 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:39.796247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9ea07747-d4b8-486e-856e-9e7e626c4e74 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:39.798824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:39.804397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea07747-d4b8-486e-856e-9e7e626c4e74 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:39.804890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea07747-d4b8-486e-856e-9e7e626c4e74 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:39.805448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea07747-d4b8-486e-856e-9e7e626c4e74 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:39.806150 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea07747-d4b8-486e-856e-9e7e626c4e74 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:39.806611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea07747-d4b8-486e-856e-9e7e626c4e74 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:39.807038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea07747-d4b8-486e-856e-9e7e626c4e74 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:39.943324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9ea07747-d4b8-486e-856e-9e7e626c4e74 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:39.951485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9ea07747-d4b8-486e-856e-9e7e626c4e74 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1364 microversion: 2.1 time: 0.160174 Aug 08 08:46:39.952053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 289/600] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:39 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:40.707395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-42a6208e-c929-40f8-b184-9368cd957b74 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:40.707929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-42a6208e-c929-40f8-b184-9368cd957b74 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:40.714375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42a6208e-c929-40f8-b184-9368cd957b74 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:40.715425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42a6208e-c929-40f8-b184-9368cd957b74 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:40.718158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42a6208e-c929-40f8-b184-9368cd957b74 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:40.718158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42a6208e-c929-40f8-b184-9368cd957b74 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:40.718158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42a6208e-c929-40f8-b184-9368cd957b74 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:40.718158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42a6208e-c929-40f8-b184-9368cd957b74 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:40.740967 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-42a6208e-c929-40f8-b184-9368cd957b74 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lazy-loading 'flavor' on Instance uuid c2e00a03-eab8-4b60-bb8d-84093fbe9b22 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:46:40.971928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-da1c893a-3270-4116-a8e3-2b691ad3f1c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:40.972540 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-da1c893a-3270-4116-a8e3-2b691ad3f1c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:40.979756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da1c893a-3270-4116-a8e3-2b691ad3f1c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:40.980285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da1c893a-3270-4116-a8e3-2b691ad3f1c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:40.980725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da1c893a-3270-4116-a8e3-2b691ad3f1c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:40.981487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da1c893a-3270-4116-a8e3-2b691ad3f1c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:40.981938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da1c893a-3270-4116-a8e3-2b691ad3f1c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:40.982361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da1c893a-3270-4116-a8e3-2b691ad3f1c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:41.114020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-da1c893a-3270-4116-a8e3-2b691ad3f1c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:41.116186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:41.122170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-da1c893a-3270-4116-a8e3-2b691ad3f1c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1364 microversion: 2.1 time: 0.154058 Aug 08 08:46:41.129929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 290/601] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:40 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:46:41.257046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-42a6208e-c929-40f8-b184-9368cd957b74 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "POST /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/action" status: 202 len: 0 microversion: 2.20 time: 0.553526 Aug 08 08:46:41.257889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 312/602] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Aug 8 08:46:40 2022] POST /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:46:41.266213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:41.266851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:41.273658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:41.274152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:41.274596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:41.275325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:41.275785 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:41.276216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:41.410885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:41.419658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:41.420968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:41.422158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4e872219-c2b6-43b8-be44-9c8cb9e85a0f tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.159975 Aug 08 08:46:41.422707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 291/603] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:41 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:42.139852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:42.140627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=16 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:42.145212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e3b0c1a6-4b4c-42cc-813c-e4c7c514d77c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:42.145908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e3b0c1a6-4b4c-42cc-813c-e4c7c514d77c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:42.151984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b0c1a6-4b4c-42cc-813c-e4c7c514d77c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:42.152491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b0c1a6-4b4c-42cc-813c-e4c7c514d77c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:42.152923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b0c1a6-4b4c-42cc-813c-e4c7c514d77c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:42.153885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b0c1a6-4b4c-42cc-813c-e4c7c514d77c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:42.154336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b0c1a6-4b4c-42cc-813c-e4c7c514d77c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:42.159700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b0c1a6-4b4c-42cc-813c-e4c7c514d77c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:42.286369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e3b0c1a6-4b4c-42cc-813c-e4c7c514d77c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:42.293718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e3b0c1a6-4b4c-42cc-813c-e4c7c514d77c tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1364 microversion: 2.1 time: 0.154865 Aug 08 08:46:42.294311 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 313/604] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:42 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:42.445646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:42.446387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:42.448686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=8 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:42.456905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:42.457440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:42.457879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:42.458589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:42.459082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:42.459508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:42.603214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:42.611962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:42.613549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:42.614702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-87a4591a-2e29-4a8e-95bd-e4e0f7fd6e17 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.173052 Aug 08 08:46:42.615259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 292/605] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:42 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:42.652756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-28132d32-acb6-4479-932e-983adab88647 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:42.653361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-28132d32-acb6-4479-932e-983adab88647 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:42.659330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28132d32-acb6-4479-932e-983adab88647 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:42.659817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28132d32-acb6-4479-932e-983adab88647 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:42.660253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28132d32-acb6-4479-932e-983adab88647 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:42.660947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28132d32-acb6-4479-932e-983adab88647 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:42.661451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28132d32-acb6-4479-932e-983adab88647 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:42.661867 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28132d32-acb6-4479-932e-983adab88647 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:42.687255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-28132d32-acb6-4479-932e-983adab88647 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:46:42.950138 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-28132d32-acb6-4479-932e-983adab88647 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 204 len: 0 microversion: 2.1 time: 0.300820 Aug 08 08:46:42.950758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 314/606] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:46:42 2022] DELETE /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:46:42.958850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-78e5add2-538a-4a93-87c8-c945a252d0f1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:42.959459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-78e5add2-538a-4a93-87c8-c945a252d0f1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:42.965506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78e5add2-538a-4a93-87c8-c945a252d0f1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:42.966680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78e5add2-538a-4a93-87c8-c945a252d0f1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:42.967202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78e5add2-538a-4a93-87c8-c945a252d0f1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:42.967923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78e5add2-538a-4a93-87c8-c945a252d0f1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:42.968374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78e5add2-538a-4a93-87c8-c945a252d0f1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:42.968797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-78e5add2-538a-4a93-87c8-c945a252d0f1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:43.094979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-78e5add2-538a-4a93-87c8-c945a252d0f1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:43.102383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-78e5add2-538a-4a93-87c8-c945a252d0f1 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1508 microversion: 2.1 time: 0.147554 Aug 08 08:46:43.102941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 293/607] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:42 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:43.315677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0e9822a9-0222-452d-9d16-cf06f85ca49a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:43.316292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0e9822a9-0222-452d-9d16-cf06f85ca49a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:43.322560 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e9822a9-0222-452d-9d16-cf06f85ca49a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:43.323049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e9822a9-0222-452d-9d16-cf06f85ca49a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:43.323489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e9822a9-0222-452d-9d16-cf06f85ca49a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:43.324178 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e9822a9-0222-452d-9d16-cf06f85ca49a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:43.324665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e9822a9-0222-452d-9d16-cf06f85ca49a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:43.325106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e9822a9-0222-452d-9d16-cf06f85ca49a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:43.452088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0e9822a9-0222-452d-9d16-cf06f85ca49a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:43.459274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0e9822a9-0222-452d-9d16-cf06f85ca49a tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1364 microversion: 2.1 time: 0.147918 Aug 08 08:46:43.459852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 315/608] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:43 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:43.637448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:43.638108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:43.644486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:43.644970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:43.645446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:43.646133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:43.646591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:43.647017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:43.779134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:43.787255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:43.788854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:43.790026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6362f05f-0bcd-4c94-9bb0-f5e73ccea5c7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.156494 Aug 08 08:46:43.790588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 294/609] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:43 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:43.970072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-3c35a3d0-83b2-4837-a6ff-04f7d7e0357f req-e5f3852b-654e-43b9-951d-8bb7a8053071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a91ed7-306e-4904-8935-50892fa1e6c6", "name": "network-vif-plugged", "status": "completed", "tag": "eb94ab59-2c5c-4438-a1d2-1cf9c5097f71"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:43.979828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-3c35a3d0-83b2-4837-a6ff-04f7d7e0357f req-e5f3852b-654e-43b9-951d-8bb7a8053071 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:43.980312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-3c35a3d0-83b2-4837-a6ff-04f7d7e0357f req-e5f3852b-654e-43b9-951d-8bb7a8053071 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:43.980747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-3c35a3d0-83b2-4837-a6ff-04f7d7e0357f req-e5f3852b-654e-43b9-951d-8bb7a8053071 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:43.984887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:43.992192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-3c35a3d0-83b2-4837-a6ff-04f7d7e0357f req-e5f3852b-654e-43b9-951d-8bb7a8053071 service nova] Creating event network-vif-plugged:eb94ab59-2c5c-4438-a1d2-1cf9c5097f71 for instance 32a91ed7-306e-4904-8935-50892fa1e6c6 on hv-cinder-83697 Aug 08 08:46:43.997051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-3c35a3d0-83b2-4837-a6ff-04f7d7e0357f req-e5f3852b-654e-43b9-951d-8bb7a8053071 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031265 Aug 08 08:46:43.997676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 316/610] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:44.123003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-003914af-c680-42ee-9573-81f2b7bde42d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:44.123696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-003914af-c680-42ee-9573-81f2b7bde42d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:44.129913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-003914af-c680-42ee-9573-81f2b7bde42d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:44.130416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-003914af-c680-42ee-9573-81f2b7bde42d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:44.130857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-003914af-c680-42ee-9573-81f2b7bde42d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:44.131554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-003914af-c680-42ee-9573-81f2b7bde42d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:44.132010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-003914af-c680-42ee-9573-81f2b7bde42d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:44.132436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-003914af-c680-42ee-9573-81f2b7bde42d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:44.259850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-003914af-c680-42ee-9573-81f2b7bde42d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:44.267884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-003914af-c680-42ee-9573-81f2b7bde42d tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1508 microversion: 2.1 time: 0.148782 Aug 08 08:46:44.268451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 295/611] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:44 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:44.482072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9b336c01-264b-4a4f-9e81-f04c996677fa tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:44.482694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9b336c01-264b-4a4f-9e81-f04c996677fa tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:44.489213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b336c01-264b-4a4f-9e81-f04c996677fa tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:44.489730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b336c01-264b-4a4f-9e81-f04c996677fa tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:44.490170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b336c01-264b-4a4f-9e81-f04c996677fa tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:44.490862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b336c01-264b-4a4f-9e81-f04c996677fa tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:44.491323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b336c01-264b-4a4f-9e81-f04c996677fa tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:44.491751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b336c01-264b-4a4f-9e81-f04c996677fa tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:44.628803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9b336c01-264b-4a4f-9e81-f04c996677fa tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:44.636209 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9b336c01-264b-4a4f-9e81-f04c996677fa tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1364 microversion: 2.1 time: 0.159738 Aug 08 08:46:44.636795 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 317/612] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:44 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:44.814190 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:44.814763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:44.821052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:44.821573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:44.822010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:44.822695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:44.823151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:44.823577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:44.949759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:44.961222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:44.962740 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:44.964110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1c5ae254-4c60-4350-a3f8-8ea009ebf665 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.154586 Aug 08 08:46:44.964690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 296/613] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:44 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:45.287973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f5f26223-8f91-412c-995a-ba1c5374c8c8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:45.288710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f5f26223-8f91-412c-995a-ba1c5374c8c8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:45.295776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5f26223-8f91-412c-995a-ba1c5374c8c8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:45.296293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5f26223-8f91-412c-995a-ba1c5374c8c8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:45.296736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5f26223-8f91-412c-995a-ba1c5374c8c8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:45.297475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5f26223-8f91-412c-995a-ba1c5374c8c8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:45.297941 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5f26223-8f91-412c-995a-ba1c5374c8c8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:45.298378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5f26223-8f91-412c-995a-ba1c5374c8c8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:45.481082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f5f26223-8f91-412c-995a-ba1c5374c8c8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:45.490188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f5f26223-8f91-412c-995a-ba1c5374c8c8 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1508 microversion: 2.1 time: 0.205949 Aug 08 08:46:45.490723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 318/614] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:45 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:45.657240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f45c3f20-ea8d-48b6-9fcc-5a1cfb9c0f2e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:45.657860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f45c3f20-ea8d-48b6-9fcc-5a1cfb9c0f2e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:45.663868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f45c3f20-ea8d-48b6-9fcc-5a1cfb9c0f2e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:45.664353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f45c3f20-ea8d-48b6-9fcc-5a1cfb9c0f2e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:45.664820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f45c3f20-ea8d-48b6-9fcc-5a1cfb9c0f2e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:45.665547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f45c3f20-ea8d-48b6-9fcc-5a1cfb9c0f2e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:45.666003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f45c3f20-ea8d-48b6-9fcc-5a1cfb9c0f2e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:45.666432 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f45c3f20-ea8d-48b6-9fcc-5a1cfb9c0f2e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:45.803421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-2ecfb4b0-a26b-4576-8597-413b8cdf9aaa req-c008c1ea-baaf-4089-bde5-2fcd50748d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7125c9bf-f883-4fde-b50a-031fadb4cac1", "name": "network-vif-deleted", "tag": "dec57a28-51ce-4c11-9486-8775c1cdfc54"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:45.811167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f45c3f20-ea8d-48b6-9fcc-5a1cfb9c0f2e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:45.818242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2ecfb4b0-a26b-4576-8597-413b8cdf9aaa req-c008c1ea-baaf-4089-bde5-2fcd50748d72 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:45.818729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2ecfb4b0-a26b-4576-8597-413b8cdf9aaa req-c008c1ea-baaf-4089-bde5-2fcd50748d72 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:45.819159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2ecfb4b0-a26b-4576-8597-413b8cdf9aaa req-c008c1ea-baaf-4089-bde5-2fcd50748d72 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:45.822662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f45c3f20-ea8d-48b6-9fcc-5a1cfb9c0f2e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1364 microversion: 2.1 time: 0.167789 Aug 08 08:46:45.822662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 297/615] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:45 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:45.831685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-2ecfb4b0-a26b-4576-8597-413b8cdf9aaa req-c008c1ea-baaf-4089-bde5-2fcd50748d72 service nova] Creating event network-vif-deleted:dec57a28-51ce-4c11-9486-8775c1cdfc54 for instance 7125c9bf-f883-4fde-b50a-031fadb4cac1 on hv-cinder-83697 Aug 08 08:46:45.836753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-2ecfb4b0-a26b-4576-8597-413b8cdf9aaa req-c008c1ea-baaf-4089-bde5-2fcd50748d72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040178 Aug 08 08:46:45.837712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 319/616] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:45.988816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:45.989386 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:45.995488 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:45.995971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:45.996406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:45.997621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:45.998074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:45.998552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:46.133578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:46.142054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:46.143563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:46.144719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fef4abcd-e6a5-469d-97e9-cbbae4df79ad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.159896 Aug 08 08:46:46.145393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 298/617] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:45 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:46.511276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:46.512003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:46.518642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:46.519134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:46.519578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:46.520273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:46.520732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:46.521183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:46.552318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:46.552805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:46.553271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:46.553717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lazy-loading 'fault' on Instance uuid 7125c9bf-f883-4fde-b50a-031fadb4cac1 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:46:46.593855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:46.601205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c2e565bf-39bc-4c09-9324-d1a81d399d3a tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 200 len: 1312 microversion: 2.1 time: 0.094105 Aug 08 08:46:46.601769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 320/618] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:46 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:46.841508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-89a91529-90d7-4b62-888d-4478a1af796f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:46.842048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-89a91529-90d7-4b62-888d-4478a1af796f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:46.848449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89a91529-90d7-4b62-888d-4478a1af796f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:46.848932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89a91529-90d7-4b62-888d-4478a1af796f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:46.849421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89a91529-90d7-4b62-888d-4478a1af796f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:46.850203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89a91529-90d7-4b62-888d-4478a1af796f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:46.850662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89a91529-90d7-4b62-888d-4478a1af796f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:46.851078 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89a91529-90d7-4b62-888d-4478a1af796f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:46.980299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-89a91529-90d7-4b62-888d-4478a1af796f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:46.988489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-89a91529-90d7-4b62-888d-4478a1af796f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1364 microversion: 2.1 time: 0.151118 Aug 08 08:46:46.989053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 299/619] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:46 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:47.167847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:47.168484 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:47.175020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:47.175508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:47.175946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:47.176637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:47.177097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:47.177550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:47.556451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:47.565268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:47.566763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:47.567916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-68a04d7a-8523-4884-908a-81a4358076a7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.403991 Aug 08 08:46:47.568462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 321/620] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:47 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:47.622508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:47.623118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 7125c9bf-f883-4fde-b50a-031fadb4cac1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:47.628974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:47.629497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:47.629941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:47.630624 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:47.631080 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:47.631533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:47.644604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] HTTP exception thrown: Instance 7125c9bf-f883-4fde-b50a-031fadb4cac1 could not be found. Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Request method failure captured: Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 HTTP/1.1 Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxL2F7ZuGskPSxhai7x0oCP1vO9ils3SnaQq8McZIlcSa0VOxLWO6VilcGbV94Kh5zwVgCfUYE97a1dvb13NYbQkeUAJAoUQrR8y52k20in8oG8jaOnuESYqYBI_dUu-rSkgOop2uVpELpc5_TxTQGz7w12k7peMHSN-XCHDlBqsUo Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 2a4e5c5a950c4047b15749aace25f46d Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:46:47.646246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 2a4e5c5a950c4047b15749aace25f46d Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-ServerRescueNegativeTestJSON-7596386-project Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 00e07188d3df4d958ce83085b7bb141a Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-ServerRescueNegativeTestJSON-7596386-project Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 7125c9bf-f883-4fde-b50a-031fadb4cac1 could not be found. Aug 08 08:46:47.647786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '7125c9bf-f883-4fde-b50a-031fadb4cac1'} Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7125c9bf-f883-4fde-b50a-031fadb4cac1 could not be found. Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:47.648675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7125c9bf-f883-4fde-b50a-031fadb4cac1 could not be found. Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7125c9bf-f883-4fde-b50a-031fadb4cac1 could not be found. Aug 08 08:46:47.649978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:47.651259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Returning 404 to user: Instance 7125c9bf-f883-4fde-b50a-031fadb4cac1 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:47.651259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0e4b0c01-ef55-4745-85aa-31609ec22753 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1" status: 404 len: 111 microversion: 2.1 time: 0.029584 Aug 08 08:46:47.651259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 300/621] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:47 2022] GET /compute/v2.1/servers/7125c9bf-f883-4fde-b50a-031fadb4cac1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:46:47.656972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0eebc02e-776d-45d0-913d-3d9e25d284ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:47.657508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0eebc02e-776d-45d0-913d-3d9e25d284ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:47.663621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eebc02e-776d-45d0-913d-3d9e25d284ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:47.664113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eebc02e-776d-45d0-913d-3d9e25d284ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:47.664555 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eebc02e-776d-45d0-913d-3d9e25d284ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:47.665330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eebc02e-776d-45d0-913d-3d9e25d284ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:47.665798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eebc02e-776d-45d0-913d-3d9e25d284ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:47.666232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eebc02e-776d-45d0-913d-3d9e25d284ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:47.692534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0eebc02e-776d-45d0-913d-3d9e25d284ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:46:47.926475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0eebc02e-776d-45d0-913d-3d9e25d284ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 204 len: 0 microversion: 2.1 time: 0.273548 Aug 08 08:46:47.927055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 322/622] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:46:47 2022] DELETE /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:46:47.990481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a47f205a-8799-48bb-9993-9521605235b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:47.991099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a47f205a-8799-48bb-9993-9521605235b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:47.997253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a47f205a-8799-48bb-9993-9521605235b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:47.997744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a47f205a-8799-48bb-9993-9521605235b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:47.998219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a47f205a-8799-48bb-9993-9521605235b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:47.998912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a47f205a-8799-48bb-9993-9521605235b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:47.999369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a47f205a-8799-48bb-9993-9521605235b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:47.999798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a47f205a-8799-48bb-9993-9521605235b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:48.066944 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-236fbc22-5d15-4432-ad73-d474de729ece tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:48.067645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-236fbc22-5d15-4432-ad73-d474de729ece tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:48.073555 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236fbc22-5d15-4432-ad73-d474de729ece tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:48.074042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236fbc22-5d15-4432-ad73-d474de729ece tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:48.074477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236fbc22-5d15-4432-ad73-d474de729ece tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:48.075333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236fbc22-5d15-4432-ad73-d474de729ece tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:48.075799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236fbc22-5d15-4432-ad73-d474de729ece tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:48.076223 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236fbc22-5d15-4432-ad73-d474de729ece tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:48.160402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a47f205a-8799-48bb-9993-9521605235b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:48.167890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a47f205a-8799-48bb-9993-9521605235b2 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.236697 Aug 08 08:46:48.168458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 301/623] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:47 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:48.224983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-236fbc22-5d15-4432-ad73-d474de729ece tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:48.233359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-236fbc22-5d15-4432-ad73-d474de729ece tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1550 microversion: 2.1 time: 0.227069 Aug 08 08:46:48.233917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 323/624] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:48 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1550 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:46:48.252808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-40f753b4-9bc2-4296-931b-8e5dc2e20d73 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:48.253348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-40f753b4-9bc2-4296-931b-8e5dc2e20d73 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:48.259151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40f753b4-9bc2-4296-931b-8e5dc2e20d73 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:48.259642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40f753b4-9bc2-4296-931b-8e5dc2e20d73 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:48.260085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40f753b4-9bc2-4296-931b-8e5dc2e20d73 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:48.260775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40f753b4-9bc2-4296-931b-8e5dc2e20d73 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:48.261263 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40f753b4-9bc2-4296-931b-8e5dc2e20d73 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:48.261694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40f753b4-9bc2-4296-931b-8e5dc2e20d73 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:48.336342 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-40f753b4-9bc2-4296-931b-8e5dc2e20d73 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087291 Aug 08 08:46:48.336932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 302/625] 10.222.0.33 () {58 vars in 1275 bytes} [Mon Aug 8 08:46:48 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:48.592310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:48.592872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:48.599350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:48.599839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:48.600275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:48.600976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:48.601465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:48.601893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:48.841800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:48.849843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:48.851291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:48.852449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d4a4c4ba-d3ee-4653-b2ba-00688fe960db tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.264420 Aug 08 08:46:48.853006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 324/626] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:48 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:49.190556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-babd0db1-9366-4da2-bf5f-13917236d6ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:49.191157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-babd0db1-9366-4da2-bf5f-13917236d6ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:49.197517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-babd0db1-9366-4da2-bf5f-13917236d6ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:49.198013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-babd0db1-9366-4da2-bf5f-13917236d6ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:49.198458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-babd0db1-9366-4da2-bf5f-13917236d6ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:49.199155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-babd0db1-9366-4da2-bf5f-13917236d6ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:49.199617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-babd0db1-9366-4da2-bf5f-13917236d6ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:49.200646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-babd0db1-9366-4da2-bf5f-13917236d6ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:49.390513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-babd0db1-9366-4da2-bf5f-13917236d6ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:49.398041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-babd0db1-9366-4da2-bf5f-13917236d6ca tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.212538 Aug 08 08:46:49.398611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 303/627] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:49 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:49.484150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-91f7cdf3-4a69-40dd-963a-140653b9a600 req-2a818e3b-98cb-48bc-9b72-12268c823590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a91ed7-306e-4904-8935-50892fa1e6c6", "tag": "eb94ab59-2c5c-4438-a1d2-1cf9c5097f71"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:49.493927 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-91f7cdf3-4a69-40dd-963a-140653b9a600 req-2a818e3b-98cb-48bc-9b72-12268c823590 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:49.494408 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-91f7cdf3-4a69-40dd-963a-140653b9a600 req-2a818e3b-98cb-48bc-9b72-12268c823590 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:49.494838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-91f7cdf3-4a69-40dd-963a-140653b9a600 req-2a818e3b-98cb-48bc-9b72-12268c823590 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:49.508091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-91f7cdf3-4a69-40dd-963a-140653b9a600 req-2a818e3b-98cb-48bc-9b72-12268c823590 service nova] Creating event network-changed:eb94ab59-2c5c-4438-a1d2-1cf9c5097f71 for instance 32a91ed7-306e-4904-8935-50892fa1e6c6 on hv-cinder-83697 Aug 08 08:46:49.513246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-91f7cdf3-4a69-40dd-963a-140653b9a600 req-2a818e3b-98cb-48bc-9b72-12268c823590 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032788 Aug 08 08:46:49.513832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 325/628] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:49.876735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:49.877642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:49.883857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:49.884351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:49.884787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:49.885515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:49.885996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:49.886425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:50.019011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:50.026903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:50.028941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:50.030118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-390e445b-05a3-4b33-a2fa-eca9d017b2d8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.157301 Aug 08 08:46:50.030677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 304/629] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:49 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:50.420802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2fe5b4ba-6751-4790-ba88-b1b091816c46 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:50.421527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2fe5b4ba-6751-4790-ba88-b1b091816c46 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:50.427649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe5b4ba-6751-4790-ba88-b1b091816c46 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:50.428136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe5b4ba-6751-4790-ba88-b1b091816c46 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:50.428577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe5b4ba-6751-4790-ba88-b1b091816c46 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:50.429297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe5b4ba-6751-4790-ba88-b1b091816c46 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:50.429757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe5b4ba-6751-4790-ba88-b1b091816c46 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:50.430183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe5b4ba-6751-4790-ba88-b1b091816c46 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:50.559632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2fe5b4ba-6751-4790-ba88-b1b091816c46 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:50.567544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2fe5b4ba-6751-4790-ba88-b1b091816c46 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.151704 Aug 08 08:46:50.568100 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 326/630] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:50 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:51.051794 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:51.052407 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:51.058686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:51.059273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:51.059715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:51.060569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:51.061022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:51.061750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:51.200849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:51.209238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:51.210856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:51.212047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-55970f19-0eb9-4f86-b9cf-eaf2b5e43ca1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.164113 Aug 08 08:46:51.212819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 305/631] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:51 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:51.588098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9f157941-4df2-4d86-98c3-7eb4c43b3e85 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:51.588896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9f157941-4df2-4d86-98c3-7eb4c43b3e85 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:51.601765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f157941-4df2-4d86-98c3-7eb4c43b3e85 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:51.602239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f157941-4df2-4d86-98c3-7eb4c43b3e85 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:51.602670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f157941-4df2-4d86-98c3-7eb4c43b3e85 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:51.603372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f157941-4df2-4d86-98c3-7eb4c43b3e85 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:51.604081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f157941-4df2-4d86-98c3-7eb4c43b3e85 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:51.604505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f157941-4df2-4d86-98c3-7eb4c43b3e85 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:51.852235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9f157941-4df2-4d86-98c3-7eb4c43b3e85 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:51.866383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9f157941-4df2-4d86-98c3-7eb4c43b3e85 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1521 microversion: 2.1 time: 0.281919 Aug 08 08:46:51.866969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 327/632] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:51 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:52.207220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-1be30ce7-a4a2-458e-bbe2-35219df2feb2 req-265e84d7-2ae6-4c00-bdb0-023e18217753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec8f653-4fc1-4f77-a832-768f73782b17", "name": "network-vif-deleted", "tag": "a272eb6d-b0c0-4037-a16a-be5cad0542fd"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:52.217744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-1be30ce7-a4a2-458e-bbe2-35219df2feb2 req-265e84d7-2ae6-4c00-bdb0-023e18217753 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:52.218244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-1be30ce7-a4a2-458e-bbe2-35219df2feb2 req-265e84d7-2ae6-4c00-bdb0-023e18217753 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:52.221914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-1be30ce7-a4a2-458e-bbe2-35219df2feb2 req-265e84d7-2ae6-4c00-bdb0-023e18217753 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:52.230097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-1be30ce7-a4a2-458e-bbe2-35219df2feb2 req-265e84d7-2ae6-4c00-bdb0-023e18217753 service nova] Creating event network-vif-deleted:a272eb6d-b0c0-4037-a16a-be5cad0542fd for instance 1ec8f653-4fc1-4f77-a832-768f73782b17 on hv-cinder-83697 Aug 08 08:46:52.236008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-1be30ce7-a4a2-458e-bbe2-35219df2feb2 req-265e84d7-2ae6-4c00-bdb0-023e18217753 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032473 Aug 08 08:46:52.236477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:52.236604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 306/633] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:46:52.237177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:52.243589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:52.244091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:52.248149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:52.248149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:52.248149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:52.248149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:52.383287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:52.391566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:52.393297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:52.394580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-82690e30-7be8-40db-8d0f-b5c4a7403678 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.163459 Aug 08 08:46:52.395213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 328/634] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:52 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:46:52.889169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:52.889818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:52.895995 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:52.896487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:52.896932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:52.897667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:52.898128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:52.898560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:52.929085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:52.929668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:52.930060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:52.930522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lazy-loading 'fault' on Instance uuid 1ec8f653-4fc1-4f77-a832-768f73782b17 {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:46:52.974025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e07188d3df4d958ce83085b7bb141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4e5c5a950c4047b15749aace25f46d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:52.982185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f930be6c-8e5b-42fd-ad13-332d4e429738 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 200 len: 1311 microversion: 2.1 time: 0.097821 Aug 08 08:46:52.982772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 307/635] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:52 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:46:53.417498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:53.419299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:53.425433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:53.425923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:53.426360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:53.427052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:53.427510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:53.427934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:53.554902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:53.562887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:53.564424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:53.565576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-637bfa5c-3314-4dc9-95ad-a15b401138ea tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.151956 Aug 08 08:46:53.566159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 329/636] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:53 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:54.003419 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:54.004051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] [instance: 1ec8f653-4fc1-4f77-a832-768f73782b17] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:54.010374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:54.010890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:54.011332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:54.012632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:54.019266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:54.019266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:54.026741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] HTTP exception thrown: Instance 1ec8f653-4fc1-4f77-a832-768f73782b17 could not be found. Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Request method failure captured: Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 HTTP/1.1 Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxL2F7ZuGskPSxhai7x0oCP1vO9ils3SnaQq8McZIlcSa0VOxLWO6VilcGbV94Kh5zwVgCfUYE97a1dvb13NYbQkeUAJAoUQrR8y52k20in8oG8jaOnuESYqYBI_dUu-rSkgOop2uVpELpc5_TxTQGz7w12k7peMHSN-XCHDlBqsUo Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 2a4e5c5a950c4047b15749aace25f46d Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:46:54.028394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a4e5c5a950c4047b15749aace25f46d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 2a4e5c5a950c4047b15749aace25f46d Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-7596386 Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-ServerRescueNegativeTestJSON-7596386-project Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 00e07188d3df4d958ce83085b7bb141a Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-ServerRescueNegativeTestJSON-7596386-project Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 1ec8f653-4fc1-4f77-a832-768f73782b17 could not be found. Aug 08 08:46:54.029853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '1ec8f653-4fc1-4f77-a832-768f73782b17'} Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ec8f653-4fc1-4f77-a832-768f73782b17 could not be found. Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:54.030988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ec8f653-4fc1-4f77-a832-768f73782b17 could not be found. Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ec8f653-4fc1-4f77-a832-768f73782b17 could not be found. Aug 08 08:46:54.032361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:46:54.033807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] Returning 404 to user: Instance 1ec8f653-4fc1-4f77-a832-768f73782b17 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:54.033807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9b58c903-e300-4f44-a88a-21dd72760334 tempest-ServerRescueNegativeTestJSON-7596386 tempest-ServerRescueNegativeTestJSON-7596386-project] 10.222.0.33 "GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17" status: 404 len: 111 microversion: 2.1 time: 0.030370 Aug 08 08:46:54.033807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 308/637] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:46:53 2022] GET /compute/v2.1/servers/1ec8f653-4fc1-4f77-a832-768f73782b17 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:46:54.587878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:54.588638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:54.595036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:54.595520 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:54.595951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:54.596637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:54.597088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:54.597533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:54.799893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:54.807919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:54.810075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:54.811238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bf3e1f9e-e193-46ec-9a92-e1a95c25efdd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.227260 Aug 08 08:46:54.811795 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 330/638] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:54 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:55.833840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:55.834455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:55.848563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:55.849011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:55.849486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:55.850434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:55.851195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:55.851813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:55.885192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:46:55.999766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:56.008272 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:56.009842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:56.012397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-61c20df3-49c7-4c5e-ba6c-66b57e09faad tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.181219 Aug 08 08:46:56.016856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 309/639] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:55 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:57.035541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:57.036115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:57.044117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:57.044117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:57.044369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:57.044964 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:57.045452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:57.045903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:57.205159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:57.216615 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:57.218260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:57.222487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ebff1e19-0441-48f1-9892-9c32276622ef tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1745 microversion: 2.20 time: 0.188092 Aug 08 08:46:57.222487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 331/640] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:57 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:58.243962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:58.244564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:58.251344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:58.251827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:58.252269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:58.252959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:58.253437 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:58.253861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:58.398652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:58.406760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:58.408289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:58.409468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5237c33a-afdc-4983-8717-3d98745b9825 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1745 microversion: 2.20 time: 0.169530 Aug 08 08:46:58.410016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 310/641] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:58 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:46:59.420943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d26dfb51-2723-4db6-b216-ba5cde7c797f tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Action: 'create', calling method: .version_select at 0x7f4795bde4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1173302260", "metadata": {"Type": "work"}}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:59.435058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:59.435685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d26dfb51-2723-4db6-b216-ba5cde7c797f tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Request method failure captured: Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 122 Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M2D7KEijNHF10YPQ4rtQzaEiqwYPEsnff8zCmTtrcX0k15I9L0-UdBrGvowxOD13GjEbwWSkY6uYgZwwsTg-MHlBidu9Kphp1x9tiOF15bheUSjc2Tt0XU5kQKWPx4SyEAYBEP1F4byndGrolaMRGa36KcF9g6PrqgKjVgYzpz1S68 Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:46:59.439778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: cccd76799a5140bc925f01e63abf45e2 Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1173302260", "metadata": {"Type": "work"}}} Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: Aug 08 08:46:59.441455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1173302260', 'metadata': {'Type': 'work'}}}} Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise error Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi '#$%' Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:59.442477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 08:46:59.444118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 08:46:59.445595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 08:46:59.445595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.445772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:59.445772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:59.445772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:59.445772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:46:59.446112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d26dfb51-2723-4db6-b216-ba5cde7c797f tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:59.446213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:46:59.446213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:46:59.447124 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d26dfb51-2723-4db6-b216-ba5cde7c797f tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.145471 Aug 08 08:46:59.448149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 332/642] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Aug 8 08:46:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 08:46:59.457420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a5292741-6298-4b7a-819e-b49ea714e275 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Action: 'create', calling method: .version_select at 0x7f4795b55d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1374965120", "metadata": {"Type": "work"}}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a5292741-6298-4b7a-819e-b49ea714e275 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Request method failure captured: Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 120 Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M2D7KEijNHF10YPQ4rtQzaEiqwYPEsnff8zCmTtrcX0k15I9L0-UdBrGvowxOD13GjEbwWSkY6uYgZwwsTg-MHlBidu9Kphp1x9tiOF15bheUSjc2Tt0XU5kQKWPx4SyEAYBEP1F4byndGrolaMRGa36KcF9g6PrqgKjVgYzpz1S68 Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:46:59.462096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: cccd76799a5140bc925f01e63abf45e2 Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1374965120", "metadata": {"Type": "work"}}} Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: Aug 08 08:46:59.463649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1374965120', 'metadata': {'Type': 'work'}}}} Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise error Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi '0' Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:59.464596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 08:46:59.466585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 08:46:59.467860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 08:46:59.467860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.467860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a5292741-6298-4b7a-819e-b49ea714e275 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:59.467860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a5292741-6298-4b7a-819e-b49ea714e275 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010133 Aug 08 08:46:59.467860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 333/643] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Aug 8 08:46:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 08:46:59.478278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d94e167a-8f1b-4346-af11-4623ee99b202 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Action: 'create', calling method: .version_select at 0x7f4795c38e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1585545599", "metadata": {"Type": "work"}}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d94e167a-8f1b-4346-af11-4623ee99b202 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Request method failure captured: Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 119 Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M2D7KEijNHF10YPQ4rtQzaEiqwYPEsnff8zCmTtrcX0k15I9L0-UdBrGvowxOD13GjEbwWSkY6uYgZwwsTg-MHlBidu9Kphp1x9tiOF15bheUSjc2Tt0XU5kQKWPx4SyEAYBEP1F4byndGrolaMRGa36KcF9g6PrqgKjVgYzpz1S68 Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:46:59.482596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: cccd76799a5140bc925f01e63abf45e2 Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1585545599", "metadata": {"Type": "work"}}} Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: Aug 08 08:46:59.484183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1585545599', 'metadata': {'Type': 'work'}}}} Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise error Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi '' Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:59.491668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 08:46:59.493604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 08:46:59.494936 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 08:46:59.494936 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.494936 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d94e167a-8f1b-4346-af11-4623ee99b202 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:59.494936 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d94e167a-8f1b-4346-af11-4623ee99b202 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010574 Aug 08 08:46:59.494936 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 334/644] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Aug 8 08:46:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 08:46:59.502211 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8d1604ac-d67b-43a2-a10c-fff5c5523473 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Calling method '.version_select at 0x7f4795c11ee0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:59.537980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-8d1604ac-d67b-43a2-a10c-fff5c5523473 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] HTTP exception thrown: Volume tempest-invalid-2003613916 could not be found. Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8d1604ac-d67b-43a2-a10c-fff5c5523473 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Request method failure captured: Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2003613916 HTTP/1.1 Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M2D7KEijNHF10YPQ4rtQzaEiqwYPEsnff8zCmTtrcX0k15I9L0-UdBrGvowxOD13GjEbwWSkY6uYgZwwsTg-MHlBidu9Kphp1x9tiOF15bheUSjc2Tt0XU5kQKWPx4SyEAYBEP1F4byndGrolaMRGa36KcF9g6PrqgKjVgYzpz1S68 Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:46:59.540182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: cccd76799a5140bc925f01e63abf45e2 Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Volume tempest-invalid-2003613916 could not be found. Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'tempest-invalid-2003613916'} Aug 08 08:46:59.541750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2003613916 could not be found. (HTTP 404) (Request-ID: req-483f470d-dffd-4be4-a94b-df8034a2c448) Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.542621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 08:46:59.545595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2003613916 could not be found. Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:46:59.548364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2003613916 could not be found. Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2003613916 could not be found. Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8d1604ac-d67b-43a2-a10c-fff5c5523473 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Returning 404 to user: Volume tempest-invalid-2003613916 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8d1604ac-d67b-43a2-a10c-fff5c5523473 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2003613916" status: 404 len: 99 microversion: 2.1 time: 0.043866 Aug 08 08:46:59.550253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 335/645] 10.222.0.33 () {58 vars in 1218 bytes} [Mon Aug 8 08:46:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2003613916 => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 08 08:46:59.556852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-acbcf79d-a869-45d0-a0a4-392280ad865e tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007458 Aug 08 08:46:59.556852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 336/646] 10.222.0.33 () {58 vars in 1140 bytes} [Mon Aug 8 08:46:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 08:46:59.566418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-47f158f3-436e-4b66-9968-5db6bfc7f0e2 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003980 Aug 08 08:46:59.566958 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 337/647] 10.222.0.33 () {58 vars in 1137 bytes} [Mon Aug 8 08:46:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 08 08:46:59.575831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b34942d1-3bce-4622-8ab3-8fe13355f505 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Calling method '.version_select at 0x7f4795bdedc0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:59.605314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-b34942d1-3bce-4622-8ab3-8fe13355f505 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] HTTP exception thrown: Volume 3070df1c-51bc-4fda-96e3-2ae05c8e6f50 could not be found. Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b34942d1-3bce-4622-8ab3-8fe13355f505 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Request method failure captured: Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: DELETE /compute/v2.1/os-volumes/3070df1c-51bc-4fda-96e3-2ae05c8e6f50 HTTP/1.1 Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M2D7KEijNHF10YPQ4rtQzaEiqwYPEsnff8zCmTtrcX0k15I9L0-UdBrGvowxOD13GjEbwWSkY6uYgZwwsTg-MHlBidu9Kphp1x9tiOF15bheUSjc2Tt0XU5kQKWPx4SyEAYBEP1F4byndGrolaMRGa36KcF9g6PrqgKjVgYzpz1S68 Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:46:59.607746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: cccd76799a5140bc925f01e63abf45e2 Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Volume 3070df1c-51bc-4fda-96e3-2ae05c8e6f50 could not be found. Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '3070df1c-51bc-4fda-96e3-2ae05c8e6f50'} Aug 08 08:46:59.609422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3070df1c-51bc-4fda-96e3-2ae05c8e6f50 could not be found. (HTTP 404) (Request-ID: req-3f351e2e-8ffd-4adb-88c1-e0199720880a) Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.610376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 08:46:59.611896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3070df1c-51bc-4fda-96e3-2ae05c8e6f50 could not be found. Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 08:46:59.612996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3070df1c-51bc-4fda-96e3-2ae05c8e6f50 could not be found. Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3070df1c-51bc-4fda-96e3-2ae05c8e6f50 could not be found. Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b34942d1-3bce-4622-8ab3-8fe13355f505 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Returning 404 to user: Volume 3070df1c-51bc-4fda-96e3-2ae05c8e6f50 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b34942d1-3bce-4622-8ab3-8fe13355f505 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/3070df1c-51bc-4fda-96e3-2ae05c8e6f50" status: 404 len: 109 microversion: 2.1 time: 0.037440 Aug 08 08:46:59.614576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 338/648] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 08:46:59 2022] DELETE /compute/v2.1/os-volumes/3070df1c-51bc-4fda-96e3-2ae05c8e6f50 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 08:46:59.616317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:59.620683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:59.622273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:46:59.625567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-af21ff0b-eb40-49be-af4e-bc3f8cfc488a tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1740 microversion: 2.20 time: 0.193406 Aug 08 08:46:59.625718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dc363029-e636-4bdb-a3e3-ea40802e43c8 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Calling method '.version_select at 0x7f4795d3f820>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:46:59.625839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 311/649] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:46:59 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:46:59.665899 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-dc363029-e636-4bdb-a3e3-ea40802e43c8 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] HTTP exception thrown: Volume 511718d0-60a2-47b3-9070-b40f391e96b6 could not be found. Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dc363029-e636-4bdb-a3e3-ea40802e43c8 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Request method failure captured: Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/os-volumes/511718d0-60a2-47b3-9070-b40f391e96b6 HTTP/1.1 Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M2D7KEijNHF10YPQ4rtQzaEiqwYPEsnff8zCmTtrcX0k15I9L0-UdBrGvowxOD13GjEbwWSkY6uYgZwwsTg-MHlBidu9Kphp1x9tiOF15bheUSjc2Tt0XU5kQKWPx4SyEAYBEP1F4byndGrolaMRGa36KcF9g6PrqgKjVgYzpz1S68 Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:46:59.667831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a263438c78bf4c34be8f427c12d8a291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: a263438c78bf4c34be8f427c12d8a291 Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-VolumesNegativeTest-1510075298 Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: cccd76799a5140bc925f01e63abf45e2 Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-VolumesNegativeTest-1510075298-project Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Volume 511718d0-60a2-47b3-9070-b40f391e96b6 could not be found. Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '511718d0-60a2-47b3-9070-b40f391e96b6'} Aug 08 08:46:59.669128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 511718d0-60a2-47b3-9070-b40f391e96b6 could not be found. (HTTP 404) (Request-ID: req-e5665ddd-d599-42b3-bb4f-d7e3fbea1366) Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.670136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 08:46:59.674500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 511718d0-60a2-47b3-9070-b40f391e96b6 could not be found. Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 08:46:59.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 511718d0-60a2-47b3-9070-b40f391e96b6 could not be found. Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 511718d0-60a2-47b3-9070-b40f391e96b6 could not be found. Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dc363029-e636-4bdb-a3e3-ea40802e43c8 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] Returning 404 to user: Volume 511718d0-60a2-47b3-9070-b40f391e96b6 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dc363029-e636-4bdb-a3e3-ea40802e43c8 tempest-VolumesNegativeTest-1510075298 tempest-VolumesNegativeTest-1510075298-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/511718d0-60a2-47b3-9070-b40f391e96b6" status: 404 len: 109 microversion: 2.1 time: 0.053875 Aug 08 08:46:59.676682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 339/650] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:46:59 2022] GET /compute/v2.1/os-volumes/511718d0-60a2-47b3-9070-b40f391e96b6 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 08:47:00.032546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-6c2c4836-b21a-4d3e-8ddf-67a1af806734 req-495c1bbb-a7fd-4dd0-b534-0d266d74d3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2e00a03-eab8-4b60-bb8d-84093fbe9b22", "name": "network-vif-plugged", "status": "completed", "tag": "259d0741-4693-45fb-b135-1c29ea66a183"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:00.044976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-6c2c4836-b21a-4d3e-8ddf-67a1af806734 req-495c1bbb-a7fd-4dd0-b534-0d266d74d3ee service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:00.045564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-6c2c4836-b21a-4d3e-8ddf-67a1af806734 req-495c1bbb-a7fd-4dd0-b534-0d266d74d3ee service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:00.052397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-6c2c4836-b21a-4d3e-8ddf-67a1af806734 req-495c1bbb-a7fd-4dd0-b534-0d266d74d3ee service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:00.058138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-6c2c4836-b21a-4d3e-8ddf-67a1af806734 req-495c1bbb-a7fd-4dd0-b534-0d266d74d3ee service nova] Creating event network-vif-plugged:259d0741-4693-45fb-b135-1c29ea66a183 for instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 on hv-cinder-83697 Aug 08 08:47:00.063753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-6c2c4836-b21a-4d3e-8ddf-67a1af806734 req-495c1bbb-a7fd-4dd0-b534-0d266d74d3ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037674 Aug 08 08:47:00.064350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 312/651] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:00.653111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:00.653111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:00.684009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:00.684517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:00.684961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:00.686127 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:00.689859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:00.690316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:00.852843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:00.859542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:00.865950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:00.871538 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:00.873365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-264c1840-cc7b-42c6-9383-8f959ce79bf9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1740 microversion: 2.20 time: 0.226185 Aug 08 08:47:00.885396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 340/652] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:00 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:01.899528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:01.900235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:01.908023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:01.908808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:01.909648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:01.910885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:01.911972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:01.912601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:02.073687 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:02.083906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:02.085845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:02.087185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b8eef023-7298-497e-92ae-421aee410588 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1740 microversion: 2.20 time: 0.192376 Aug 08 08:47:02.087914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 313/653] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:01 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:03.113304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:03.114060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:03.122096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:03.122647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:03.123105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:03.123875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:03.124434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:03.124975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:03.276174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:03.289009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:03.291496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:03.293792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-196c9682-ccba-48b6-8cc6-68d27c593288 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1740 microversion: 2.20 time: 0.184577 Aug 08 08:47:03.295205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 341/654] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:03 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:04.319489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:04.320345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:04.327664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:04.328234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:04.329125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:04.330837 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:04.331326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:04.331793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:04.472795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:04.487950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:04.489457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:04.490767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3210aa4f-47e4-431d-b9ba-4f0bbbb3e424 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1740 microversion: 2.20 time: 0.175498 Aug 08 08:47:04.491322 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 314/655] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:04 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:05.516697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:05.517400 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:05.524027 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:05.524540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:05.524996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:05.525695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:05.526157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:05.526584 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:05.676345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:05.685543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:05.687081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:05.688326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-843bf7bd-fa6f-47ef-baaa-f884d53fa2a4 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1740 microversion: 2.20 time: 0.178140 Aug 08 08:47:05.688908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 342/656] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:05 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:06.712091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:06.714012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:06.720200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:06.720699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:06.721160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:06.724599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:06.724599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:06.724599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:06.876996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:06.886994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:06.890252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:06.892187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-699b6c52-c47f-4ca3-9bbc-2a13e0d3a148 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1740 microversion: 2.20 time: 0.183584 Aug 08 08:47:06.904636 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 315/657] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:06 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:07.359064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-10a08c20-66c5-4280-9022-6bf2e73ac346 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:07.359648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-10a08c20-66c5-4280-9022-6bf2e73ac346 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:07.361917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:07.367229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10a08c20-66c5-4280-9022-6bf2e73ac346 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:07.367899 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10a08c20-66c5-4280-9022-6bf2e73ac346 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:07.368334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10a08c20-66c5-4280-9022-6bf2e73ac346 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:07.369236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10a08c20-66c5-4280-9022-6bf2e73ac346 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:07.369870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10a08c20-66c5-4280-9022-6bf2e73ac346 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:07.370446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10a08c20-66c5-4280-9022-6bf2e73ac346 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:07.400119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-10a08c20-66c5-4280-9022-6bf2e73ac346 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:47:07.726547 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-10a08c20-66c5-4280-9022-6bf2e73ac346 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "DELETE /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 204 len: 0 microversion: 2.1 time: 0.372310 Aug 08 08:47:07.727330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 343/658] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:47:07 2022] DELETE /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:47:07.735716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3b6a712e-2e5a-4dd3-9d11-ebc0c16b92e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:07.740683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3b6a712e-2e5a-4dd3-9d11-ebc0c16b92e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:07.743557 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b6a712e-2e5a-4dd3-9d11-ebc0c16b92e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:07.744056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b6a712e-2e5a-4dd3-9d11-ebc0c16b92e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:07.744682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b6a712e-2e5a-4dd3-9d11-ebc0c16b92e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:07.746112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b6a712e-2e5a-4dd3-9d11-ebc0c16b92e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:07.746772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b6a712e-2e5a-4dd3-9d11-ebc0c16b92e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:07.747418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b6a712e-2e5a-4dd3-9d11-ebc0c16b92e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:07.899265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3b6a712e-2e5a-4dd3-9d11-ebc0c16b92e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:07.907562 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3b6a712e-2e5a-4dd3-9d11-ebc0c16b92e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1577 microversion: 2.1 time: 0.175636 Aug 08 08:47:07.908231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 316/659] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:07 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:07.920948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:07.921672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:07.931151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:07.931645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:07.932090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:07.932798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:07.934117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:07.934564 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:08.107359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:08.115638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:08.117191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:08.118608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a296e72d-385a-4843-9550-630c0875bc08 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1740 microversion: 2.20 time: 0.203278 Aug 08 08:47:08.125200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 344/660] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:07 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:08.929451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5e7d8bd2-dbe6-4670-b183-bd687a5085d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:08.930711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5e7d8bd2-dbe6-4670-b183-bd687a5085d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:08.938648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e7d8bd2-dbe6-4670-b183-bd687a5085d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:08.939140 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e7d8bd2-dbe6-4670-b183-bd687a5085d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:08.939568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e7d8bd2-dbe6-4670-b183-bd687a5085d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:08.940274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e7d8bd2-dbe6-4670-b183-bd687a5085d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:08.940772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e7d8bd2-dbe6-4670-b183-bd687a5085d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:08.941233 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e7d8bd2-dbe6-4670-b183-bd687a5085d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:09.079709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5e7d8bd2-dbe6-4670-b183-bd687a5085d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:09.087356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5e7d8bd2-dbe6-4670-b183-bd687a5085d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1577 microversion: 2.1 time: 0.161973 Aug 08 08:47:09.087911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 317/661] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:08 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:09.151361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:09.152761 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:09.159992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:09.160537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:09.160978 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:09.161772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:09.162288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:09.163435 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:09.306696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:09.314864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:09.316400 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:09.317683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-076fa521-0ee0-4df2-80ca-4b926219d91e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1740 microversion: 2.20 time: 0.170871 Aug 08 08:47:09.318353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 345/662] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:09 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:10.109723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8ac9ea50-3ee2-4c1a-9329-0de553025d0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:10.111455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8ac9ea50-3ee2-4c1a-9329-0de553025d0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:10.120102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ac9ea50-3ee2-4c1a-9329-0de553025d0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:10.121188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ac9ea50-3ee2-4c1a-9329-0de553025d0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:10.121997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ac9ea50-3ee2-4c1a-9329-0de553025d0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:10.123077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ac9ea50-3ee2-4c1a-9329-0de553025d0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:10.123738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ac9ea50-3ee2-4c1a-9329-0de553025d0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:10.124382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ac9ea50-3ee2-4c1a-9329-0de553025d0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:10.296442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8ac9ea50-3ee2-4c1a-9329-0de553025d0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:10.304885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8ac9ea50-3ee2-4c1a-9329-0de553025d0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1577 microversion: 2.1 time: 0.199929 Aug 08 08:47:10.305521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 318/663] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:10 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:10.344109 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:10.344726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:10.351505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:10.351990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:10.352459 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:10.353250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:10.354068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:10.366282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:10.565911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:10.573767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:10.575283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:10.576433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1d4f236b-db5b-4ffc-bbd5-1218cde8ce58 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1740 microversion: 2.20 time: 0.236763 Aug 08 08:47:10.577018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 346/664] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:10 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:10.896531 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-4f584f0c-94da-4f80-850f-cd17fef63ce6 req-9d002000-417a-4b8d-8eb3-7dd78bfba1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817d5956-5363-4c2c-be67-9c273e9cc34b", "name": "network-vif-deleted", "tag": "3165d13a-8b89-4c30-9db1-51f00d58b1b4"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:10.910096 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-4f584f0c-94da-4f80-850f-cd17fef63ce6 req-9d002000-417a-4b8d-8eb3-7dd78bfba1e8 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:10.910708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-4f584f0c-94da-4f80-850f-cd17fef63ce6 req-9d002000-417a-4b8d-8eb3-7dd78bfba1e8 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:10.911098 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-4f584f0c-94da-4f80-850f-cd17fef63ce6 req-9d002000-417a-4b8d-8eb3-7dd78bfba1e8 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:10.923667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-4f584f0c-94da-4f80-850f-cd17fef63ce6 req-9d002000-417a-4b8d-8eb3-7dd78bfba1e8 service nova] Creating event network-vif-deleted:3165d13a-8b89-4c30-9db1-51f00d58b1b4 for instance 817d5956-5363-4c2c-be67-9c273e9cc34b on hv-cinder-83697 Aug 08 08:47:10.928932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-4f584f0c-94da-4f80-850f-cd17fef63ce6 req-9d002000-417a-4b8d-8eb3-7dd78bfba1e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205041 Aug 08 08:47:10.929583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 319/665] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:11.328270 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a370a1a0-1334-4b3c-bc6a-348ffb7fc6a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:11.328945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a370a1a0-1334-4b3c-bc6a-348ffb7fc6a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:11.335212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a370a1a0-1334-4b3c-bc6a-348ffb7fc6a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:11.335706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a370a1a0-1334-4b3c-bc6a-348ffb7fc6a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:11.336139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a370a1a0-1334-4b3c-bc6a-348ffb7fc6a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:11.336835 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a370a1a0-1334-4b3c-bc6a-348ffb7fc6a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:11.337326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a370a1a0-1334-4b3c-bc6a-348ffb7fc6a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:11.337746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a370a1a0-1334-4b3c-bc6a-348ffb7fc6a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:11.415398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a370a1a0-1334-4b3c-bc6a-348ffb7fc6a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:11.428836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a370a1a0-1334-4b3c-bc6a-348ffb7fc6a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 200 len: 1225 microversion: 2.1 time: 0.105581 Aug 08 08:47:11.429436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 347/666] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:11 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:11.604503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:11.605235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:11.607251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=64 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:11.612513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:11.613008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:11.613480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:11.614364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:11.614828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:11.615356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:11.802790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:11.810918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:11.812423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:11.813613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5b630b46-ff2c-4c33-a27c-9ad14a5af605 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1722 microversion: 2.20 time: 0.215334 Aug 08 08:47:11.814170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 320/667] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:11 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:12.449805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:12.450426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:12.456769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:12.457296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:12.457740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:12.458436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:12.458906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:12.459338 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:12.472695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] HTTP exception thrown: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Request method failure captured: Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b HTTP/1.1 Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MzXjMQz1Kp56xcb_Sm5-oSaYF-Mq61EeqQE2-thU_paPGDqAIYZVnVf9V2iQL_lCA-Il33XwMOKv8GTTwR56oXScdfARptj3eVX2Z3g9UJeynBsTWKJVNZNVnITKpxrQm7yTN1cdVPTdIeMaT1rBGPBs7CTI7pOVYiB8hzhF0ujB0Q Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: e87616891fa34cd9aca388a5d101f3f9 Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-TestVolumeBootPattern-650232808 Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:47:12.474306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-TestVolumeBootPattern-650232808 Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: e87616891fa34cd9aca388a5d101f3f9 Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-TestVolumeBootPattern-650232808 Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-TestVolumeBootPattern-650232808-project Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: cd870619247a47ac810fea1aa636ac65 Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-TestVolumeBootPattern-650232808-project Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 08:47:12.479106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '817d5956-5363-4c2c-be67-9c273e9cc34b'} Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:47:12.480025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 08:47:12.482066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:12.483426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Returning 404 to user: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:47:12.483426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7161ab06-995b-48e0-8806-536330b457d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 404 len: 111 microversion: 2.1 time: 0.029767 Aug 08 08:47:12.483426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 348/668] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:12 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 08:47:12.579040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1004639852", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1650248059", "security_groups": [{"name": "tempest-secgroup-smoke-306397345"}], "block_device_mapping_v2": [{"uuid": "377126e8-5e47-40fd-b0ea-29ae2cbda763", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aded838a-535a-491c-a5f4-94feae65f9aa"}]}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:12.694000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.network.neutron [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] validate_networks() for [('aded838a-535a-491c-a5f4-94feae65f9aa', None, None, None, None, None)] {{(pid=124673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:47:12.839920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:12.841250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:12.864539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:12.865504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:12.866123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:12.867317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:12.867778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:12.868945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:13.080959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:13.088979 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:13.090699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:13.092033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bc636459-0a66-4656-91ce-9d064f2f74f1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1722 microversion: 2.20 time: 0.259018 Aug 08 08:47:13.092581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 349/669] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:12 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:47:13.178478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Flavor limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:47:13.178905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Image limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:47:13.179392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Flavor pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:47:13.179832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Image pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:47:13.180248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:47:13.189655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:13.190149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:13.190593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:13.191326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:13.191828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:13.192243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:13.208820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Getting quotas for project e87616891fa34cd9aca388a5d101f3f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:47:13.212788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Getting quotas for user cd870619247a47ac810fea1aa636ac65 and project e87616891fa34cd9aca388a5d101f3f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:47:13.270075 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Going to run 1 instances... {{(pid=124673) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:47:13.272169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='377126e8-5e47-40fd-b0ea-29ae2cbda763',volume_size=None,volume_type=None)] {{(pid=124673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:47:13.693019 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3649b073-e0d1-471b-8fbe-092d059cd1e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.117622 Aug 08 08:47:13.693640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 321/670] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:47:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:47:13.704295 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-649d1eec-324a-4a0b-ba87-bb7220496eeb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:13.704905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-649d1eec-324a-4a0b-ba87-bb7220496eeb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:13.759718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-649d1eec-324a-4a0b-ba87-bb7220496eeb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:13.766654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-649d1eec-324a-4a0b-ba87-bb7220496eeb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1095 microversion: 2.1 time: 0.066288 Aug 08 08:47:13.767402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 350/671] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:13 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:14.068426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-4680fc22-4559-4764-835d-2b43938b2eaf req-7c1072ae-0816-477f-8110-8c1b61923793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2e00a03-eab8-4b60-bb8d-84093fbe9b22", "name": "network-vif-unplugged", "status": "completed", "tag": "259d0741-4693-45fb-b135-1c29ea66a183"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:14.078092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-4680fc22-4559-4764-835d-2b43938b2eaf req-7c1072ae-0816-477f-8110-8c1b61923793 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:14.078469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-4680fc22-4559-4764-835d-2b43938b2eaf req-7c1072ae-0816-477f-8110-8c1b61923793 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:14.078902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-4680fc22-4559-4764-835d-2b43938b2eaf req-7c1072ae-0816-477f-8110-8c1b61923793 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:14.089624 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-4680fc22-4559-4764-835d-2b43938b2eaf req-7c1072ae-0816-477f-8110-8c1b61923793 service nova] Creating event network-vif-unplugged:259d0741-4693-45fb-b135-1c29ea66a183 for instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 on hv-cinder-83697 Aug 08 08:47:14.095046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-4680fc22-4559-4764-835d-2b43938b2eaf req-7c1072ae-0816-477f-8110-8c1b61923793 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030407 Aug 08 08:47:14.095859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 322/672] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:14.115759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:14.116382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:14.125765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:14.126321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:14.126758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:14.127455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:14.127952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:14.128456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:14.275168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:14.283793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:14.285360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:14.286520 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6c868224-a221-45c1-9b82-f0b8eff1ddcf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1722 microversion: 2.20 time: 0.174820 Aug 08 08:47:14.287068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 351/673] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:14 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:14.788562 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-59bea2b3-815c-4279-a692-f0338dbd00c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:14.789196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-59bea2b3-815c-4279-a692-f0338dbd00c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:14.795847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59bea2b3-815c-4279-a692-f0338dbd00c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:14.796354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59bea2b3-815c-4279-a692-f0338dbd00c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:14.796788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59bea2b3-815c-4279-a692-f0338dbd00c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:14.797501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59bea2b3-815c-4279-a692-f0338dbd00c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:14.797955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59bea2b3-815c-4279-a692-f0338dbd00c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:14.798379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59bea2b3-815c-4279-a692-f0338dbd00c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:14.864368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-59bea2b3-815c-4279-a692-f0338dbd00c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:14.872704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-59bea2b3-815c-4279-a692-f0338dbd00c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1145 microversion: 2.1 time: 0.088920 Aug 08 08:47:14.873320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 323/674] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:14 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:15.310384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:15.310999 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:15.317407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:15.317924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:15.318361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:15.319050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:15.319509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:15.319935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:15.447405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:15.455960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:15.457484 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:15.458641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2286138b-5c45-4293-8bcc-b58761020911 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1665 microversion: 2.20 time: 0.152213 Aug 08 08:47:15.459199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 352/675] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:15 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:15.482315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-679ad426-69de-4023-9705-44d1afc9db5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c61e7762-4c70-4ec6-a692-e094a7729dbc"}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:15.484618 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-679ad426-69de-4023-9705-44d1afc9db5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:15.490689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-679ad426-69de-4023-9705-44d1afc9db5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:15.491180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-679ad426-69de-4023-9705-44d1afc9db5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:15.491617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-679ad426-69de-4023-9705-44d1afc9db5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:15.492313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-679ad426-69de-4023-9705-44d1afc9db5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:15.492798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-679ad426-69de-4023-9705-44d1afc9db5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:15.493253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-679ad426-69de-4023-9705-44d1afc9db5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:15.894044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-53fd417a-086c-4f6c-a4be-09bab4659f27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:15.900557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-53fd417a-086c-4f6c-a4be-09bab4659f27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:15.900557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53fd417a-086c-4f6c-a4be-09bab4659f27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:15.901041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53fd417a-086c-4f6c-a4be-09bab4659f27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:15.901516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53fd417a-086c-4f6c-a4be-09bab4659f27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:15.902217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53fd417a-086c-4f6c-a4be-09bab4659f27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:15.902785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53fd417a-086c-4f6c-a4be-09bab4659f27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:15.903222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53fd417a-086c-4f6c-a4be-09bab4659f27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:15.975200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-53fd417a-086c-4f6c-a4be-09bab4659f27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:15.987120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-53fd417a-086c-4f6c-a4be-09bab4659f27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1201 microversion: 2.1 time: 0.093459 Aug 08 08:47:15.987120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 353/676] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:15 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:16.548486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-679ad426-69de-4023-9705-44d1afc9db5c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "POST /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.070873 Aug 08 08:47:16.549623 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 324/677] 10.222.0.33 () {62 vars in 1364 bytes} [Mon Aug 8 08:47:15 2022] POST /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/os-volume_attachments => generated 188 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 08:47:16.687130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5a7a3d48-77e8-4cd3-952f-f8ee6a3d86c3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:16.688266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5a7a3d48-77e8-4cd3-952f-f8ee6a3d86c3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:16.695817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a7a3d48-77e8-4cd3-952f-f8ee6a3d86c3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:16.696463 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a7a3d48-77e8-4cd3-952f-f8ee6a3d86c3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:16.696897 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a7a3d48-77e8-4cd3-952f-f8ee6a3d86c3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:16.697776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a7a3d48-77e8-4cd3-952f-f8ee6a3d86c3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:16.698395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a7a3d48-77e8-4cd3-952f-f8ee6a3d86c3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:16.698820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a7a3d48-77e8-4cd3-952f-f8ee6a3d86c3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:17.006060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3a47ce90-8f4e-4a03-9c3a-dd0b1cc621dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:17.006592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3a47ce90-8f4e-4a03-9c3a-dd0b1cc621dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:17.014167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a47ce90-8f4e-4a03-9c3a-dd0b1cc621dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:17.014719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a47ce90-8f4e-4a03-9c3a-dd0b1cc621dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:17.015155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a47ce90-8f4e-4a03-9c3a-dd0b1cc621dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:17.015879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a47ce90-8f4e-4a03-9c3a-dd0b1cc621dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:17.016337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a47ce90-8f4e-4a03-9c3a-dd0b1cc621dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:17.016760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a47ce90-8f4e-4a03-9c3a-dd0b1cc621dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:17.237939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3a47ce90-8f4e-4a03-9c3a-dd0b1cc621dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:17.245787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3a47ce90-8f4e-4a03-9c3a-dd0b1cc621dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1278 microversion: 2.1 time: 0.244475 Aug 08 08:47:17.246951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 325/678] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:17 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1278 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:17.314263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5a7a3d48-77e8-4cd3-952f-f8ee6a3d86c3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/os-volume_attachments/c61e7762-4c70-4ec6-a692-e094a7729dbc" status: 202 len: 0 microversion: 2.20 time: 0.631480 Aug 08 08:47:17.318137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 354/679] 10.222.0.33 () {60 vars in 1457 bytes} [Mon Aug 8 08:47:16 2022] DELETE /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/os-volume_attachments/c61e7762-4c70-4ec6-a692-e094a7729dbc => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:47:17.380285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c6883ccf-a3bb-40f8-a48f-111dd1ca082e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:17.380917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c6883ccf-a3bb-40f8-a48f-111dd1ca082e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:17.387314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6883ccf-a3bb-40f8-a48f-111dd1ca082e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:17.387773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6883ccf-a3bb-40f8-a48f-111dd1ca082e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:17.388105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6883ccf-a3bb-40f8-a48f-111dd1ca082e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:17.388792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6883ccf-a3bb-40f8-a48f-111dd1ca082e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:17.389274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6883ccf-a3bb-40f8-a48f-111dd1ca082e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:17.390636 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6883ccf-a3bb-40f8-a48f-111dd1ca082e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:17.393395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:17.420319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c6883ccf-a3bb-40f8-a48f-111dd1ca082e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124673) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 08:47:17.677729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c6883ccf-a3bb-40f8-a48f-111dd1ca082e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "POST /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/action" status: 202 len: 0 microversion: 2.20 time: 0.301055 Aug 08 08:47:17.679735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 326/680] 10.222.0.33 () {62 vars in 1319 bytes} [Mon Aug 8 08:47:17 2022] POST /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:47:17.687419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:17.688121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:17.695071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:17.695564 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:17.696017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:17.696723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:17.697230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:17.700495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:17.703497 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:17.741738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-e2a13a4d-602c-4e75-9574-832943c376a3 req-9fdbd4ac-ea9e-471f-935a-bfdcd5edd06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae15222-d37a-43e4-bf78-a97c7c3d16c8", "tag": "bffdad13-f65d-4d9b-830d-d0bb55adc8d7"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:17.755618 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-e2a13a4d-602c-4e75-9574-832943c376a3 req-9fdbd4ac-ea9e-471f-935a-bfdcd5edd06f service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:17.756101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-e2a13a4d-602c-4e75-9574-832943c376a3 req-9fdbd4ac-ea9e-471f-935a-bfdcd5edd06f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:17.756532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-e2a13a4d-602c-4e75-9574-832943c376a3 req-9fdbd4ac-ea9e-471f-935a-bfdcd5edd06f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:17.768357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-e2a13a4d-602c-4e75-9574-832943c376a3 req-9fdbd4ac-ea9e-471f-935a-bfdcd5edd06f service nova] Creating event network-changed:bffdad13-f65d-4d9b-830d-d0bb55adc8d7 for instance cae15222-d37a-43e4-bf78-a97c7c3d16c8 on hv-cinder-83697 Aug 08 08:47:17.773351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-e2a13a4d-602c-4e75-9574-832943c376a3 req-9fdbd4ac-ea9e-471f-935a-bfdcd5edd06f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035752 Aug 08 08:47:17.774317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 327/681] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:47:17.952120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:17.969697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:17.972010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:17.974138 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-12def6c9-9c11-4f85-b1c3-7dc241cc1494 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1673 microversion: 2.20 time: 0.290870 Aug 08 08:47:17.985437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 355/682] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:17 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1673 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:18.268276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-36175037-b007-4eed-b776-66aa6df33aba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:18.268983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-36175037-b007-4eed-b776-66aa6df33aba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:18.275973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36175037-b007-4eed-b776-66aa6df33aba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:18.276471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36175037-b007-4eed-b776-66aa6df33aba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:18.276913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36175037-b007-4eed-b776-66aa6df33aba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:18.277727 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36175037-b007-4eed-b776-66aa6df33aba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:18.278191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36175037-b007-4eed-b776-66aa6df33aba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:18.278802 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36175037-b007-4eed-b776-66aa6df33aba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:18.497431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-36175037-b007-4eed-b776-66aa6df33aba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:18.505394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-36175037-b007-4eed-b776-66aa6df33aba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.241208 Aug 08 08:47:18.505960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 328/683] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:18 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:18.999266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:18.999874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:19.006301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:19.006784 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:19.007219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:19.008023 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:19.008488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:19.008916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:19.210134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:19.219300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:19.220801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:19.222005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6c41b3a4-108c-4742-9aaa-edd76e361ddd tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1673 microversion: 2.20 time: 0.226814 Aug 08 08:47:19.222799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 356/684] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:18 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1673 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:19.526669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a9c60374-dc5c-4a9a-9fea-c9964e956901 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:19.527308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a9c60374-dc5c-4a9a-9fea-c9964e956901 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:19.533861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9c60374-dc5c-4a9a-9fea-c9964e956901 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:19.534379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9c60374-dc5c-4a9a-9fea-c9964e956901 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:19.534812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9c60374-dc5c-4a9a-9fea-c9964e956901 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:19.535548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9c60374-dc5c-4a9a-9fea-c9964e956901 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:19.536035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9c60374-dc5c-4a9a-9fea-c9964e956901 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:19.536492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a9c60374-dc5c-4a9a-9fea-c9964e956901 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:19.668065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a9c60374-dc5c-4a9a-9fea-c9964e956901 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:19.675509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a9c60374-dc5c-4a9a-9fea-c9964e956901 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.152697 Aug 08 08:47:19.675995 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 329/685] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:19 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:20.245521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:20.246234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:20.252923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:20.253679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:20.264348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:20.265787 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:20.266266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:20.266703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:20.481809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:20.494008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:20.494008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:20.494008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a73bb80b-d32f-42a9-95c0-d080f182b040 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.251503 Aug 08 08:47:20.494376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 357/686] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:20 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:20.695622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4b5a52ec-63e2-45cb-8ceb-39f8cded39cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:20.696788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4b5a52ec-63e2-45cb-8ceb-39f8cded39cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:20.705547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b5a52ec-63e2-45cb-8ceb-39f8cded39cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:20.705547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b5a52ec-63e2-45cb-8ceb-39f8cded39cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:20.705547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b5a52ec-63e2-45cb-8ceb-39f8cded39cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:20.705547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b5a52ec-63e2-45cb-8ceb-39f8cded39cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:20.705930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b5a52ec-63e2-45cb-8ceb-39f8cded39cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:20.706367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b5a52ec-63e2-45cb-8ceb-39f8cded39cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:20.843305 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4b5a52ec-63e2-45cb-8ceb-39f8cded39cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:20.850731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4b5a52ec-63e2-45cb-8ceb-39f8cded39cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.158892 Aug 08 08:47:20.851291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 330/687] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:20 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:21.516452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:21.517164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:21.535872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:21.536630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:21.537304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:21.538193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:21.538831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:21.539478 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:21.704203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:21.713201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:21.715582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:21.717048 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f1164061-5f22-4852-8206-bba2118bf658 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.204504 Aug 08 08:47:21.734182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 358/688] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:21 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:21.871965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-49f1decd-dff6-4902-b362-77d4b3aab1c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:21.872574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-49f1decd-dff6-4902-b362-77d4b3aab1c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:21.879132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49f1decd-dff6-4902-b362-77d4b3aab1c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:21.879624 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49f1decd-dff6-4902-b362-77d4b3aab1c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:21.880060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49f1decd-dff6-4902-b362-77d4b3aab1c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:21.880754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49f1decd-dff6-4902-b362-77d4b3aab1c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:21.881228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49f1decd-dff6-4902-b362-77d4b3aab1c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:21.881659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49f1decd-dff6-4902-b362-77d4b3aab1c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:22.039361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-49f1decd-dff6-4902-b362-77d4b3aab1c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:22.048024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-49f1decd-dff6-4902-b362-77d4b3aab1c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.180066 Aug 08 08:47:22.048599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 331/689] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:21 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:22.317569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e9f7ee47-0493-463c-abe6-cf25e7eb5dc5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:22.318104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e9f7ee47-0493-463c-abe6-cf25e7eb5dc5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:22.324448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9f7ee47-0493-463c-abe6-cf25e7eb5dc5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:22.325045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9f7ee47-0493-463c-abe6-cf25e7eb5dc5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:22.325586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9f7ee47-0493-463c-abe6-cf25e7eb5dc5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:22.326365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9f7ee47-0493-463c-abe6-cf25e7eb5dc5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:22.326836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9f7ee47-0493-463c-abe6-cf25e7eb5dc5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:22.327267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9f7ee47-0493-463c-abe6-cf25e7eb5dc5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:22.351993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e9f7ee47-0493-463c-abe6-cf25e7eb5dc5 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/ips" status: 200 len: 149 microversion: 2.1 time: 0.154332 Aug 08 08:47:22.352810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 359/690] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 08:47:22 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/ips => generated 149 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:22.742476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:22.743252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:22.749693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:22.750293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:22.750791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:22.751599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:22.752919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:22.753442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:22.925474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:22.935301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:22.936840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:22.938248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-27705965-e276-48a3-ba2a-b468400451be tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.199768 Aug 08 08:47:22.954582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 332/691] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:22 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:23.068972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4eb2a4d8-7b2e-4cbe-aa89-bec14d73c197 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:23.069770 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4eb2a4d8-7b2e-4cbe-aa89-bec14d73c197 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:23.080528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4eb2a4d8-7b2e-4cbe-aa89-bec14d73c197 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:23.081032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4eb2a4d8-7b2e-4cbe-aa89-bec14d73c197 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:23.081503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4eb2a4d8-7b2e-4cbe-aa89-bec14d73c197 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:23.082213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4eb2a4d8-7b2e-4cbe-aa89-bec14d73c197 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:23.083794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4eb2a4d8-7b2e-4cbe-aa89-bec14d73c197 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:23.084232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4eb2a4d8-7b2e-4cbe-aa89-bec14d73c197 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:23.242986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4eb2a4d8-7b2e-4cbe-aa89-bec14d73c197 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:23.253321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4eb2a4d8-7b2e-4cbe-aa89-bec14d73c197 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.187074 Aug 08 08:47:23.253765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 360/692] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:23 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:23.967023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:23.967916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:23.975890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:23.976932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=6 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:23.979523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:23.994243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:23.996493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:23.997455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:23.998080 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:24.003584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:24.073018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8e14e43e-b7ea-4fb0-b65c-d9af187546c2 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ae2323d-fcea-4c9f-930e-ba8338016d67"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:24.076395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8e14e43e-b7ea-4fb0-b65c-d9af187546c2 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:24.084719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:24.092099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e14e43e-b7ea-4fb0-b65c-d9af187546c2 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:24.092099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e14e43e-b7ea-4fb0-b65c-d9af187546c2 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:24.092099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e14e43e-b7ea-4fb0-b65c-d9af187546c2 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:24.092099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e14e43e-b7ea-4fb0-b65c-d9af187546c2 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:24.092514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e14e43e-b7ea-4fb0-b65c-d9af187546c2 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:24.092514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e14e43e-b7ea-4fb0-b65c-d9af187546c2 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:24.179276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:24.192450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:24.197878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:24.199385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e3026c9e-e956-43fb-aeb4-27bc11d58371 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.239299 Aug 08 08:47:24.213346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 333/693] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:23 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:24.279805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0a5f0334-98f6-4cdc-a27b-5d6ad117f798 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:24.280701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0a5f0334-98f6-4cdc-a27b-5d6ad117f798 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:24.286775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a5f0334-98f6-4cdc-a27b-5d6ad117f798 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:24.290129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a5f0334-98f6-4cdc-a27b-5d6ad117f798 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:24.290129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a5f0334-98f6-4cdc-a27b-5d6ad117f798 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:24.290129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a5f0334-98f6-4cdc-a27b-5d6ad117f798 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:24.290129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a5f0334-98f6-4cdc-a27b-5d6ad117f798 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:24.290641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a5f0334-98f6-4cdc-a27b-5d6ad117f798 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:24.542594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0a5f0334-98f6-4cdc-a27b-5d6ad117f798 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:24.550725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0a5f0334-98f6-4cdc-a27b-5d6ad117f798 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.275788 Aug 08 08:47:24.551554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 334/694] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:24 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:25.223786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:25.225076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:25.232651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:25.233157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:25.233603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:25.234657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:25.235333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:25.235973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:25.391423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:25.403720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:25.405626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:25.407029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ab8ebe6d-cf7b-4841-9b5d-c35989c812e1 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.188140 Aug 08 08:47:25.408570 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 335/695] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:25 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:47:25.572878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cc45064d-72f4-4c9d-9ecc-7947eb682cc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:25.573564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cc45064d-72f4-4c9d-9ecc-7947eb682cc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:25.581001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc45064d-72f4-4c9d-9ecc-7947eb682cc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:25.581721 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc45064d-72f4-4c9d-9ecc-7947eb682cc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:25.588465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc45064d-72f4-4c9d-9ecc-7947eb682cc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:25.590243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc45064d-72f4-4c9d-9ecc-7947eb682cc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:25.590933 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc45064d-72f4-4c9d-9ecc-7947eb682cc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:25.591492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc45064d-72f4-4c9d-9ecc-7947eb682cc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:25.785253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cc45064d-72f4-4c9d-9ecc-7947eb682cc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:25.795063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cc45064d-72f4-4c9d-9ecc-7947eb682cc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.226887 Aug 08 08:47:25.795686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 336/696] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:25 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:26.430724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:26.431335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:26.438899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:26.439400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:26.439855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:26.440561 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:26.441038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:26.441493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:26.599286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:26.616083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:26.618132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:26.620083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e455775d-069d-4db1-bc1c-1a2436549b92 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.193311 Aug 08 08:47:26.621384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 337/697] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:26 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:26.815779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3a7dfd0a-0ce0-4c2f-9267-03f2febb1591 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:26.817082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3a7dfd0a-0ce0-4c2f-9267-03f2febb1591 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:26.828114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a7dfd0a-0ce0-4c2f-9267-03f2febb1591 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:26.828766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a7dfd0a-0ce0-4c2f-9267-03f2febb1591 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:26.829371 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a7dfd0a-0ce0-4c2f-9267-03f2febb1591 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:26.830299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a7dfd0a-0ce0-4c2f-9267-03f2febb1591 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:26.832118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a7dfd0a-0ce0-4c2f-9267-03f2febb1591 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:26.832785 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a7dfd0a-0ce0-4c2f-9267-03f2febb1591 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:26.991778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3a7dfd0a-0ce0-4c2f-9267-03f2febb1591 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:27.012466 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3a7dfd0a-0ce0-4c2f-9267-03f2febb1591 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.200018 Aug 08 08:47:27.013404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 338/698] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:26 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:27.644662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:27.645416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:27.652221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:27.652704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:27.653152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:27.656196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:27.656196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:27.656196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:27.857501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:27.874951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:27.876177 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:27.877888 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-72e4b35a-d7ff-4f42-b174-c5e5de3ccab7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.237709 Aug 08 08:47:27.878672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 339/699] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:27 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:28.034000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fc446b97-2867-4a7a-bafa-778976350245 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:28.034872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fc446b97-2867-4a7a-bafa-778976350245 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:28.040731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc446b97-2867-4a7a-bafa-778976350245 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:28.041247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc446b97-2867-4a7a-bafa-778976350245 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:28.041682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc446b97-2867-4a7a-bafa-778976350245 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:28.042890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc446b97-2867-4a7a-bafa-778976350245 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:28.043353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc446b97-2867-4a7a-bafa-778976350245 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:28.043789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc446b97-2867-4a7a-bafa-778976350245 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:28.204710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fc446b97-2867-4a7a-bafa-778976350245 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:28.213238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fc446b97-2867-4a7a-bafa-778976350245 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.182877 Aug 08 08:47:28.214010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 340/700] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:28 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:28.900499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:28.901442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:28.908119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:28.908747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:28.909340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:28.910160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:28.910728 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:28.911403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:29.047488 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:29.055602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:29.057080 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:29.058899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c34f0f44-19b4-43c5-81bd-f70aa06dbcbc tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.161836 Aug 08 08:47:29.059807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 341/701] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:28 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:47:29.235089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b8edea51-5a58-426e-8484-82a120caf0ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:29.235617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b8edea51-5a58-426e-8484-82a120caf0ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:29.241493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8edea51-5a58-426e-8484-82a120caf0ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:29.241979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8edea51-5a58-426e-8484-82a120caf0ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:29.242417 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8edea51-5a58-426e-8484-82a120caf0ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:29.243097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8edea51-5a58-426e-8484-82a120caf0ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:29.243553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8edea51-5a58-426e-8484-82a120caf0ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:29.243979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8edea51-5a58-426e-8484-82a120caf0ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:29.258416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:29.375790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b8edea51-5a58-426e-8484-82a120caf0ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:29.383137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b8edea51-5a58-426e-8484-82a120caf0ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.152175 Aug 08 08:47:29.383690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 342/702] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:29 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:30.082351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:30.083017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:30.089431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:30.092766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:30.092766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:30.092766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:30.092766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:30.093387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:30.223461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:30.232073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:30.233639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:30.234801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f2e830be-5665-4c73-9f02-8adcad505b36 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.156446 Aug 08 08:47:30.235352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 343/703] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:30 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:47:30.403971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5ff8b089-d0c0-44ec-9724-0a60471d4926 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:30.404580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5ff8b089-d0c0-44ec-9724-0a60471d4926 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:30.410838 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ff8b089-d0c0-44ec-9724-0a60471d4926 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:30.411343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ff8b089-d0c0-44ec-9724-0a60471d4926 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:30.411788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ff8b089-d0c0-44ec-9724-0a60471d4926 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:30.412491 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ff8b089-d0c0-44ec-9724-0a60471d4926 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:30.412956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ff8b089-d0c0-44ec-9724-0a60471d4926 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:30.413413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ff8b089-d0c0-44ec-9724-0a60471d4926 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:30.549954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5ff8b089-d0c0-44ec-9724-0a60471d4926 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:30.557409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5ff8b089-d0c0-44ec-9724-0a60471d4926 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.157355 Aug 08 08:47:30.561652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 344/704] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:30 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:31.258498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:31.259145 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:31.266048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:31.266533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:31.266974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:31.267669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:31.268129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:31.268562 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:31.396010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:31.404900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:31.406423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:31.407584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-84b08b75-d18b-4778-a662-ac9993f2f0b8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.153083 Aug 08 08:47:31.408164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 345/705] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:31 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 08:47:31.576559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8e14e43e-b7ea-4fb0-b65c-d9af187546c2 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "POST /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.514415 Aug 08 08:47:31.581718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 361/706] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:47:24 2022] POST /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments => generated 194 bytes in 7516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:47:31.581875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-614ed6b3-1426-498a-a74f-948f99e23475 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:31.581875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-614ed6b3-1426-498a-a74f-948f99e23475 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:31.585520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-614ed6b3-1426-498a-a74f-948f99e23475 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:31.589210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-614ed6b3-1426-498a-a74f-948f99e23475 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:31.589210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-614ed6b3-1426-498a-a74f-948f99e23475 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:31.589210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-614ed6b3-1426-498a-a74f-948f99e23475 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:31.589210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-614ed6b3-1426-498a-a74f-948f99e23475 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:31.589850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-614ed6b3-1426-498a-a74f-948f99e23475 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:31.737871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-614ed6b3-1426-498a-a74f-948f99e23475 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:31.746122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-614ed6b3-1426-498a-a74f-948f99e23475 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.170568 Aug 08 08:47:31.757929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 346/707] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:31 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:32.432296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:32.433704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:32.441338 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:32.442050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:32.442572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:32.444108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:32.444664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:32.445267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:32.633503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:32.655481 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:32.657028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:32.660122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-eefb786f-9e4d-40a0-947d-44cb2a25c57e tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.233091 Aug 08 08:47:32.663176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 362/708] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:32 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:32.766465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-17897c56-d744-4e4c-bf57-b2e650bf5cfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:32.767080 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-17897c56-d744-4e4c-bf57-b2e650bf5cfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:32.773517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17897c56-d744-4e4c-bf57-b2e650bf5cfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:32.774018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17897c56-d744-4e4c-bf57-b2e650bf5cfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:32.774455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17897c56-d744-4e4c-bf57-b2e650bf5cfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:32.775154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17897c56-d744-4e4c-bf57-b2e650bf5cfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:32.775611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17897c56-d744-4e4c-bf57-b2e650bf5cfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:32.776042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17897c56-d744-4e4c-bf57-b2e650bf5cfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:32.918395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-17897c56-d744-4e4c-bf57-b2e650bf5cfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:32.927795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-17897c56-d744-4e4c-bf57-b2e650bf5cfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.165161 Aug 08 08:47:32.928433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 347/709] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:32 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:33.312095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-47ab54ad-0d37-4b36-8dfd-91261be36515 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:33.312518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-47ab54ad-0d37-4b36-8dfd-91261be36515 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:33.320071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47ab54ad-0d37-4b36-8dfd-91261be36515 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:33.320687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47ab54ad-0d37-4b36-8dfd-91261be36515 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:33.321133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47ab54ad-0d37-4b36-8dfd-91261be36515 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:33.321889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47ab54ad-0d37-4b36-8dfd-91261be36515 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:33.322523 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47ab54ad-0d37-4b36-8dfd-91261be36515 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:33.323049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47ab54ad-0d37-4b36-8dfd-91261be36515 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:33.349595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-47ab54ad-0d37-4b36-8dfd-91261be36515 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/ips" status: 200 len: 145 microversion: 2.1 time: 0.041775 Aug 08 08:47:33.350246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 363/710] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 08:47:33 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:33.684610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:33.685268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:33.691219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:33.691693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:33.692127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:33.692811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:33.693299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:33.693723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:33.833986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:33.842250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:33.844123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:33.845355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-493b50e2-2d78-474e-a603-84573b81cd01 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.165081 Aug 08 08:47:33.846213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 348/711] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:33 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:33.949127 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2dca34c9-be1a-409c-a68a-defe31d0cd51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:33.949815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2dca34c9-be1a-409c-a68a-defe31d0cd51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:33.957131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2dca34c9-be1a-409c-a68a-defe31d0cd51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:33.957649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2dca34c9-be1a-409c-a68a-defe31d0cd51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:33.958261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2dca34c9-be1a-409c-a68a-defe31d0cd51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:33.958992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2dca34c9-be1a-409c-a68a-defe31d0cd51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:33.959460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2dca34c9-be1a-409c-a68a-defe31d0cd51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:33.959887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2dca34c9-be1a-409c-a68a-defe31d0cd51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:34.100375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2dca34c9-be1a-409c-a68a-defe31d0cd51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:34.108068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2dca34c9-be1a-409c-a68a-defe31d0cd51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.163337 Aug 08 08:47:34.109210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 364/712] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:33 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:34.626175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-30a55545-7844-4484-b1a2-e252bdf0d56d req-1fc18b5d-4092-45ae-8060-a8be7d850a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2e00a03-eab8-4b60-bb8d-84093fbe9b22", "name": "network-vif-plugged", "status": "completed", "tag": "259d0741-4693-45fb-b135-1c29ea66a183"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:34.635405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-30a55545-7844-4484-b1a2-e252bdf0d56d req-1fc18b5d-4092-45ae-8060-a8be7d850a97 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:34.635878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-30a55545-7844-4484-b1a2-e252bdf0d56d req-1fc18b5d-4092-45ae-8060-a8be7d850a97 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:34.636304 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-30a55545-7844-4484-b1a2-e252bdf0d56d req-1fc18b5d-4092-45ae-8060-a8be7d850a97 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:34.648933 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-30a55545-7844-4484-b1a2-e252bdf0d56d req-1fc18b5d-4092-45ae-8060-a8be7d850a97 service nova] Creating event network-vif-plugged:259d0741-4693-45fb-b135-1c29ea66a183 for instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 on hv-cinder-83697 Aug 08 08:47:34.653823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-30a55545-7844-4484-b1a2-e252bdf0d56d req-1fc18b5d-4092-45ae-8060-a8be7d850a97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.295428 Aug 08 08:47:34.654430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 349/713] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:34.869514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:34.870130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:34.876954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:34.882678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:34.882678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:34.882678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:34.882678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:34.883045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:35.082423 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:35.090908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:35.093518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:35.094730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2753060d-b7e8-4a4f-b732-3ae8019c66a8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.229588 Aug 08 08:47:35.095710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 365/714] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:34 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:35.135025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1c49a551-b0f8-4728-bcda-c2b18c391f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:35.135025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1c49a551-b0f8-4728-bcda-c2b18c391f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:35.136920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c49a551-b0f8-4728-bcda-c2b18c391f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:35.137453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c49a551-b0f8-4728-bcda-c2b18c391f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:35.137892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c49a551-b0f8-4728-bcda-c2b18c391f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:35.138580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c49a551-b0f8-4728-bcda-c2b18c391f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:35.139040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c49a551-b0f8-4728-bcda-c2b18c391f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:35.139570 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c49a551-b0f8-4728-bcda-c2b18c391f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:35.284706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1c49a551-b0f8-4728-bcda-c2b18c391f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:35.289819 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7fa3ca15-a830-43a1-b7d9-46e830c44491 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f240393c-98c9-46de-84b2-d5b0a186b2a5"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:35.294956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7fa3ca15-a830-43a1-b7d9-46e830c44491 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:35.295075 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1c49a551-b0f8-4728-bcda-c2b18c391f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.167072 Aug 08 08:47:35.295075 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 350/715] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:35 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:35.298699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fa3ca15-a830-43a1-b7d9-46e830c44491 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:35.299188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fa3ca15-a830-43a1-b7d9-46e830c44491 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:35.299626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fa3ca15-a830-43a1-b7d9-46e830c44491 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:35.300342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fa3ca15-a830-43a1-b7d9-46e830c44491 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:35.300853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fa3ca15-a830-43a1-b7d9-46e830c44491 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:35.301321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fa3ca15-a830-43a1-b7d9-46e830c44491 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:35.895692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7fa3ca15-a830-43a1-b7d9-46e830c44491 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "POST /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.609601 Aug 08 08:47:35.896312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 366/716] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:47:35 2022] POST /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments => generated 194 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:47:36.121752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:36.122367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:36.128776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:36.129279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:36.129725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:36.130418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:36.130872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:36.131484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:36.265898 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:36.273948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:36.275654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:36.276900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-88b827d3-8c51-4907-b0e5-67cfdfae6efb tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.159056 Aug 08 08:47:36.277493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 351/717] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:36 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:36.373759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-63b55403-2a68-4240-ae9e-0121bfdae6ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:36.375087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-63b55403-2a68-4240-ae9e-0121bfdae6ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:36.381224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-63b55403-2a68-4240-ae9e-0121bfdae6ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:36.381889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-63b55403-2a68-4240-ae9e-0121bfdae6ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:36.382335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-63b55403-2a68-4240-ae9e-0121bfdae6ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:36.383145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-63b55403-2a68-4240-ae9e-0121bfdae6ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:36.383681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-63b55403-2a68-4240-ae9e-0121bfdae6ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:36.384115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-63b55403-2a68-4240-ae9e-0121bfdae6ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:36.525899 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-63b55403-2a68-4240-ae9e-0121bfdae6ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:36.534309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-63b55403-2a68-4240-ae9e-0121bfdae6ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.165201 Aug 08 08:47:36.534874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 367/718] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:36 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:36.669389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-c15599eb-b1e4-4ab2-a4a2-0bcbaa9bf05e req-89b08dab-f2f9-49c9-a03f-10d4725a7b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae15222-d37a-43e4-bf78-a97c7c3d16c8", "name": "network-vif-plugged", "status": "completed", "tag": "bffdad13-f65d-4d9b-830d-d0bb55adc8d7"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:36.679661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-c15599eb-b1e4-4ab2-a4a2-0bcbaa9bf05e req-89b08dab-f2f9-49c9-a03f-10d4725a7b3f service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:36.680364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-c15599eb-b1e4-4ab2-a4a2-0bcbaa9bf05e req-89b08dab-f2f9-49c9-a03f-10d4725a7b3f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:36.680866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-c15599eb-b1e4-4ab2-a4a2-0bcbaa9bf05e req-89b08dab-f2f9-49c9-a03f-10d4725a7b3f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:36.693659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-c15599eb-b1e4-4ab2-a4a2-0bcbaa9bf05e req-89b08dab-f2f9-49c9-a03f-10d4725a7b3f service nova] Creating event network-vif-plugged:bffdad13-f65d-4d9b-830d-d0bb55adc8d7 for instance cae15222-d37a-43e4-bf78-a97c7c3d16c8 on hv-cinder-83697 Aug 08 08:47:36.698431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-c15599eb-b1e4-4ab2-a4a2-0bcbaa9bf05e req-89b08dab-f2f9-49c9-a03f-10d4725a7b3f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033192 Aug 08 08:47:36.699123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 352/719] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:37.300174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:37.300643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:37.307114 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:37.307611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:37.308050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:37.308744 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:37.309240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:37.309671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:37.448423 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:37.458042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:37.459525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:37.460672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a2a580f3-3bd6-46e3-b3b3-db5ea658d4e6 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1731 microversion: 2.20 time: 0.164818 Aug 08 08:47:37.461236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 368/720] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:37 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:37.555392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4f4d568c-c8e0-4f9e-b18b-925f87344c64 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:37.556035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4f4d568c-c8e0-4f9e-b18b-925f87344c64 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:37.562870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f4d568c-c8e0-4f9e-b18b-925f87344c64 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:37.563353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f4d568c-c8e0-4f9e-b18b-925f87344c64 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:37.563790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f4d568c-c8e0-4f9e-b18b-925f87344c64 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:37.564482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f4d568c-c8e0-4f9e-b18b-925f87344c64 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:37.564935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f4d568c-c8e0-4f9e-b18b-925f87344c64 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:37.565402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f4d568c-c8e0-4f9e-b18b-925f87344c64 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:37.699061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4f4d568c-c8e0-4f9e-b18b-925f87344c64 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:37.709094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4f4d568c-c8e0-4f9e-b18b-925f87344c64 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1266 microversion: 2.1 time: 0.158349 Aug 08 08:47:37.721417 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 353/721] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:37 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:38.484932 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:38.485596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:38.487997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:38.492768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:38.493369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:38.493806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:38.494492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:38.494946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:38.495368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:38.627842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:38.630050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:38.636280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:38.637818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:38.638980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-20a1e051-62c5-4941-9804-90b3125daabf tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1718 microversion: 2.20 time: 0.159204 Aug 08 08:47:38.640069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 369/722] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:47:38 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:47:38.730957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d65eb7c2-c975-425a-a99d-fc82c7bbb05a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:38.731487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d65eb7c2-c975-425a-a99d-fc82c7bbb05a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:38.738308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d65eb7c2-c975-425a-a99d-fc82c7bbb05a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:38.738790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d65eb7c2-c975-425a-a99d-fc82c7bbb05a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:38.739222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d65eb7c2-c975-425a-a99d-fc82c7bbb05a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:38.739908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d65eb7c2-c975-425a-a99d-fc82c7bbb05a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:38.740537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d65eb7c2-c975-425a-a99d-fc82c7bbb05a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:38.740967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d65eb7c2-c975-425a-a99d-fc82c7bbb05a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:38.885139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d65eb7c2-c975-425a-a99d-fc82c7bbb05a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:38.893742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d65eb7c2-c975-425a-a99d-fc82c7bbb05a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1452 microversion: 2.1 time: 0.167236 Aug 08 08:47:38.894349 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 354/723] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:38 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:38.914170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7880263e-dd3e-43b2-b0f5-b898d9032e19 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:38.914774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7880263e-dd3e-43b2-b0f5-b898d9032e19 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:38.921638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7880263e-dd3e-43b2-b0f5-b898d9032e19 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:38.922206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7880263e-dd3e-43b2-b0f5-b898d9032e19 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:38.923536 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7880263e-dd3e-43b2-b0f5-b898d9032e19 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:38.923536 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7880263e-dd3e-43b2-b0f5-b898d9032e19 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:38.923749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7880263e-dd3e-43b2-b0f5-b898d9032e19 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:38.924170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7880263e-dd3e-43b2-b0f5-b898d9032e19 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:39.064401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7880263e-dd3e-43b2-b0f5-b898d9032e19 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:39.072159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7880263e-dd3e-43b2-b0f5-b898d9032e19 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1452 microversion: 2.1 time: 0.162120 Aug 08 08:47:39.072718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 370/724] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:38 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:40.321471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-eba48b5c-773a-46f4-bf35-d17f134de615 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:40.322013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-eba48b5c-773a-46f4-bf35-d17f134de615 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:40.329913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eba48b5c-773a-46f4-bf35-d17f134de615 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:40.330401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eba48b5c-773a-46f4-bf35-d17f134de615 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:40.330834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eba48b5c-773a-46f4-bf35-d17f134de615 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:40.331539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eba48b5c-773a-46f4-bf35-d17f134de615 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:40.331988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eba48b5c-773a-46f4-bf35-d17f134de615 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:40.332408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eba48b5c-773a-46f4-bf35-d17f134de615 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:40.413610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-eba48b5c-773a-46f4-bf35-d17f134de615 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lazy-loading 'services' on Instance uuid 97e76361-0be7-4cf0-a3e1-7ba5a1245905 {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:47:40.650627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-eba48b5c-773a-46f4-bf35-d17f134de615 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments/9ae2323d-fcea-4c9f-930e-ba8338016d67" status: 202 len: 0 microversion: 2.1 time: 0.333254 Aug 08 08:47:40.651291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 355/725] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:47:40 2022] DELETE /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments/9ae2323d-fcea-4c9f-930e-ba8338016d67 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:47:40.660073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e943bf16-1497-4e65-a4fa-0ae186f1330c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:40.662976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e943bf16-1497-4e65-a4fa-0ae186f1330c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:40.670002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e943bf16-1497-4e65-a4fa-0ae186f1330c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:40.670740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e943bf16-1497-4e65-a4fa-0ae186f1330c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:40.671090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e943bf16-1497-4e65-a4fa-0ae186f1330c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:40.671959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e943bf16-1497-4e65-a4fa-0ae186f1330c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:40.672428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e943bf16-1497-4e65-a4fa-0ae186f1330c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:40.672862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e943bf16-1497-4e65-a4fa-0ae186f1330c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:40.703810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e943bf16-1497-4e65-a4fa-0ae186f1330c tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047813 Aug 08 08:47:40.704393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 371/726] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:47:40 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:41.303109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-ebcc2601-4894-418e-abea-4d35aa15bb64 req-f1f4e835-9ce7-4513-a8b5-e3efa2a6c61a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae15222-d37a-43e4-bf78-a97c7c3d16c8", "tag": "bffdad13-f65d-4d9b-830d-d0bb55adc8d7"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:41.313828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-ebcc2601-4894-418e-abea-4d35aa15bb64 req-f1f4e835-9ce7-4513-a8b5-e3efa2a6c61a service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:41.314311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-ebcc2601-4894-418e-abea-4d35aa15bb64 req-f1f4e835-9ce7-4513-a8b5-e3efa2a6c61a service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:41.314749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-ebcc2601-4894-418e-abea-4d35aa15bb64 req-f1f4e835-9ce7-4513-a8b5-e3efa2a6c61a service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:41.327692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-ebcc2601-4894-418e-abea-4d35aa15bb64 req-f1f4e835-9ce7-4513-a8b5-e3efa2a6c61a service nova] Creating event network-changed:bffdad13-f65d-4d9b-830d-d0bb55adc8d7 for instance cae15222-d37a-43e4-bf78-a97c7c3d16c8 on hv-cinder-83697 Aug 08 08:47:41.332752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-ebcc2601-4894-418e-abea-4d35aa15bb64 req-f1f4e835-9ce7-4513-a8b5-e3efa2a6c61a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033650 Aug 08 08:47:41.333558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 356/727] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:41.715905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a56d9504-0777-4b02-a01f-722d05fbaf25 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:41.718282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a56d9504-0777-4b02-a01f-722d05fbaf25 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:41.724731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a56d9504-0777-4b02-a01f-722d05fbaf25 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:41.725252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a56d9504-0777-4b02-a01f-722d05fbaf25 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:41.725696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a56d9504-0777-4b02-a01f-722d05fbaf25 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:41.726390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a56d9504-0777-4b02-a01f-722d05fbaf25 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:41.726850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a56d9504-0777-4b02-a01f-722d05fbaf25 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:41.727278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a56d9504-0777-4b02-a01f-722d05fbaf25 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:41.759834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a56d9504-0777-4b02-a01f-722d05fbaf25 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047708 Aug 08 08:47:41.760294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 372/728] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:47:41 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:42.772803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dcfe7cac-938d-415f-b7e5-81bda69a9905 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:42.775162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dcfe7cac-938d-415f-b7e5-81bda69a9905 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:42.777085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:42.782588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcfe7cac-938d-415f-b7e5-81bda69a9905 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:42.783069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcfe7cac-938d-415f-b7e5-81bda69a9905 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:42.787594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcfe7cac-938d-415f-b7e5-81bda69a9905 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:42.787594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcfe7cac-938d-415f-b7e5-81bda69a9905 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:42.787594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcfe7cac-938d-415f-b7e5-81bda69a9905 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:42.787594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcfe7cac-938d-415f-b7e5-81bda69a9905 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:42.817054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dcfe7cac-938d-415f-b7e5-81bda69a9905 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048980 Aug 08 08:47:42.817747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 357/729] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:47:42 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:43.830279 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-388f929b-842f-4a0a-babc-1bddee7c15cc tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:43.832274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-388f929b-842f-4a0a-babc-1bddee7c15cc tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:43.838743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-388f929b-842f-4a0a-babc-1bddee7c15cc tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:43.839340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-388f929b-842f-4a0a-babc-1bddee7c15cc tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:43.839784 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-388f929b-842f-4a0a-babc-1bddee7c15cc tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:43.840471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-388f929b-842f-4a0a-babc-1bddee7c15cc tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:43.840939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-388f929b-842f-4a0a-babc-1bddee7c15cc tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:43.841389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-388f929b-842f-4a0a-babc-1bddee7c15cc tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:43.871563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-388f929b-842f-4a0a-babc-1bddee7c15cc tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045994 Aug 08 08:47:43.872117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 373/730] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:47:43 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:44.883952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c1b6d63d-c8e3-4ff1-887c-030ecf4714ad tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:44.886114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c1b6d63d-c8e3-4ff1-887c-030ecf4714ad tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:44.893996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1b6d63d-c8e3-4ff1-887c-030ecf4714ad tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:44.894482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1b6d63d-c8e3-4ff1-887c-030ecf4714ad tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:44.894924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1b6d63d-c8e3-4ff1-887c-030ecf4714ad tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:44.895640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1b6d63d-c8e3-4ff1-887c-030ecf4714ad tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:44.896096 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1b6d63d-c8e3-4ff1-887c-030ecf4714ad tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:44.896526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1b6d63d-c8e3-4ff1-887c-030ecf4714ad tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:44.926335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c1b6d63d-c8e3-4ff1-887c-030ecf4714ad tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046434 Aug 08 08:47:44.926888 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 358/731] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:47:44 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:45.938529 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f88a98b7-fe1d-4970-8d1e-33c9ea866ee9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:45.940686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f88a98b7-fe1d-4970-8d1e-33c9ea866ee9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:45.947227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f88a98b7-fe1d-4970-8d1e-33c9ea866ee9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:45.947710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f88a98b7-fe1d-4970-8d1e-33c9ea866ee9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:45.948147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f88a98b7-fe1d-4970-8d1e-33c9ea866ee9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:45.948846 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f88a98b7-fe1d-4970-8d1e-33c9ea866ee9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:45.949343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f88a98b7-fe1d-4970-8d1e-33c9ea866ee9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:45.949772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f88a98b7-fe1d-4970-8d1e-33c9ea866ee9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:45.980996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f88a98b7-fe1d-4970-8d1e-33c9ea866ee9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046504 Aug 08 08:47:45.981832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 374/732] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:47:45 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:46.993063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1e2f16fe-abd5-449d-baa8-e1fda1d207e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:46.995843 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1e2f16fe-abd5-449d-baa8-e1fda1d207e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:47.003464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f16fe-abd5-449d-baa8-e1fda1d207e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:47.003962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f16fe-abd5-449d-baa8-e1fda1d207e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:47.004410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f16fe-abd5-449d-baa8-e1fda1d207e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:47.005160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f16fe-abd5-449d-baa8-e1fda1d207e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:47.005657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f16fe-abd5-449d-baa8-e1fda1d207e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:47.006090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f16fe-abd5-449d-baa8-e1fda1d207e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:47.035538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1e2f16fe-abd5-449d-baa8-e1fda1d207e0 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046305 Aug 08 08:47:47.036093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 359/733] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:47:46 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:48.048881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-05fcb5ce-6500-4ec9-90fc-3dcfebf2b61d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:48.051235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-05fcb5ce-6500-4ec9-90fc-3dcfebf2b61d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:48.057847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05fcb5ce-6500-4ec9-90fc-3dcfebf2b61d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:48.058337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05fcb5ce-6500-4ec9-90fc-3dcfebf2b61d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:48.058788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05fcb5ce-6500-4ec9-90fc-3dcfebf2b61d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:48.059572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05fcb5ce-6500-4ec9-90fc-3dcfebf2b61d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:48.060037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05fcb5ce-6500-4ec9-90fc-3dcfebf2b61d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:48.060476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05fcb5ce-6500-4ec9-90fc-3dcfebf2b61d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:48.089516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-05fcb5ce-6500-4ec9-90fc-3dcfebf2b61d tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Aug 08 08:47:48.090079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 375/734] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:47:48 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:49.102482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a27ccb66-607f-458b-83a1-9b2113a0905f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:49.104858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a27ccb66-607f-458b-83a1-9b2113a0905f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:49.114643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a27ccb66-607f-458b-83a1-9b2113a0905f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:49.115131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a27ccb66-607f-458b-83a1-9b2113a0905f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:49.115570 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a27ccb66-607f-458b-83a1-9b2113a0905f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:49.116263 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a27ccb66-607f-458b-83a1-9b2113a0905f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:49.116717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a27ccb66-607f-458b-83a1-9b2113a0905f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:49.117161 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a27ccb66-607f-458b-83a1-9b2113a0905f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:49.132822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:47:49.148451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a27ccb66-607f-458b-83a1-9b2113a0905f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049993 Aug 08 08:47:49.149256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 360/735] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:47:49 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:49.812289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8d387f1c-c235-4f7f-aed9-edbd904e0790 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:49.814532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8d387f1c-c235-4f7f-aed9-edbd904e0790 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:49.821712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d387f1c-c235-4f7f-aed9-edbd904e0790 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:49.822212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d387f1c-c235-4f7f-aed9-edbd904e0790 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:49.822645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d387f1c-c235-4f7f-aed9-edbd904e0790 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:49.823345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d387f1c-c235-4f7f-aed9-edbd904e0790 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:49.823805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d387f1c-c235-4f7f-aed9-edbd904e0790 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:49.824232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d387f1c-c235-4f7f-aed9-edbd904e0790 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:49.853800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8d387f1c-c235-4f7f-aed9-edbd904e0790 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 Aug 08 08:47:49.854360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 376/736] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:47:49 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:49.866185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dd1f07da-1f68-4c11-a758-9ff761f59b95 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:49.866766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dd1f07da-1f68-4c11-a758-9ff761f59b95 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:49.872997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd1f07da-1f68-4c11-a758-9ff761f59b95 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:49.874175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd1f07da-1f68-4c11-a758-9ff761f59b95 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:49.874613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd1f07da-1f68-4c11-a758-9ff761f59b95 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:49.875300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd1f07da-1f68-4c11-a758-9ff761f59b95 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:49.875749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd1f07da-1f68-4c11-a758-9ff761f59b95 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:49.876173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd1f07da-1f68-4c11-a758-9ff761f59b95 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:49.904644 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dd1f07da-1f68-4c11-a758-9ff761f59b95 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments/f240393c-98c9-46de-84b2-d5b0a186b2a5" status: 200 len: 194 microversion: 2.1 time: 0.042872 Aug 08 08:47:49.905376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 361/737] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Aug 8 08:47:49 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments/f240393c-98c9-46de-84b2-d5b0a186b2a5 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:50.160676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-effd4b91-11ec-4fe6-9164-79d420aa9e34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:50.162882 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-effd4b91-11ec-4fe6-9164-79d420aa9e34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:50.168851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-effd4b91-11ec-4fe6-9164-79d420aa9e34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:50.169376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-effd4b91-11ec-4fe6-9164-79d420aa9e34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:50.169817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-effd4b91-11ec-4fe6-9164-79d420aa9e34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:50.171062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-effd4b91-11ec-4fe6-9164-79d420aa9e34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:50.171522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-effd4b91-11ec-4fe6-9164-79d420aa9e34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:50.171949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-effd4b91-11ec-4fe6-9164-79d420aa9e34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:50.204154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-effd4b91-11ec-4fe6-9164-79d420aa9e34 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047331 Aug 08 08:47:50.204726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 377/738] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:47:50 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 08:47:50.268466 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-73162fa1-948b-4397-9fc5-f5fd07629660 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:50.268954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-73162fa1-948b-4397-9fc5-f5fd07629660 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:50.275841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73162fa1-948b-4397-9fc5-f5fd07629660 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:50.276340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73162fa1-948b-4397-9fc5-f5fd07629660 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:50.277015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73162fa1-948b-4397-9fc5-f5fd07629660 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:50.283801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73162fa1-948b-4397-9fc5-f5fd07629660 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:50.283801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73162fa1-948b-4397-9fc5-f5fd07629660 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:50.283801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73162fa1-948b-4397-9fc5-f5fd07629660 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:50.305167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-73162fa1-948b-4397-9fc5-f5fd07629660 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Going to try to terminate instance {{(pid=124673) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:47:50.577001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-73162fa1-948b-4397-9fc5-f5fd07629660 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 204 len: 0 microversion: 2.1 time: 0.311547 Aug 08 08:47:50.577619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 362/739] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:47:50 2022] DELETE /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:47:50.586713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-229cf697-5026-4af2-b0ff-623e43837dd6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:50.587335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-229cf697-5026-4af2-b0ff-623e43837dd6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:50.594217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-229cf697-5026-4af2-b0ff-623e43837dd6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:50.594874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-229cf697-5026-4af2-b0ff-623e43837dd6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:50.595318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-229cf697-5026-4af2-b0ff-623e43837dd6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:50.597289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-229cf697-5026-4af2-b0ff-623e43837dd6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:50.598698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-229cf697-5026-4af2-b0ff-623e43837dd6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:50.599767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-229cf697-5026-4af2-b0ff-623e43837dd6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:50.742915 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-229cf697-5026-4af2-b0ff-623e43837dd6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:50.750668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-229cf697-5026-4af2-b0ff-623e43837dd6 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1682 microversion: 2.1 time: 0.168462 Aug 08 08:47:50.751237 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 378/740] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:50 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:51.571590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-df211d84-8f39-438a-943d-cbf412846e52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9f63b17-bcae-4f8b-8815-e4ecce7b8855"}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:51.574322 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-df211d84-8f39-438a-943d-cbf412846e52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:51.581723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df211d84-8f39-438a-943d-cbf412846e52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:51.582281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df211d84-8f39-438a-943d-cbf412846e52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:51.582781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df211d84-8f39-438a-943d-cbf412846e52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:51.583545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df211d84-8f39-438a-943d-cbf412846e52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:51.584067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df211d84-8f39-438a-943d-cbf412846e52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:51.584720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df211d84-8f39-438a-943d-cbf412846e52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:51.772007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4d823cba-36f4-4fac-bcf9-830b37fcd69f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:51.772550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4d823cba-36f4-4fac-bcf9-830b37fcd69f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:51.779002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d823cba-36f4-4fac-bcf9-830b37fcd69f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:51.779559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d823cba-36f4-4fac-bcf9-830b37fcd69f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:51.779993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d823cba-36f4-4fac-bcf9-830b37fcd69f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:51.780682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d823cba-36f4-4fac-bcf9-830b37fcd69f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:51.781134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d823cba-36f4-4fac-bcf9-830b37fcd69f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:51.781582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d823cba-36f4-4fac-bcf9-830b37fcd69f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:51.916766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4d823cba-36f4-4fac-bcf9-830b37fcd69f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:51.924676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4d823cba-36f4-4fac-bcf9-830b37fcd69f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1682 microversion: 2.1 time: 0.156562 Aug 08 08:47:51.925260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 379/741] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:51 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:52.614408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-df211d84-8f39-438a-943d-cbf412846e52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "POST /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.047590 Aug 08 08:47:52.620152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 363/742] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:47:51 2022] POST /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments => generated 194 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:52.948413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5597db28-d1c1-4d53-abd7-fef831443ff9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:52.949197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5597db28-d1c1-4d53-abd7-fef831443ff9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:52.957512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5597db28-d1c1-4d53-abd7-fef831443ff9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:52.958007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5597db28-d1c1-4d53-abd7-fef831443ff9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:52.958445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5597db28-d1c1-4d53-abd7-fef831443ff9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:52.959180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5597db28-d1c1-4d53-abd7-fef831443ff9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:52.959638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5597db28-d1c1-4d53-abd7-fef831443ff9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:52.960064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5597db28-d1c1-4d53-abd7-fef831443ff9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:53.060306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5597db28-d1c1-4d53-abd7-fef831443ff9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:53.069349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5597db28-d1c1-4d53-abd7-fef831443ff9 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1614 microversion: 2.1 time: 0.126378 Aug 08 08:47:53.069866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 380/743] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:52 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1614 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:53.269097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-e47a97dd-536b-40c3-8a5c-5bf58411cfa2 req-e063b424-b248-48de-8055-f8465981042b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e76361-0be7-4cf0-a3e1-7ba5a1245905", "name": "network-vif-deleted", "tag": "efcb8c59-959e-4f15-8786-52dcf3c27016"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:53.286346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-e47a97dd-536b-40c3-8a5c-5bf58411cfa2 req-e063b424-b248-48de-8055-f8465981042b service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:53.286837 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-e47a97dd-536b-40c3-8a5c-5bf58411cfa2 req-e063b424-b248-48de-8055-f8465981042b service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:53.287270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-e47a97dd-536b-40c3-8a5c-5bf58411cfa2 req-e063b424-b248-48de-8055-f8465981042b service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:53.327913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-e47a97dd-536b-40c3-8a5c-5bf58411cfa2 req-e063b424-b248-48de-8055-f8465981042b service nova] Creating event network-vif-deleted:efcb8c59-959e-4f15-8786-52dcf3c27016 for instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 on hv-cinder-83697 Aug 08 08:47:53.327913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-e47a97dd-536b-40c3-8a5c-5bf58411cfa2 req-e063b424-b248-48de-8055-f8465981042b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042965 Aug 08 08:47:53.327913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 364/744] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:47:53.372352 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-732988201", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "networks": [{"uuid": "b7464812-84f8-4261-98cd-b5cd14f53a63"}]}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:53.442373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] validate_networks() for [('b7464812-84f8-4261-98cd-b5cd14f53a63', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:47:53.880413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:47:53.880837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:47:53.881353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:47:53.881762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:47:53.882205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:47:53.891265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:53.891765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:53.892174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:53.892896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:53.893396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:53.893797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:53.912148 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Getting quotas for project 9537e903aa1646ee8f3774b7dd417309. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:47:53.916410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Getting quotas for user a02c4fdcb5ad418d93e0629f604babea and project 9537e903aa1646ee8f3774b7dd417309. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:47:53.929024 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:47:53.931339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:47:54.030495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3e3c27f9-1a8e-4767-b5d0-50f757990c01 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662184 Aug 08 08:47:54.031459 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 381/745] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:47:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:47:54.042372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6a884873-9818-46d5-b42f-b1fa46eb35ef tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:54.043665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6a884873-9818-46d5-b42f-b1fa46eb35ef tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:54.090746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:54.091545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:54.101271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6a884873-9818-46d5-b42f-b1fa46eb35ef tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:54.104085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:54.104716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:54.105297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:54.106150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:54.106710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:54.107274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:54.110651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6a884873-9818-46d5-b42f-b1fa46eb35ef tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1213 microversion: 2.1 time: 0.071626 Aug 08 08:47:54.124367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 365/746] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:54 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:54.143098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:54.143666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:54.144191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:54.144660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lazy-loading 'fault' on Instance uuid 97e76361-0be7-4cf0-a3e1-7ba5a1245905 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:47:54.187597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32dcdc2e24e44a07ade44d1da330a77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce958d94ddc441e9bd10b5ae9638accc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:54.195692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-aca50267-dec7-4378-8036-874ea7b10aff tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 200 len: 1332 microversion: 2.1 time: 0.109139 Aug 08 08:47:54.196374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 382/747] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:54 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:55.131340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a1fd401d-2283-4307-a62a-974997dcfd12 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:55.131959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a1fd401d-2283-4307-a62a-974997dcfd12 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:55.139769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1fd401d-2283-4307-a62a-974997dcfd12 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:55.140244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1fd401d-2283-4307-a62a-974997dcfd12 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:55.140681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1fd401d-2283-4307-a62a-974997dcfd12 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:55.141400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1fd401d-2283-4307-a62a-974997dcfd12 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:55.141859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1fd401d-2283-4307-a62a-974997dcfd12 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:55.142288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1fd401d-2283-4307-a62a-974997dcfd12 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:55.205651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a1fd401d-2283-4307-a62a-974997dcfd12 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:55.213127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a1fd401d-2283-4307-a62a-974997dcfd12 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1217 microversion: 2.1 time: 0.085668 Aug 08 08:47:55.213790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 366/748] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:55 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:47:55.215856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:55.216466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:55.224085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:55.229125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:55.229125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:55.229125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:55.229125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:55.229462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:55.240976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 HTTP/1.1 Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:47:55.242685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:55.244267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '97e76361-0be7-4cf0-a3e1-7ba5a1245905'} Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:47:55.245215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:55.246726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:55.247948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:47:55.247948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f43b6248-de2f-4b71-a31c-52effd0fa9b3 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 404 len: 111 microversion: 2.1 time: 0.032051 Aug 08 08:47:55.247948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 383/749] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:55 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 08:47:55.253275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4724b480-a687-4d8d-ad24-5ef437fe3850 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '.version_select at 0x7f4795b6bd30>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:55.319923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4724b480-a687-4d8d-ad24-5ef437fe3850 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899082831" status: 202 len: 0 microversion: 2.1 time: 0.070414 Aug 08 08:47:55.320504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 367/750] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Aug 8 08:47:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899082831 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:47:56.234293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ee97ed40-3bcc-4408-885e-b21775a622ee tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:56.234825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ee97ed40-3bcc-4408-885e-b21775a622ee tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:56.241483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee97ed40-3bcc-4408-885e-b21775a622ee tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:56.242059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee97ed40-3bcc-4408-885e-b21775a622ee tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:56.242405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee97ed40-3bcc-4408-885e-b21775a622ee tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:56.243269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee97ed40-3bcc-4408-885e-b21775a622ee tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:56.243725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee97ed40-3bcc-4408-885e-b21775a622ee tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:56.244149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee97ed40-3bcc-4408-885e-b21775a622ee tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:56.550070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ee97ed40-3bcc-4408-885e-b21775a622ee tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:56.558058 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ee97ed40-3bcc-4408-885e-b21775a622ee tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1273 microversion: 2.1 time: 0.327713 Aug 08 08:47:56.558916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 384/751] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:56 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1273 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:57.420921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:57.421757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:57.428563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:57.429056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:57.429524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:57.430231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:57.430692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:57.431281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:57.445864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 HTTP/1.1 Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:47:57.447536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:57.449895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '97e76361-0be7-4cf0-a3e1-7ba5a1245905'} Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:47:57.450779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:57.452410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:47:57.454673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:47:57.454673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6ed29c53-e82f-4b54-ae88-d51a2adfe404 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 404 len: 111 microversion: 2.1 time: 0.032727 Aug 08 08:47:57.454673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 368/752] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:47:57 2022] DELETE /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:47:57.461162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:57.461776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 97e76361-0be7-4cf0-a3e1-7ba5a1245905] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:57.468162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:57.468642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:57.469074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:57.469798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:57.470255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:57.470677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:57.485405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 HTTP/1.1 Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:47:57.487136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:57.488557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '97e76361-0be7-4cf0-a3e1-7ba5a1245905'} Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:47:57.489407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. Aug 08 08:47:57.490847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:57.492055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance 97e76361-0be7-4cf0-a3e1-7ba5a1245905 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:47:57.492055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-18fc7974-f731-494d-8e1d-c77775a5cd58 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905" status: 404 len: 111 microversion: 2.1 time: 0.031938 Aug 08 08:47:57.492055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 385/753] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:57 2022] GET /compute/v2.1/servers/97e76361-0be7-4cf0-a3e1-7ba5a1245905 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:47:57.579528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8d7b8b61-b2e8-4883-9884-466775d825b2 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:57.580099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8d7b8b61-b2e8-4883-9884-466775d825b2 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:57.586189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7b8b61-b2e8-4883-9884-466775d825b2 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:57.586679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7b8b61-b2e8-4883-9884-466775d825b2 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:57.587123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7b8b61-b2e8-4883-9884-466775d825b2 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:57.587870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7b8b61-b2e8-4883-9884-466775d825b2 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:57.588340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7b8b61-b2e8-4883-9884-466775d825b2 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:57.588770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7b8b61-b2e8-4883-9884-466775d825b2 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:57.799307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8d7b8b61-b2e8-4883-9884-466775d825b2 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:57.806851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8d7b8b61-b2e8-4883-9884-466775d825b2 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1313 microversion: 2.1 time: 0.231491 Aug 08 08:47:57.807413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 369/754] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:57 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:47:58.165329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-2de66a1d-f560-4c35-b624-c738f34ca977 req-e5f28756-b826-4117-b005-1ce94766bb98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4deecce-39b6-427d-919a-e73401929e49", "tag": "7e464ec1-4746-49c4-a444-6137e3dc5b60"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:47:58.175258 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2de66a1d-f560-4c35-b624-c738f34ca977 req-e5f28756-b826-4117-b005-1ce94766bb98 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:58.175736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2de66a1d-f560-4c35-b624-c738f34ca977 req-e5f28756-b826-4117-b005-1ce94766bb98 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:58.176169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-2de66a1d-f560-4c35-b624-c738f34ca977 req-e5f28756-b826-4117-b005-1ce94766bb98 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:58.188493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-2de66a1d-f560-4c35-b624-c738f34ca977 req-e5f28756-b826-4117-b005-1ce94766bb98 service nova] Creating event network-changed:7e464ec1-4746-49c4-a444-6137e3dc5b60 for instance c4deecce-39b6-427d-919a-e73401929e49 on hv-cinder-83697 Aug 08 08:47:58.193485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-2de66a1d-f560-4c35-b624-c738f34ca977 req-e5f28756-b826-4117-b005-1ce94766bb98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031936 Aug 08 08:47:58.194421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 386/755] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:47:58.772170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:58.772686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:58.778968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:58.779681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:58.780115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:58.780793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:58.781281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:58.781704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:58.794492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 HTTP/1.1 Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:47:58.796615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:47:58.798155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '78a63eae-e877-4736-8882-261c5d7766b2'} Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:47:58.799041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:47:58.800509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.801917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:47:58.801917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a97603ed-dd2a-43aa-b9ed-74f78ecdcd3f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 404 len: 111 microversion: 2.1 time: 0.029695 Aug 08 08:47:58.801917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 370/756] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:47:58 2022] DELETE /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:47:58.806644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:58.807375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: 78a63eae-e877-4736-8882-261c5d7766b2] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:58.814749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:58.815232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:58.815670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:58.816369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:58.816828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:58.817318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:58.826748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b0b103f1-f9ec-476b-a5b0-dbac4da70992 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:58.827359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b0b103f1-f9ec-476b-a5b0-dbac4da70992 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:58.830922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 HTTP/1.1 Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:47:58.832544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:47:58.834135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '78a63eae-e877-4736-8882-261c5d7766b2'} Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:47:58.835003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. Aug 08 08:47:58.836379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.837683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance 78a63eae-e877-4736-8882-261c5d7766b2 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:47:58.837773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0b103f1-f9ec-476b-a5b0-dbac4da70992 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:58.837773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0b103f1-f9ec-476b-a5b0-dbac4da70992 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:58.837951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e42a6b33-2f86-4bde-b3f6-67c2f547d16f tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2" status: 404 len: 111 microversion: 2.1 time: 0.031435 Aug 08 08:47:58.838047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0b103f1-f9ec-476b-a5b0-dbac4da70992 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:58.838137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 387/757] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:58 2022] GET /compute/v2.1/servers/78a63eae-e877-4736-8882-261c5d7766b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:47:58.838231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0b103f1-f9ec-476b-a5b0-dbac4da70992 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:58.838231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0b103f1-f9ec-476b-a5b0-dbac4da70992 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:58.838231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0b103f1-f9ec-476b-a5b0-dbac4da70992 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:58.848231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:58.848231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:58.852906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:58.853681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:58.854126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:58.854829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:58.855289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:58.855718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:58.870271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: DELETE /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 HTTP/1.1 Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:47:58.871817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:47:58.873922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'f62f454f-de08-4ed1-b767-cce30f0af653'} Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:47:58.874822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:47:58.876280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.877734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:47:58.877734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0e987ebf-79c9-41fe-bd65-a289c1cf641a tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 404 len: 111 microversion: 2.1 time: 0.030644 Aug 08 08:47:58.877734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 388/758] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:47:58 2022] DELETE /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 08:47:58.881990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:47:58.882603 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: f62f454f-de08-4ed1-b767-cce30f0af653] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:47:58.888331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:58.889025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:58.889502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:58.890201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:47:58.890659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:47:58.891090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:47:58.908672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 HTTP/1.1 Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:47:58.910261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:47:58.912522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'f62f454f-de08-4ed1-b767-cce30f0af653'} Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:47:58.913905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. Aug 08 08:47:58.915638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:47:58.917966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance f62f454f-de08-4ed1-b767-cce30f0af653 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:47:58.917966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dca7e5a2-8c2b-4cf4-b6dc-b276e9ebcd85 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653" status: 404 len: 111 microversion: 2.1 time: 0.033267 Aug 08 08:47:58.917966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 389/759] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:58 2022] GET /compute/v2.1/servers/f62f454f-de08-4ed1-b767-cce30f0af653 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 08:47:59.016645 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b0b103f1-f9ec-476b-a5b0-dbac4da70992 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:47:59.024077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b0b103f1-f9ec-476b-a5b0-dbac4da70992 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1313 microversion: 2.1 time: 0.201044 Aug 08 08:47:59.024635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 371/760] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:47:58 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:48:00.044934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e03c5c55-882c-452c-a1db-963944fa394d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:00.045598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e03c5c55-882c-452c-a1db-963944fa394d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:00.052091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03c5c55-882c-452c-a1db-963944fa394d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.052580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03c5c55-882c-452c-a1db-963944fa394d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.053018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03c5c55-882c-452c-a1db-963944fa394d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.053739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03c5c55-882c-452c-a1db-963944fa394d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.054209 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03c5c55-882c-452c-a1db-963944fa394d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.054628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e03c5c55-882c-452c-a1db-963944fa394d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.186865 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e03c5c55-882c-452c-a1db-963944fa394d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:00.190324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:00.193216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-22cbbfd7-067f-48c8-8aed-94cfa676db40 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:00.195386 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-22cbbfd7-067f-48c8-8aed-94cfa676db40 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:00.196083 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e03c5c55-882c-452c-a1db-963944fa394d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1313 microversion: 2.1 time: 0.155005 Aug 08 08:48:00.196922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 390/761] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:00 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:00.202063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22cbbfd7-067f-48c8-8aed-94cfa676db40 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.202553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22cbbfd7-067f-48c8-8aed-94cfa676db40 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.203013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22cbbfd7-067f-48c8-8aed-94cfa676db40 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.203698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22cbbfd7-067f-48c8-8aed-94cfa676db40 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.204160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22cbbfd7-067f-48c8-8aed-94cfa676db40 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.204689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22cbbfd7-067f-48c8-8aed-94cfa676db40 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.237650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-22cbbfd7-067f-48c8-8aed-94cfa676db40 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049155 Aug 08 08:48:00.238395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 372/762] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:48:00 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:48:00.348939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-22715eea-0e2e-46e1-b713-84c3c04a0fa1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:00.349438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-22715eea-0e2e-46e1-b713-84c3c04a0fa1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:00.356150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22715eea-0e2e-46e1-b713-84c3c04a0fa1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.356673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22715eea-0e2e-46e1-b713-84c3c04a0fa1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.357113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22715eea-0e2e-46e1-b713-84c3c04a0fa1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.357830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22715eea-0e2e-46e1-b713-84c3c04a0fa1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.358291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22715eea-0e2e-46e1-b713-84c3c04a0fa1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.358718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22715eea-0e2e-46e1-b713-84c3c04a0fa1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.389220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-22715eea-0e2e-46e1-b713-84c3c04a0fa1 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments/f240393c-98c9-46de-84b2-d5b0a186b2a5" status: 200 len: 194 microversion: 2.1 time: 0.044369 Aug 08 08:48:00.389792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 391/763] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Aug 8 08:48:00 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments/f240393c-98c9-46de-84b2-d5b0a186b2a5 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:00.399702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e99ca1e3-99b3-423e-b6c6-b50c566e32f6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:00.400238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e99ca1e3-99b3-423e-b6c6-b50c566e32f6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:00.406175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e99ca1e3-99b3-423e-b6c6-b50c566e32f6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.406652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e99ca1e3-99b3-423e-b6c6-b50c566e32f6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.407088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e99ca1e3-99b3-423e-b6c6-b50c566e32f6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.407769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e99ca1e3-99b3-423e-b6c6-b50c566e32f6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.408225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e99ca1e3-99b3-423e-b6c6-b50c566e32f6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.408645 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e99ca1e3-99b3-423e-b6c6-b50c566e32f6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.438283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:00.438797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:00.445907 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.446402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.446841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.447537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.448001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.448433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.462616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: DELETE /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a HTTP/1.1 Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:48:00.464170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:48:00.465844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'fff4ce16-ea8e-4710-accb-cd6e5a31960a'} Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:00.466901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:48:00.468365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:00.469890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:00.469890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c9122843-a7b3-4882-9a5f-f7ebd43fcbc4 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 404 len: 111 microversion: 2.1 time: 0.031079 Aug 08 08:48:00.469890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 392/764] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:48:00 2022] DELETE /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 08:48:00.473758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:00.474371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] [instance: fff4ce16-ea8e-4710-accb-cd6e5a31960a] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:00.480412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.480886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.481358 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.482054 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:00.482517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:00.482955 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:00.491869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-e99ca1e3-99b3-423e-b6c6-b50c566e32f6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lazy-loading 'services' on Instance uuid 32a91ed7-306e-4904-8935-50892fa1e6c6 {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:48:00.497052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] HTTP exception thrown: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Request method failure captured: Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a HTTP/1.1 Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxNcougyHvkxbk70M6b9UmrrZtI7-pSo2g3mL6yXPvBgtesHn2j4T5XZjY2mw4YamIx0hYWJOfsFXzznrFYNV3Uzg5ikzBZMVh3othRJesM9vJCZKdg8cgo_huOZiFJOemO9vCfx3K-9xkxj3n1X1AGszCmIXpb6zjSdlVfDdiTaJk Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:48:00.498595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce958d94ddc441e9bd10b5ae9638accc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: ce958d94ddc441e9bd10b5ae9638accc Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1603077248 Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 32dcdc2e24e44a07ade44d1da330a77e Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeNegativeTest-1603077248-project Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:48:00.500121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'fff4ce16-ea8e-4710-accb-cd6e5a31960a'} Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:00.501050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. Aug 08 08:48:00.503439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:00.504802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] Returning 404 to user: Instance fff4ce16-ea8e-4710-accb-cd6e5a31960a could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:00.504802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3a690683-9fcd-46ec-800e-901484a52585 tempest-AttachVolumeNegativeTest-1603077248 tempest-AttachVolumeNegativeTest-1603077248-project] 10.222.0.33 "GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a" status: 404 len: 111 microversion: 2.1 time: 0.029743 Aug 08 08:48:00.504802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 393/765] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:00 2022] GET /compute/v2.1/servers/fff4ce16-ea8e-4710-accb-cd6e5a31960a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 08:48:00.712866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e99ca1e3-99b3-423e-b6c6-b50c566e32f6 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "DELETE /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments/f240393c-98c9-46de-84b2-d5b0a186b2a5" status: 202 len: 0 microversion: 2.1 time: 0.316774 Aug 08 08:48:00.713498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 373/766] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:48:00 2022] DELETE /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments/f240393c-98c9-46de-84b2-d5b0a186b2a5 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:48:01.216227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-866283b8-b9e3-4fe7-81ed-c56d71ab0576 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:01.216772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-866283b8-b9e3-4fe7-81ed-c56d71ab0576 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:01.223539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866283b8-b9e3-4fe7-81ed-c56d71ab0576 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:01.224032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866283b8-b9e3-4fe7-81ed-c56d71ab0576 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:01.224476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866283b8-b9e3-4fe7-81ed-c56d71ab0576 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:01.225195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866283b8-b9e3-4fe7-81ed-c56d71ab0576 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:01.225662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866283b8-b9e3-4fe7-81ed-c56d71ab0576 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:01.226094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866283b8-b9e3-4fe7-81ed-c56d71ab0576 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:01.429892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-866283b8-b9e3-4fe7-81ed-c56d71ab0576 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:01.437627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-866283b8-b9e3-4fe7-81ed-c56d71ab0576 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1313 microversion: 2.1 time: 0.225287 Aug 08 08:48:01.438184 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 394/767] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:01 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:02.459756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cc40cf4d-7636-4c33-ad08-efe70087dd49 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:02.461196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cc40cf4d-7636-4c33-ad08-efe70087dd49 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:02.468510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc40cf4d-7636-4c33-ad08-efe70087dd49 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:02.469077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc40cf4d-7636-4c33-ad08-efe70087dd49 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:02.469709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc40cf4d-7636-4c33-ad08-efe70087dd49 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:02.471362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc40cf4d-7636-4c33-ad08-efe70087dd49 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:02.471826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc40cf4d-7636-4c33-ad08-efe70087dd49 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:02.472420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc40cf4d-7636-4c33-ad08-efe70087dd49 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:02.692290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cc40cf4d-7636-4c33-ad08-efe70087dd49 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:02.700111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cc40cf4d-7636-4c33-ad08-efe70087dd49 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1313 microversion: 2.1 time: 0.245686 Aug 08 08:48:02.700903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 374/768] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:02 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:02.894306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-259d8f11-6a01-40b8-b892-00a103bfe8f9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:02.894861 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-259d8f11-6a01-40b8-b892-00a103bfe8f9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:02.901513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-259d8f11-6a01-40b8-b892-00a103bfe8f9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:02.902235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-259d8f11-6a01-40b8-b892-00a103bfe8f9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:02.902673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-259d8f11-6a01-40b8-b892-00a103bfe8f9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:02.903375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-259d8f11-6a01-40b8-b892-00a103bfe8f9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:02.903833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-259d8f11-6a01-40b8-b892-00a103bfe8f9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:02.904426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-259d8f11-6a01-40b8-b892-00a103bfe8f9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:02.934809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-259d8f11-6a01-40b8-b892-00a103bfe8f9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments/b9f63b17-bcae-4f8b-8815-e4ecce7b8855" status: 200 len: 194 microversion: 2.1 time: 0.045378 Aug 08 08:48:02.937950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 395/769] 10.222.0.33 () {58 vars in 1413 bytes} [Mon Aug 8 08:48:02 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments/b9f63b17-bcae-4f8b-8815-e4ecce7b8855 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:02.946364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dd32be25-7312-4944-a2d5-97313f10ff9f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:02.946863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dd32be25-7312-4944-a2d5-97313f10ff9f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:02.953089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd32be25-7312-4944-a2d5-97313f10ff9f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:02.953559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd32be25-7312-4944-a2d5-97313f10ff9f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:02.954007 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd32be25-7312-4944-a2d5-97313f10ff9f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:02.955265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd32be25-7312-4944-a2d5-97313f10ff9f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:02.955727 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd32be25-7312-4944-a2d5-97313f10ff9f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:02.956237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd32be25-7312-4944-a2d5-97313f10ff9f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:03.052031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-dd32be25-7312-4944-a2d5-97313f10ff9f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lazy-loading 'services' on Instance uuid 32a91ed7-306e-4904-8935-50892fa1e6c6 {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:48:03.244464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dd32be25-7312-4944-a2d5-97313f10ff9f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "DELETE /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments/b9f63b17-bcae-4f8b-8815-e4ecce7b8855" status: 202 len: 0 microversion: 2.1 time: 0.301604 Aug 08 08:48:03.244987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 375/770] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:48:02 2022] DELETE /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments/b9f63b17-bcae-4f8b-8815-e4ecce7b8855 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 08:48:03.724599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-20d26eee-46f2-449d-b670-2535597a583e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:03.725433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-20d26eee-46f2-449d-b670-2535597a583e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:03.732169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20d26eee-46f2-449d-b670-2535597a583e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:03.732788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20d26eee-46f2-449d-b670-2535597a583e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:03.733356 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20d26eee-46f2-449d-b670-2535597a583e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:03.734122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20d26eee-46f2-449d-b670-2535597a583e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:03.734667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20d26eee-46f2-449d-b670-2535597a583e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:03.735176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20d26eee-46f2-449d-b670-2535597a583e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:03.902319 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:03.922584 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-20d26eee-46f2-449d-b670-2535597a583e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:03.924963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=6 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:03.930963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-20d26eee-46f2-449d-b670-2535597a583e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1313 microversion: 2.1 time: 0.213182 Aug 08 08:48:03.931544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 396/771] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:03 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:04.456262 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:04.460506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9e63cffa-4829-4fd3-ad03-96064fac96c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:04.462867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9e63cffa-4829-4fd3-ad03-96064fac96c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:04.469122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e63cffa-4829-4fd3-ad03-96064fac96c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:04.469689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e63cffa-4829-4fd3-ad03-96064fac96c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:04.470222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e63cffa-4829-4fd3-ad03-96064fac96c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:04.471298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e63cffa-4829-4fd3-ad03-96064fac96c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:04.471768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e63cffa-4829-4fd3-ad03-96064fac96c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:04.472204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e63cffa-4829-4fd3-ad03-96064fac96c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:04.502860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:04.507282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9e63cffa-4829-4fd3-ad03-96064fac96c7 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052970 Aug 08 08:48:04.512826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 376/772] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:48:04 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 08:48:04.634317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-69b02e7f-8f6b-41da-9473-5860f089f596 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:04.636496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-69b02e7f-8f6b-41da-9473-5860f089f596 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:04.643589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69b02e7f-8f6b-41da-9473-5860f089f596 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:04.644088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69b02e7f-8f6b-41da-9473-5860f089f596 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:04.644527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69b02e7f-8f6b-41da-9473-5860f089f596 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:04.645262 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69b02e7f-8f6b-41da-9473-5860f089f596 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:04.645723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69b02e7f-8f6b-41da-9473-5860f089f596 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:04.646343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69b02e7f-8f6b-41da-9473-5860f089f596 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:04.649697 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-ca6d8dfb-d1a0-4f99-8f02-52906dc2430a req-61ef6e62-27d8-4946-b49c-b9cb8e891f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4deecce-39b6-427d-919a-e73401929e49", "name": "network-vif-plugged", "status": "completed", "tag": "7e464ec1-4746-49c4-a444-6137e3dc5b60"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:48:04.660240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-ca6d8dfb-d1a0-4f99-8f02-52906dc2430a req-61ef6e62-27d8-4946-b49c-b9cb8e891f81 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:04.666177 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-ca6d8dfb-d1a0-4f99-8f02-52906dc2430a req-61ef6e62-27d8-4946-b49c-b9cb8e891f81 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:04.666177 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-ca6d8dfb-d1a0-4f99-8f02-52906dc2430a req-61ef6e62-27d8-4946-b49c-b9cb8e891f81 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:04.672814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-ca6d8dfb-d1a0-4f99-8f02-52906dc2430a req-61ef6e62-27d8-4946-b49c-b9cb8e891f81 service nova] Creating event network-vif-plugged:7e464ec1-4746-49c4-a444-6137e3dc5b60 for instance c4deecce-39b6-427d-919a-e73401929e49 on hv-cinder-83697 Aug 08 08:48:04.677100 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-69b02e7f-8f6b-41da-9473-5860f089f596 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046769 Aug 08 08:48:04.677698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 397/773] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:48:04 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 08:48:04.678553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-ca6d8dfb-d1a0-4f99-8f02-52906dc2430a req-61ef6e62-27d8-4946-b49c-b9cb8e891f81 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032990 Aug 08 08:48:04.679136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 377/774] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:04.742059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4787b8df-cf6a-4dd1-98fe-bda737724484 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:04.744888 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4787b8df-cf6a-4dd1-98fe-bda737724484 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:04.749089 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4787b8df-cf6a-4dd1-98fe-bda737724484 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:04.749624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4787b8df-cf6a-4dd1-98fe-bda737724484 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:04.750076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4787b8df-cf6a-4dd1-98fe-bda737724484 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:04.750764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4787b8df-cf6a-4dd1-98fe-bda737724484 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:04.751946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4787b8df-cf6a-4dd1-98fe-bda737724484 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:04.752414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4787b8df-cf6a-4dd1-98fe-bda737724484 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:04.777818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4787b8df-cf6a-4dd1-98fe-bda737724484 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:48:04.953385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e8d6656f-e33e-48b7-8bc1-dfabded8e19e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:04.954089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e8d6656f-e33e-48b7-8bc1-dfabded8e19e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:04.961341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8d6656f-e33e-48b7-8bc1-dfabded8e19e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:04.961861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8d6656f-e33e-48b7-8bc1-dfabded8e19e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:04.962495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8d6656f-e33e-48b7-8bc1-dfabded8e19e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:04.963206 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8d6656f-e33e-48b7-8bc1-dfabded8e19e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:04.963665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8d6656f-e33e-48b7-8bc1-dfabded8e19e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:04.964270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8d6656f-e33e-48b7-8bc1-dfabded8e19e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:05.073513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4787b8df-cf6a-4dd1-98fe-bda737724484 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "DELETE /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 204 len: 0 microversion: 2.1 time: 0.334938 Aug 08 08:48:05.074176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 398/775] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:48:04 2022] DELETE /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:48:05.082833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7c842691-f67c-451e-9ae4-d6433d0d5f4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:05.084871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7c842691-f67c-451e-9ae4-d6433d0d5f4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:05.089570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7c842691-f67c-451e-9ae4-d6433d0d5f4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:05.090058 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7c842691-f67c-451e-9ae4-d6433d0d5f4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:05.090497 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7c842691-f67c-451e-9ae4-d6433d0d5f4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:05.091189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7c842691-f67c-451e-9ae4-d6433d0d5f4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:05.091644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7c842691-f67c-451e-9ae4-d6433d0d5f4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:05.092090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7c842691-f67c-451e-9ae4-d6433d0d5f4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:05.288364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e8d6656f-e33e-48b7-8bc1-dfabded8e19e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:05.295928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e8d6656f-e33e-48b7-8bc1-dfabded8e19e tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1313 microversion: 2.1 time: 0.347588 Aug 08 08:48:05.296501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 378/776] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:04 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:48:05.319013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7c842691-f67c-451e-9ae4-d6433d0d5f4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:05.328103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7c842691-f67c-451e-9ae4-d6433d0d5f4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1674 microversion: 2.1 time: 0.249372 Aug 08 08:48:05.328898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 399/777] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:05 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1674 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:06.317775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f81a02a0-5267-426a-9523-bb664ccd8c85 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:06.318471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f81a02a0-5267-426a-9523-bb664ccd8c85 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:06.325711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f81a02a0-5267-426a-9523-bb664ccd8c85 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:06.326278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f81a02a0-5267-426a-9523-bb664ccd8c85 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:06.326807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f81a02a0-5267-426a-9523-bb664ccd8c85 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:06.327559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f81a02a0-5267-426a-9523-bb664ccd8c85 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:06.328036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f81a02a0-5267-426a-9523-bb664ccd8c85 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:06.328465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f81a02a0-5267-426a-9523-bb664ccd8c85 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:06.349481 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-05ac7858-fdaf-4115-8e3f-1637a50a9f7d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:06.350550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-05ac7858-fdaf-4115-8e3f-1637a50a9f7d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:06.357904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05ac7858-fdaf-4115-8e3f-1637a50a9f7d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:06.358503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05ac7858-fdaf-4115-8e3f-1637a50a9f7d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:06.359007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05ac7858-fdaf-4115-8e3f-1637a50a9f7d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:06.359841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05ac7858-fdaf-4115-8e3f-1637a50a9f7d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:06.361075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05ac7858-fdaf-4115-8e3f-1637a50a9f7d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:06.361623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-05ac7858-fdaf-4115-8e3f-1637a50a9f7d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:06.542520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f81a02a0-5267-426a-9523-bb664ccd8c85 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:06.546280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-05ac7858-fdaf-4115-8e3f-1637a50a9f7d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:06.551174 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f81a02a0-5267-426a-9523-bb664ccd8c85 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1313 microversion: 2.1 time: 0.237723 Aug 08 08:48:06.551771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 379/778] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:06 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:06.554265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-05ac7858-fdaf-4115-8e3f-1637a50a9f7d tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1674 microversion: 2.1 time: 0.208675 Aug 08 08:48:06.554920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 400/779] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:06 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1674 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:48:07.572286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-320bced3-3983-44fd-a8ac-b6a9f0b71657 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:07.573003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-320bced3-3983-44fd-a8ac-b6a9f0b71657 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:07.575494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b009450a-5e83-4a90-99bc-e7d7ca2e3b55 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:07.576394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b009450a-5e83-4a90-99bc-e7d7ca2e3b55 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:07.579465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-320bced3-3983-44fd-a8ac-b6a9f0b71657 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:07.579960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-320bced3-3983-44fd-a8ac-b6a9f0b71657 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:07.580404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-320bced3-3983-44fd-a8ac-b6a9f0b71657 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:07.582123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-320bced3-3983-44fd-a8ac-b6a9f0b71657 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:07.582575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-320bced3-3983-44fd-a8ac-b6a9f0b71657 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:07.583011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-320bced3-3983-44fd-a8ac-b6a9f0b71657 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:07.583575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b009450a-5e83-4a90-99bc-e7d7ca2e3b55 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:07.584069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b009450a-5e83-4a90-99bc-e7d7ca2e3b55 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:07.584510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b009450a-5e83-4a90-99bc-e7d7ca2e3b55 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:07.585235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b009450a-5e83-4a90-99bc-e7d7ca2e3b55 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:07.585700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b009450a-5e83-4a90-99bc-e7d7ca2e3b55 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:07.593101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b009450a-5e83-4a90-99bc-e7d7ca2e3b55 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:07.920036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b009450a-5e83-4a90-99bc-e7d7ca2e3b55 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:07.924424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-320bced3-3983-44fd-a8ac-b6a9f0b71657 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:07.931169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b009450a-5e83-4a90-99bc-e7d7ca2e3b55 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1674 microversion: 2.1 time: 0.359603 Aug 08 08:48:07.931753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 401/780] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:07 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1674 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:48:07.933173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-320bced3-3983-44fd-a8ac-b6a9f0b71657 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1313 microversion: 2.1 time: 0.365017 Aug 08 08:48:07.933770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 380/781] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:07 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:08.567707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-e8e15881-26a9-4a03-914f-7e7972e00f94 req-4b4ed76e-03b1-4481-b4a1-5fb5f475392f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a91ed7-306e-4904-8935-50892fa1e6c6", "name": "network-vif-deleted", "tag": "eb94ab59-2c5c-4438-a1d2-1cf9c5097f71"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:48:08.577776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-e8e15881-26a9-4a03-914f-7e7972e00f94 req-4b4ed76e-03b1-4481-b4a1-5fb5f475392f service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:08.578975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-e8e15881-26a9-4a03-914f-7e7972e00f94 req-4b4ed76e-03b1-4481-b4a1-5fb5f475392f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:08.579410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-e8e15881-26a9-4a03-914f-7e7972e00f94 req-4b4ed76e-03b1-4481-b4a1-5fb5f475392f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:08.591005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-e8e15881-26a9-4a03-914f-7e7972e00f94 req-4b4ed76e-03b1-4481-b4a1-5fb5f475392f service nova] Creating event network-vif-deleted:eb94ab59-2c5c-4438-a1d2-1cf9c5097f71 for instance 32a91ed7-306e-4904-8935-50892fa1e6c6 on hv-cinder-83697 Aug 08 08:48:08.595707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-e8e15881-26a9-4a03-914f-7e7972e00f94 req-4b4ed76e-03b1-4481-b4a1-5fb5f475392f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031920 Aug 08 08:48:08.597173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 402/782] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:08.954717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:08.955279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:08.958150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-de0cec04-2af2-4ebf-a351-3368d1b6686c tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:08.958975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-de0cec04-2af2-4ebf-a351-3368d1b6686c tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:08.961206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:08.966200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:08.967210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de0cec04-2af2-4ebf-a351-3368d1b6686c tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:08.967489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:08.968069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:08.968193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de0cec04-2af2-4ebf-a351-3368d1b6686c tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:08.968766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de0cec04-2af2-4ebf-a351-3368d1b6686c tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:08.968945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:08.969278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:08.977409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de0cec04-2af2-4ebf-a351-3368d1b6686c tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:08.977693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:08.977809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de0cec04-2af2-4ebf-a351-3368d1b6686c tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:08.977809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de0cec04-2af2-4ebf-a351-3368d1b6686c tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:09.010087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:09.010783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:09.011591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:09.012686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lazy-loading 'fault' on Instance uuid 32a91ed7-306e-4904-8935-50892fa1e6c6 {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:48:09.101880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d6a9d89e394e63ba5c8182a12b4142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734d6a79fd5845f19569b2c2825fb38c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:09.113748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a1234764-ad92-4597-b9f4-26cc6bc93f52 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 200 len: 1328 microversion: 2.1 time: 0.163016 Aug 08 08:48:09.115773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 381/783] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:08 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 1328 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:09.155791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-de0cec04-2af2-4ebf-a351-3368d1b6686c tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:09.164143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-de0cec04-2af2-4ebf-a351-3368d1b6686c tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1497 microversion: 2.1 time: 0.212245 Aug 08 08:48:09.164772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 403/784] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:08 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1497 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:10.015894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-37bb2353-1a54-4e81-a43b-04ebe9fd46cd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:10.016413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-37bb2353-1a54-4e81-a43b-04ebe9fd46cd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:10.022862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37bb2353-1a54-4e81-a43b-04ebe9fd46cd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:10.023346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37bb2353-1a54-4e81-a43b-04ebe9fd46cd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:10.023784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37bb2353-1a54-4e81-a43b-04ebe9fd46cd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:10.024470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37bb2353-1a54-4e81-a43b-04ebe9fd46cd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:10.024926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37bb2353-1a54-4e81-a43b-04ebe9fd46cd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:10.025382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37bb2353-1a54-4e81-a43b-04ebe9fd46cd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:10.051052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-37bb2353-1a54-4e81-a43b-04ebe9fd46cd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Going to try to terminate instance {{(pid=124673) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:48:10.146016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:10.146625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:10.152972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:10.153491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:10.153962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:10.154647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:10.155101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:10.155524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:10.169074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] HTTP exception thrown: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Request method failure captured: Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 HTTP/1.1 Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxLzU3bRfFjcH6l16FZZFqNgO8CTVY2fyNZuAAJULBcQnw-w_wze6D5y9K-YIo8rp8oPjapmCVT4XSBbFXOmIwa6xavwtaxIqgKO3elVDxZKekSr2y4DAVV-4CfVNNKtxYWkvJ4X6-ZN8ONopiWEe3Ue8NE8ZwmoRXzsSl75fZty80 Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:48:10.170779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 81d6a9d89e394e63ba5c8182a12b4142 Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:10.172389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '32a91ed7-306e-4904-8935-50892fa1e6c6'} Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:10.173245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:10.175079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:10.176157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Returning 404 to user: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:10.176157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-78595681-7798-4782-bdaf-1303df26c52f tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 404 len: 111 microversion: 2.1 time: 0.030346 Aug 08 08:48:10.176157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 404/785] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:10 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 08:48:10.181378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c261472e-d6cf-49f0-85fe-f0a2e9e3eb19 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '.version_select at 0x7f4795c60ca0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:10.257638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c261472e-d6cf-49f0-85fe-f0a2e9e3eb19 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000362586" status: 202 len: 0 microversion: 2.1 time: 0.079831 Aug 08 08:48:10.258396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 405/786] 10.222.0.33 () {58 vars in 1221 bytes} [Mon Aug 8 08:48:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000362586 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 08:48:10.324471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-37bb2353-1a54-4e81-a43b-04ebe9fd46cd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 204 len: 0 microversion: 2.1 time: 0.312144 Aug 08 08:48:10.325066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 382/787] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:48:10 2022] DELETE /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:48:10.334453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0617896b-eea3-4a99-a2cc-e53a5efdc606 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:10.335389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0617896b-eea3-4a99-a2cc-e53a5efdc606 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:10.342081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0617896b-eea3-4a99-a2cc-e53a5efdc606 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:10.342322 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0617896b-eea3-4a99-a2cc-e53a5efdc606 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:10.342961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0617896b-eea3-4a99-a2cc-e53a5efdc606 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:10.343657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0617896b-eea3-4a99-a2cc-e53a5efdc606 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:10.344112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0617896b-eea3-4a99-a2cc-e53a5efdc606 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:10.344579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0617896b-eea3-4a99-a2cc-e53a5efdc606 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:10.476422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0617896b-eea3-4a99-a2cc-e53a5efdc606 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:10.488160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0617896b-eea3-4a99-a2cc-e53a5efdc606 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1503 microversion: 2.1 time: 0.158857 Aug 08 08:48:10.490618 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 406/788] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:10 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:48:11.510151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0fcb5a6e-073e-4556-a135-73324ffe3e7d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:11.510857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0fcb5a6e-073e-4556-a135-73324ffe3e7d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:11.517320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0fcb5a6e-073e-4556-a135-73324ffe3e7d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:11.517933 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0fcb5a6e-073e-4556-a135-73324ffe3e7d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:11.518508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0fcb5a6e-073e-4556-a135-73324ffe3e7d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:11.519234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0fcb5a6e-073e-4556-a135-73324ffe3e7d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:11.519672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0fcb5a6e-073e-4556-a135-73324ffe3e7d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:11.520104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0fcb5a6e-073e-4556-a135-73324ffe3e7d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:11.656153 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0fcb5a6e-073e-4556-a135-73324ffe3e7d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:11.664288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0fcb5a6e-073e-4556-a135-73324ffe3e7d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1503 microversion: 2.1 time: 0.158367 Aug 08 08:48:11.664855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 383/789] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:11 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:12.600922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-e0d2be1e-836e-4269-ad12-6fd2301f4f42 req-79191a5c-466f-47cc-b4dc-826c6d725b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4deecce-39b6-427d-919a-e73401929e49", "name": "network-vif-deleted", "tag": "7e464ec1-4746-49c4-a444-6137e3dc5b60"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:48:12.612420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-e0d2be1e-836e-4269-ad12-6fd2301f4f42 req-79191a5c-466f-47cc-b4dc-826c6d725b2a service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:12.618096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-e0d2be1e-836e-4269-ad12-6fd2301f4f42 req-79191a5c-466f-47cc-b4dc-826c6d725b2a service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:12.618096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-e0d2be1e-836e-4269-ad12-6fd2301f4f42 req-79191a5c-466f-47cc-b4dc-826c6d725b2a service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:12.625074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-e0d2be1e-836e-4269-ad12-6fd2301f4f42 req-79191a5c-466f-47cc-b4dc-826c6d725b2a service nova] Creating event network-vif-deleted:7e464ec1-4746-49c4-a444-6137e3dc5b60 for instance c4deecce-39b6-427d-919a-e73401929e49 on hv-cinder-83697 Aug 08 08:48:12.630157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-e0d2be1e-836e-4269-ad12-6fd2301f4f42 req-79191a5c-466f-47cc-b4dc-826c6d725b2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034656 Aug 08 08:48:12.630743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 407/790] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:12.683701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a449e9f3-0d01-4130-9f3a-5e102392dd77 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:12.684351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a449e9f3-0d01-4130-9f3a-5e102392dd77 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:12.691433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a449e9f3-0d01-4130-9f3a-5e102392dd77 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:12.691926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a449e9f3-0d01-4130-9f3a-5e102392dd77 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:12.692790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a449e9f3-0d01-4130-9f3a-5e102392dd77 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:12.693078 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a449e9f3-0d01-4130-9f3a-5e102392dd77 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:12.693655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a449e9f3-0d01-4130-9f3a-5e102392dd77 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:12.696833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a449e9f3-0d01-4130-9f3a-5e102392dd77 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:12.762485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a449e9f3-0d01-4130-9f3a-5e102392dd77 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:12.774948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a449e9f3-0d01-4130-9f3a-5e102392dd77 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 200 len: 1461 microversion: 2.1 time: 0.095086 Aug 08 08:48:12.775527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 384/791] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:12 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 1461 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:13.799438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:13.800151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: c4deecce-39b6-427d-919a-e73401929e49] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:13.806199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:13.806683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:13.807115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:13.807805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:13.808260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:13.808728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:13.825385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] HTTP exception thrown: Instance c4deecce-39b6-427d-919a-e73401929e49 could not be found. Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Request method failure captured: Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 HTTP/1.1 Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M23WDks7dYsImF8Imsnm43Uh9IHqooZ6d5Y4DwP5AhNakPfcxuxFh4ab6zTnYPHeJlzZfz2rQPl0C3sO1KIy6ZmNFDi5KVPYoNX-SFBIqGreBc7fRZonG2TiHw93rwnlHNd2IEP063sSSeIjFpf2Nin_2PCqKQsJLariuKZx1Ys45I Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 9537e903aa1646ee8f3774b7dd417309 Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-VolumesActionsTest-1490822032 Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:48:13.827055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9537e903aa1646ee8f3774b7dd417309"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9537e903aa1646ee8f3774b7dd417309"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9537e903aa1646ee8f3774b7dd417309"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9537e903aa1646ee8f3774b7dd417309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-VolumesActionsTest-1490822032 Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 9537e903aa1646ee8f3774b7dd417309 Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-VolumesActionsTest-1490822032 Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-VolumesActionsTest-1490822032-project Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: a02c4fdcb5ad418d93e0629f604babea Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-VolumesActionsTest-1490822032-project Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance c4deecce-39b6-427d-919a-e73401929e49 could not be found. Aug 08 08:48:13.828631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'c4deecce-39b6-427d-919a-e73401929e49'} Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4deecce-39b6-427d-919a-e73401929e49 could not be found. Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:13.829522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4deecce-39b6-427d-919a-e73401929e49 could not be found. Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4deecce-39b6-427d-919a-e73401929e49 could not be found. Aug 08 08:48:13.830702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.832250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Returning 404 to user: Instance c4deecce-39b6-427d-919a-e73401929e49 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:13.832250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d6898f93-7c2f-48a9-95bb-542d6182e46b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49" status: 404 len: 111 microversion: 2.1 time: 0.033734 Aug 08 08:48:13.832250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 408/792] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:13 2022] GET /compute/v2.1/servers/c4deecce-39b6-427d-919a-e73401929e49 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:48:13.904282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:13.905068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:13.912588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:13.913086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:13.913757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:13.914598 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:13.915205 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:13.915650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:13.930413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] HTTP exception thrown: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Request method failure captured: Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 HTTP/1.1 Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxLzU3bRfFjcH6l16FZZFqNgO8CTVY2fyNZuAAJULBcQnw-w_wze6D5y9K-YIo8rp8oPjapmCVT4XSBbFXOmIwa6xavwtaxIqgKO3elVDxZKekSr2y4DAVV-4CfVNNKtxYWkvJ4X6-ZN8ONopiWEe3Ue8NE8ZwmoRXzsSl75fZty80 Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:48:13.932100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 81d6a9d89e394e63ba5c8182a12b4142 Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:13.933478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '32a91ed7-306e-4904-8935-50892fa1e6c6'} Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:13.934361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:13.935800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.937235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Returning 404 to user: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:13.937235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e6ba121c-be60-4e37-bd25-8936c5d455e9 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "DELETE /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 404 len: 111 microversion: 2.1 time: 0.033300 Aug 08 08:48:13.939504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 385/793] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:48:13 2022] DELETE /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:48:13.943882 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:13.944658 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 32a91ed7-306e-4904-8935-50892fa1e6c6] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:13.951035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:13.951684 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:13.952165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:13.952877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:13.953367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:13.953797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:13.969422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] HTTP exception thrown: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Request method failure captured: Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 HTTP/1.1 Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxLzU3bRfFjcH6l16FZZFqNgO8CTVY2fyNZuAAJULBcQnw-w_wze6D5y9K-YIo8rp8oPjapmCVT4XSBbFXOmIwa6xavwtaxIqgKO3elVDxZKekSr2y4DAVV-4CfVNNKtxYWkvJ4X6-ZN8ONopiWEe3Ue8NE8ZwmoRXzsSl75fZty80 Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:48:13.971176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 81d6a9d89e394e63ba5c8182a12b4142 Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:13.973367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '32a91ed7-306e-4904-8935-50892fa1e6c6'} Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:13.974261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. Aug 08 08:48:13.975812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:13.977055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Returning 404 to user: Instance 32a91ed7-306e-4904-8935-50892fa1e6c6 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:13.977055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-00b24298-0977-4dd5-982b-21e12c8281cd tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6" status: 404 len: 111 microversion: 2.1 time: 0.034764 Aug 08 08:48:13.977055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 409/794] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:13 2022] GET /compute/v2.1/servers/32a91ed7-306e-4904-8935-50892fa1e6c6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:48:14.002937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1516798017", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "networks": [{"uuid": "b7464812-84f8-4261-98cd-b5cd14f53a63"}]}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:48:14.059725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.network.neutron [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] validate_networks() for [('b7464812-84f8-4261-98cd-b5cd14f53a63', None, None, None, None, None)] {{(pid=124673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:48:14.442099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Flavor limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:48:14.442541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Image limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:48:14.443018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Flavor pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:48:14.443503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Image pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:48:14.443917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:48:14.452892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:14.453415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:14.453873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:14.454602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:14.455058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:14.455483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:14.472402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Getting quotas for project 9537e903aa1646ee8f3774b7dd417309. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:48:14.476382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Getting quotas for user a02c4fdcb5ad418d93e0629f604babea and project 9537e903aa1646ee8f3774b7dd417309. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:48:14.487412 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Going to run 1 instances... {{(pid=124673) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:48:14.490160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:48:14.681870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8fd60517-6001-4bd0-9a35-9bc25df34b84 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683313 Aug 08 08:48:14.682698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 386/795] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:48:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:48:14.694615 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-71e86dc2-3b94-487d-b857-1b3319306a5b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:14.695225 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-71e86dc2-3b94-487d-b857-1b3319306a5b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:14.761045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-71e86dc2-3b94-487d-b857-1b3319306a5b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:14.770440 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-71e86dc2-3b94-487d-b857-1b3319306a5b tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1214 microversion: 2.1 time: 0.080349 Aug 08 08:48:14.771020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 410/796] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:14 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:48:15.326379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:15.326882 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:15.333814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:15.334302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:15.334733 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:15.335425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:15.335939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:15.336364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:15.350428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] HTTP exception thrown: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Request method failure captured: Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 HTTP/1.1 Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxLzU3bRfFjcH6l16FZZFqNgO8CTVY2fyNZuAAJULBcQnw-w_wze6D5y9K-YIo8rp8oPjapmCVT4XSBbFXOmIwa6xavwtaxIqgKO3elVDxZKekSr2y4DAVV-4CfVNNKtxYWkvJ4X6-ZN8ONopiWEe3Ue8NE8ZwmoRXzsSl75fZty80 Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:48:15.351963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: 81d6a9d89e394e63ba5c8182a12b4142 Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:48:15.353892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '8117a4bb-5bfc-41a1-a874-72c1266a8955'} Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:15.354788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:48:15.356243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:15.358556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Returning 404 to user: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:15.358556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-94ca425c-95e2-406b-a7ee-247a8373cc4e tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 404 len: 111 microversion: 2.1 time: 0.030858 Aug 08 08:48:15.358556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 387/797] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:48:15 2022] DELETE /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:48:15.362197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:15.367183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] [instance: 8117a4bb-5bfc-41a1-a874-72c1266a8955] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:15.370627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:15.371573 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:15.371573 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:15.372251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:15.372706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:15.373210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:15.387913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] HTTP exception thrown: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Request method failure captured: Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 HTTP/1.1 Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxLzU3bRfFjcH6l16FZZFqNgO8CTVY2fyNZuAAJULBcQnw-w_wze6D5y9K-YIo8rp8oPjapmCVT4XSBbFXOmIwa6xavwtaxIqgKO3elVDxZKekSr2y4DAVV-4CfVNNKtxYWkvJ4X6-ZN8ONopiWEe3Ue8NE8ZwmoRXzsSl75fZty80 Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:48:15.389455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/734d6a79fd5845f19569b2c2825fb38c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 734d6a79fd5845f19569b2c2825fb38c Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1358885357 Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 81d6a9d89e394e63ba5c8182a12b4142 Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeTestJSON-1358885357-project Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:48:15.390974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '8117a4bb-5bfc-41a1-a874-72c1266a8955'} Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:15.391938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. Aug 08 08:48:15.393461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:15.394654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] Returning 404 to user: Instance 8117a4bb-5bfc-41a1-a874-72c1266a8955 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:15.394654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-31cb58fd-f1c2-4091-93d1-2411b2f4a4d2 tempest-AttachVolumeTestJSON-1358885357 tempest-AttachVolumeTestJSON-1358885357-project] 10.222.0.33 "GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955" status: 404 len: 111 microversion: 2.1 time: 0.032597 Aug 08 08:48:15.394654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 411/798] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:15 2022] GET /compute/v2.1/servers/8117a4bb-5bfc-41a1-a874-72c1266a8955 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:48:15.793893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ead0d8dd-9af5-486c-9689-80c08cde3c98 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:15.794420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ead0d8dd-9af5-486c-9689-80c08cde3c98 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:15.801490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ead0d8dd-9af5-486c-9689-80c08cde3c98 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:15.802325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ead0d8dd-9af5-486c-9689-80c08cde3c98 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:15.803012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ead0d8dd-9af5-486c-9689-80c08cde3c98 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:15.803885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ead0d8dd-9af5-486c-9689-80c08cde3c98 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:15.804553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ead0d8dd-9af5-486c-9689-80c08cde3c98 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:15.805194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ead0d8dd-9af5-486c-9689-80c08cde3c98 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:15.875269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ead0d8dd-9af5-486c-9689-80c08cde3c98 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:15.883508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ead0d8dd-9af5-486c-9689-80c08cde3c98 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1218 microversion: 2.1 time: 0.093466 Aug 08 08:48:15.884429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 388/799] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:15 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:16.891812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6edd0b4e-e53c-4159-aab5-6e7060b9cfd7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:16.895718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6edd0b4e-e53c-4159-aab5-6e7060b9cfd7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:16.904805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3f86df24-e702-4297-8afd-f6bd7a9a8c0d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:16.924641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3f86df24-e702-4297-8afd-f6bd7a9a8c0d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:16.924739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6edd0b4e-e53c-4159-aab5-6e7060b9cfd7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:16.924739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6edd0b4e-e53c-4159-aab5-6e7060b9cfd7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:16.924739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6edd0b4e-e53c-4159-aab5-6e7060b9cfd7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:16.924739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6edd0b4e-e53c-4159-aab5-6e7060b9cfd7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:16.925590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6edd0b4e-e53c-4159-aab5-6e7060b9cfd7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:16.925590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6edd0b4e-e53c-4159-aab5-6e7060b9cfd7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:16.925766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f86df24-e702-4297-8afd-f6bd7a9a8c0d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:16.925766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f86df24-e702-4297-8afd-f6bd7a9a8c0d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:16.925766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f86df24-e702-4297-8afd-f6bd7a9a8c0d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:16.925766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f86df24-e702-4297-8afd-f6bd7a9a8c0d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:16.926051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f86df24-e702-4297-8afd-f6bd7a9a8c0d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:16.926051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f86df24-e702-4297-8afd-f6bd7a9a8c0d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:16.963917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6edd0b4e-e53c-4159-aab5-6e7060b9cfd7 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079177 Aug 08 08:48:16.966452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 412/800] 10.222.0.33 () {60 vars in 1343 bytes} [Mon Aug 8 08:48:16 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:17.063652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4bcde7aa-0413-4e99-837f-12159f74b133 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:17.064437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4bcde7aa-0413-4e99-837f-12159f74b133 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:17.071947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bcde7aa-0413-4e99-837f-12159f74b133 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:17.072717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bcde7aa-0413-4e99-837f-12159f74b133 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:17.073715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bcde7aa-0413-4e99-837f-12159f74b133 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:17.074595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bcde7aa-0413-4e99-837f-12159f74b133 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:17.075203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bcde7aa-0413-4e99-837f-12159f74b133 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:17.083866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bcde7aa-0413-4e99-837f-12159f74b133 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:17.108692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3f86df24-e702-4297-8afd-f6bd7a9a8c0d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:17.111032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:17.117126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3f86df24-e702-4297-8afd-f6bd7a9a8c0d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1274 microversion: 2.1 time: 0.217125 Aug 08 08:48:17.120852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 389/801] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:16 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:48:17.123387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4bcde7aa-0413-4e99-837f-12159f74b133 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:48:17.473228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4bcde7aa-0413-4e99-837f-12159f74b133 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 204 len: 0 microversion: 2.20 time: 0.413364 Aug 08 08:48:17.477013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 413/802] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Aug 8 08:48:17 2022] DELETE /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 08 08:48:17.484058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:17.484058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:17.489487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:17.490047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:17.490492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:17.491193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:17.491650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:17.492096 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:17.740554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:17.755443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:17.777558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:17.778854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d29608a4-b82b-4b67-8309-9e7f4baa7ee3 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.300592 Aug 08 08:48:17.780706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 390/803] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:48:17 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:48:18.147487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-098d87c2-51ed-4473-8d32-a428ed6aecf0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:18.148395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-098d87c2-51ed-4473-8d32-a428ed6aecf0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:18.156520 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-098d87c2-51ed-4473-8d32-a428ed6aecf0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:18.157179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-098d87c2-51ed-4473-8d32-a428ed6aecf0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:18.157700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-098d87c2-51ed-4473-8d32-a428ed6aecf0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:18.158789 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-098d87c2-51ed-4473-8d32-a428ed6aecf0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:18.160385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-098d87c2-51ed-4473-8d32-a428ed6aecf0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:18.160896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-098d87c2-51ed-4473-8d32-a428ed6aecf0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:18.315329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-098d87c2-51ed-4473-8d32-a428ed6aecf0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:18.323693 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-098d87c2-51ed-4473-8d32-a428ed6aecf0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1314 microversion: 2.1 time: 0.182308 Aug 08 08:48:18.324253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 414/804] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:18 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:18.804553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:18.805188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:18.807831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:18.815941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:18.815941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:18.819552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:18.819552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:18.819552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:18.819552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:19.128244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:19.136274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:19.137979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:19.139249 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-08c10497-3f4f-4f6b-a500-546131ba8b60 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1724 microversion: 2.20 time: 0.339316 Aug 08 08:48:19.151970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 391/805] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:48:18 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:48:19.355044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-716ed659-f79d-4e67-a412-cc2718592fb3 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:19.356244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-716ed659-f79d-4e67-a412-cc2718592fb3 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:19.368535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-716ed659-f79d-4e67-a412-cc2718592fb3 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:19.369367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-716ed659-f79d-4e67-a412-cc2718592fb3 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:19.370132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-716ed659-f79d-4e67-a412-cc2718592fb3 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:19.371367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-716ed659-f79d-4e67-a412-cc2718592fb3 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:19.372027 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-716ed659-f79d-4e67-a412-cc2718592fb3 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:19.372935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-716ed659-f79d-4e67-a412-cc2718592fb3 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:19.703727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-716ed659-f79d-4e67-a412-cc2718592fb3 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:19.711503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-716ed659-f79d-4e67-a412-cc2718592fb3 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1314 microversion: 2.1 time: 0.369115 Aug 08 08:48:19.729772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 415/806] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:19 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:19.994557 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-e43eec60-3960-4efd-ac46-339cd3235208 req-5b7c5689-a946-4a6e-a91a-fd3eed114ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66e16900-a0ae-4158-a8c7-0a720dc8a8d4", "tag": "ea1f3b61-34bd-4f55-b9df-fd1d8bac1bcb"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:48:20.011198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-e43eec60-3960-4efd-ac46-339cd3235208 req-5b7c5689-a946-4a6e-a91a-fd3eed114ba4 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:20.011681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-e43eec60-3960-4efd-ac46-339cd3235208 req-5b7c5689-a946-4a6e-a91a-fd3eed114ba4 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:20.012117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-e43eec60-3960-4efd-ac46-339cd3235208 req-5b7c5689-a946-4a6e-a91a-fd3eed114ba4 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:20.024295 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-e43eec60-3960-4efd-ac46-339cd3235208 req-5b7c5689-a946-4a6e-a91a-fd3eed114ba4 service nova] Creating event network-changed:ea1f3b61-34bd-4f55-b9df-fd1d8bac1bcb for instance 66e16900-a0ae-4158-a8c7-0a720dc8a8d4 on hv-cinder-83697 Aug 08 08:48:20.039246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-e43eec60-3960-4efd-ac46-339cd3235208 req-5b7c5689-a946-4a6e-a91a-fd3eed114ba4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050108 Aug 08 08:48:20.040548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 392/807] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:20.170743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:20.171473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:20.182534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:20.187577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:20.187577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:20.187577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:20.187577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:20.188050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:20.280849 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-231c4a16-eddd-4da8-a8bb-50540b4bce6e req-9294e44d-752f-48ee-9b76-08be062173bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2e00a03-eab8-4b60-bb8d-84093fbe9b22", "name": "network-vif-deleted", "tag": "259d0741-4693-45fb-b135-1c29ea66a183"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:48:20.296313 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-231c4a16-eddd-4da8-a8bb-50540b4bce6e req-9294e44d-752f-48ee-9b76-08be062173bb service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:20.297139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-231c4a16-eddd-4da8-a8bb-50540b4bce6e req-9294e44d-752f-48ee-9b76-08be062173bb service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:20.297762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-231c4a16-eddd-4da8-a8bb-50540b4bce6e req-9294e44d-752f-48ee-9b76-08be062173bb service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:20.315910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-231c4a16-eddd-4da8-a8bb-50540b4bce6e req-9294e44d-752f-48ee-9b76-08be062173bb service nova] Creating event network-vif-deleted:259d0741-4693-45fb-b135-1c29ea66a183 for instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 on hv-cinder-83697 Aug 08 08:48:20.329300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:20.332357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-231c4a16-eddd-4da8-a8bb-50540b4bce6e req-9294e44d-752f-48ee-9b76-08be062173bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298944 Aug 08 08:48:20.334038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 416/808] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:48:20.342762 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:20.349858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3e5a78c3b6c48d9a4aed7d36fd54736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2841a629bc1f4885a356218c2d0721b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:20.351081 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-85c40774-edd0-43f4-94fd-bef5472a1ee8 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 200 len: 1657 microversion: 2.20 time: 0.184695 Aug 08 08:48:20.351990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 393/809] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:48:20 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 1657 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 08:48:20.733253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9662a634-9970-45ec-97e5-cd547da1f89d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:20.733960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9662a634-9970-45ec-97e5-cd547da1f89d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:20.740890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9662a634-9970-45ec-97e5-cd547da1f89d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:20.741408 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9662a634-9970-45ec-97e5-cd547da1f89d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:20.741849 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9662a634-9970-45ec-97e5-cd547da1f89d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:20.742637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9662a634-9970-45ec-97e5-cd547da1f89d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:20.743037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9662a634-9970-45ec-97e5-cd547da1f89d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:20.743467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9662a634-9970-45ec-97e5-cd547da1f89d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:20.921094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9662a634-9970-45ec-97e5-cd547da1f89d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:20.930305 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9662a634-9970-45ec-97e5-cd547da1f89d tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1314 microversion: 2.1 time: 0.201962 Aug 08 08:48:20.931866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 417/810] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:20 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:21.379510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:21.380853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:21.387679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:21.388172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:21.388669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:21.389408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:21.389873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:21.390401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:21.406672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] HTTP exception thrown: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Request method failure captured: Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 HTTP/1.1 Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxCD_D-fDiqjHbDESOQq8js8YHCFkEfzJpwnv3nBUyaBTTpOFyGcKDrzi1eJ9AGLTHZuDrWIv6U6Ra02kzwRBH_vCdOd1U5mJiwf17_dPBJULLFw1YZVi1KTU27c4xrNk39CGaTPVLe3UwGm3BPEOqn_8ywEXV_5F2sGXtvuA5FpW4 Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:48:21.408424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: b3e5a78c3b6c48d9a4aed7d36fd54736 Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:21.409948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': 'c2e00a03-eab8-4b60-bb8d-84093fbe9b22'} Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:21.410720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:21.412331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:21.413971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Returning 404 to user: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:21.413971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ac9780ec-f6ba-44bc-9ac9-9ad64e3fd4ce tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 404 len: 111 microversion: 2.20 time: 0.035740 Aug 08 08:48:21.413971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 394/811] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:48:21 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 08:48:21.422297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8a342579-49a6-452a-995d-fce70d760de9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '.version_select at 0x7f479a46f430>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:21.554242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8a342579-49a6-452a-995d-fce70d760de9 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818017601" status: 204 len: 0 microversion: 2.20 time: 0.136042 Aug 08 08:48:21.554950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 418/812] 10.222.0.33 () {60 vars in 1262 bytes} [Mon Aug 8 08:48:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818017601 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 08:48:21.955307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1583cb23-17eb-43e1-b3bf-7a44031ffbc6 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:21.957074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1583cb23-17eb-43e1-b3bf-7a44031ffbc6 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:21.964769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1583cb23-17eb-43e1-b3bf-7a44031ffbc6 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:21.965282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1583cb23-17eb-43e1-b3bf-7a44031ffbc6 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:21.965724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1583cb23-17eb-43e1-b3bf-7a44031ffbc6 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:21.966429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1583cb23-17eb-43e1-b3bf-7a44031ffbc6 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:21.966894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1583cb23-17eb-43e1-b3bf-7a44031ffbc6 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:21.967324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1583cb23-17eb-43e1-b3bf-7a44031ffbc6 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:21.988969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:22.203131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1583cb23-17eb-43e1-b3bf-7a44031ffbc6 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:22.211415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1583cb23-17eb-43e1-b3bf-7a44031ffbc6 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1314 microversion: 2.1 time: 0.259802 Aug 08 08:48:22.212251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 395/813] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:21 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:23.236244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0bcb1c07-83d4-44dc-bbd0-741878c49e5f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:23.236782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0bcb1c07-83d4-44dc-bbd0-741878c49e5f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:23.242804 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0bcb1c07-83d4-44dc-bbd0-741878c49e5f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:23.243323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0bcb1c07-83d4-44dc-bbd0-741878c49e5f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:23.243762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0bcb1c07-83d4-44dc-bbd0-741878c49e5f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:23.244449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0bcb1c07-83d4-44dc-bbd0-741878c49e5f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:23.244903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0bcb1c07-83d4-44dc-bbd0-741878c49e5f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:23.245365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0bcb1c07-83d4-44dc-bbd0-741878c49e5f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:23.378822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0bcb1c07-83d4-44dc-bbd0-741878c49e5f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:23.386199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0bcb1c07-83d4-44dc-bbd0-741878c49e5f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1314 microversion: 2.1 time: 0.154541 Aug 08 08:48:23.386762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 419/814] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:23 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:23.804486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:23.805212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:23.812162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:23.812735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:23.813258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:23.814176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:23.814622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:23.815120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:23.831925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] HTTP exception thrown: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Request method failure captured: Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 HTTP/1.1 Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxCD_D-fDiqjHbDESOQq8js8YHCFkEfzJpwnv3nBUyaBTTpOFyGcKDrzi1eJ9AGLTHZuDrWIv6U6Ra02kzwRBH_vCdOd1U5mJiwf17_dPBJULLFw1YZVi1KTU27c4xrNk39CGaTPVLe3UwGm3BPEOqn_8ywEXV_5F2sGXtvuA5FpW4 Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:48:23.833801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: b3e5a78c3b6c48d9a4aed7d36fd54736 Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:23.835240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': 'c2e00a03-eab8-4b60-bb8d-84093fbe9b22'} Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:23.836006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:23.837321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:23.839182 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Returning 404 to user: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:23.839182 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1e39dce5-ef2d-4838-9323-73bc36546b2c tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 404 len: 111 microversion: 2.20 time: 0.036003 Aug 08 08:48:23.839182 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 396/815] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Aug 8 08:48:23 2022] DELETE /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 08:48:23.844764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:23.845758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: c2e00a03-eab8-4b60-bb8d-84093fbe9b22] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:23.852189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:23.852685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:23.853123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:23.854126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:23.854587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:23.855030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:23.868876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] HTTP exception thrown: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Request method failure captured: Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 HTTP/1.1 Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxCD_D-fDiqjHbDESOQq8js8YHCFkEfzJpwnv3nBUyaBTTpOFyGcKDrzi1eJ9AGLTHZuDrWIv6U6Ra02kzwRBH_vCdOd1U5mJiwf17_dPBJULLFw1YZVi1KTU27c4xrNk39CGaTPVLe3UwGm3BPEOqn_8ywEXV_5F2sGXtvuA5FpW4 Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:48:23.870875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: b3e5a78c3b6c48d9a4aed7d36fd54736 Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:23.872252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'c2e00a03-eab8-4b60-bb8d-84093fbe9b22'} Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:23.872985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. Aug 08 08:48:23.874552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:23.876071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Returning 404 to user: Instance c2e00a03-eab8-4b60-bb8d-84093fbe9b22 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:23.876071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ed746b9e-ece1-447e-ba9f-483b24d18f7b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22" status: 404 len: 111 microversion: 2.20 time: 0.031728 Aug 08 08:48:23.876071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 420/816] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:48:23 2022] GET /compute/v2.1/servers/c2e00a03-eab8-4b60-bb8d-84093fbe9b22 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 08:48:24.407169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9dc92f60-c9ed-48b4-929b-78627d88b993 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:24.407813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9dc92f60-c9ed-48b4-929b-78627d88b993 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:24.413852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dc92f60-c9ed-48b4-929b-78627d88b993 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:24.414334 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dc92f60-c9ed-48b4-929b-78627d88b993 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:24.414937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dc92f60-c9ed-48b4-929b-78627d88b993 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:24.415801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dc92f60-c9ed-48b4-929b-78627d88b993 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:24.416258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dc92f60-c9ed-48b4-929b-78627d88b993 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:24.416685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dc92f60-c9ed-48b4-929b-78627d88b993 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:24.463382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:24.484099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=6 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:24.574491 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9dc92f60-c9ed-48b4-929b-78627d88b993 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:24.582723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9dc92f60-c9ed-48b4-929b-78627d88b993 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1314 microversion: 2.1 time: 0.179262 Aug 08 08:48:24.583302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 397/817] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:24 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:25.368968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:25.369553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:25.371923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:25.377130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:25.377769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:25.378332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:25.379173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:25.379633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:25.380262 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:25.394288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] HTTP exception thrown: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Request method failure captured: Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: DELETE /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 HTTP/1.1 Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MxCD_D-fDiqjHbDESOQq8js8YHCFkEfzJpwnv3nBUyaBTTpOFyGcKDrzi1eJ9AGLTHZuDrWIv6U6Ra02kzwRBH_vCdOd1U5mJiwf17_dPBJULLFw1YZVi1KTU27c4xrNk39CGaTPVLe3UwGm3BPEOqn_8ywEXV_5F2sGXtvuA5FpW4 Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:48:25.395825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: b3e5a78c3b6c48d9a4aed7d36fd54736 Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:48:25.397384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '9aa423dc-c608-40ed-a783-faf7a48d13c1'} Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:25.398156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:48:25.399404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:25.400663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Returning 404 to user: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:25.400663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-03a8ac55-ae1d-46cd-a24c-5581e5af684b tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 404 len: 111 microversion: 2.20 time: 0.032091 Aug 08 08:48:25.400663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 421/818] 10.222.0.33 () {60 vars in 1280 bytes} [Mon Aug 8 08:48:25 2022] DELETE /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 08:48:25.406411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:25.409655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] [instance: 9aa423dc-c608-40ed-a783-faf7a48d13c1] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:25.414689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:25.415476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:25.416164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:25.417084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:25.417814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:25.418457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:25.435178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] HTTP exception thrown: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Request method failure captured: Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 HTTP/1.1 Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MxCD_D-fDiqjHbDESOQq8js8YHCFkEfzJpwnv3nBUyaBTTpOFyGcKDrzi1eJ9AGLTHZuDrWIv6U6Ra02kzwRBH_vCdOd1U5mJiwf17_dPBJULLFw1YZVi1KTU27c4xrNk39CGaTPVLe3UwGm3BPEOqn_8ywEXV_5F2sGXtvuA5FpW4 Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:48:25.436711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2841a629bc1f4885a356218c2d0721b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 2841a629bc1f4885a356218c2d0721b7 Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-227692507 Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: b3e5a78c3b6c48d9a4aed7d36fd54736 Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-227692507-project Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:48:25.438362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '9aa423dc-c608-40ed-a783-faf7a48d13c1'} Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:25.439132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. Aug 08 08:48:25.440884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:25.442137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] Returning 404 to user: Instance 9aa423dc-c608-40ed-a783-faf7a48d13c1 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:25.442137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-90dc72e0-bc2e-4095-81c8-711c49b13247 tempest-AttachVolumeShelveTestJSON-227692507 tempest-AttachVolumeShelveTestJSON-227692507-project] 10.222.0.33 "GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1" status: 404 len: 111 microversion: 2.20 time: 0.036014 Aug 08 08:48:25.442137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 398/819] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Aug 8 08:48:25 2022] GET /compute/v2.1/servers/9aa423dc-c608-40ed-a783-faf7a48d13c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 08:48:25.604703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0697ba1c-bc34-4e29-88be-fece33d86f0f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:25.609284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0697ba1c-bc34-4e29-88be-fece33d86f0f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:25.613187 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0697ba1c-bc34-4e29-88be-fece33d86f0f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:25.613685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0697ba1c-bc34-4e29-88be-fece33d86f0f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:25.614106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0697ba1c-bc34-4e29-88be-fece33d86f0f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:25.615249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0697ba1c-bc34-4e29-88be-fece33d86f0f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:25.615892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0697ba1c-bc34-4e29-88be-fece33d86f0f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:25.621387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0697ba1c-bc34-4e29-88be-fece33d86f0f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:25.902666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0697ba1c-bc34-4e29-88be-fece33d86f0f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:25.910824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0697ba1c-bc34-4e29-88be-fece33d86f0f tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1314 microversion: 2.1 time: 0.311122 Aug 08 08:48:25.911934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 422/820] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:25 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:26.670502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-66b08ca3-dcb9-46f3-be13-d5375c7bff25 req-ce16672e-cfa4-42ed-83ee-d83f6c4aefd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e16900-a0ae-4158-a8c7-0a720dc8a8d4", "name": "network-vif-plugged", "status": "completed", "tag": "ea1f3b61-34bd-4f55-b9df-fd1d8bac1bcb"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:48:26.681544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-66b08ca3-dcb9-46f3-be13-d5375c7bff25 req-ce16672e-cfa4-42ed-83ee-d83f6c4aefd1 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:26.682022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-66b08ca3-dcb9-46f3-be13-d5375c7bff25 req-ce16672e-cfa4-42ed-83ee-d83f6c4aefd1 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:26.682453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-66b08ca3-dcb9-46f3-be13-d5375c7bff25 req-ce16672e-cfa4-42ed-83ee-d83f6c4aefd1 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:26.695000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-66b08ca3-dcb9-46f3-be13-d5375c7bff25 req-ce16672e-cfa4-42ed-83ee-d83f6c4aefd1 service nova] Creating event network-vif-plugged:ea1f3b61-34bd-4f55-b9df-fd1d8bac1bcb for instance 66e16900-a0ae-4158-a8c7-0a720dc8a8d4 on hv-cinder-83697 Aug 08 08:48:26.700589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-66b08ca3-dcb9-46f3-be13-d5375c7bff25 req-ce16672e-cfa4-42ed-83ee-d83f6c4aefd1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033583 Aug 08 08:48:26.701542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 399/821] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:26.937071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fc8093dc-c97e-44e0-bba3-975e09d67400 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:26.937071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fc8093dc-c97e-44e0-bba3-975e09d67400 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:26.973706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8093dc-c97e-44e0-bba3-975e09d67400 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:26.973706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8093dc-c97e-44e0-bba3-975e09d67400 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:26.973706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8093dc-c97e-44e0-bba3-975e09d67400 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:26.973706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8093dc-c97e-44e0-bba3-975e09d67400 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:26.974170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8093dc-c97e-44e0-bba3-975e09d67400 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:26.974170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8093dc-c97e-44e0-bba3-975e09d67400 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:27.219303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fc8093dc-c97e-44e0-bba3-975e09d67400 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:27.228714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fc8093dc-c97e-44e0-bba3-975e09d67400 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1314 microversion: 2.1 time: 0.300157 Aug 08 08:48:27.229822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 423/822] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:26 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:28.251680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f4faec34-2392-4e79-a198-8677241d08a0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:28.252571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f4faec34-2392-4e79-a198-8677241d08a0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:28.261258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4faec34-2392-4e79-a198-8677241d08a0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:28.262763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4faec34-2392-4e79-a198-8677241d08a0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:28.263193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4faec34-2392-4e79-a198-8677241d08a0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:28.263914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4faec34-2392-4e79-a198-8677241d08a0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:28.264383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4faec34-2392-4e79-a198-8677241d08a0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:28.264842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4faec34-2392-4e79-a198-8677241d08a0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:28.589350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f4faec34-2392-4e79-a198-8677241d08a0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:28.600288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f4faec34-2392-4e79-a198-8677241d08a0 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1314 microversion: 2.1 time: 0.353256 Aug 08 08:48:28.601281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 400/823] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:28 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:29.626018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d36a3fd4-7814-4636-961b-4fac6d7a61d7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:29.627145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d36a3fd4-7814-4636-961b-4fac6d7a61d7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:29.643584 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d36a3fd4-7814-4636-961b-4fac6d7a61d7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:29.644480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d36a3fd4-7814-4636-961b-4fac6d7a61d7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:29.645122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d36a3fd4-7814-4636-961b-4fac6d7a61d7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:29.648480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d36a3fd4-7814-4636-961b-4fac6d7a61d7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:29.649499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d36a3fd4-7814-4636-961b-4fac6d7a61d7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:29.650122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d36a3fd4-7814-4636-961b-4fac6d7a61d7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:29.902092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d36a3fd4-7814-4636-961b-4fac6d7a61d7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:29.910194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d36a3fd4-7814-4636-961b-4fac6d7a61d7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1498 microversion: 2.1 time: 0.289237 Aug 08 08:48:29.910767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 424/824] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:29 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1498 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:30.724285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c3a2ad78-ff7f-4eef-b8d7-5a1657dcc1c7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:30.724947 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c3a2ad78-ff7f-4eef-b8d7-5a1657dcc1c7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:30.734336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3a2ad78-ff7f-4eef-b8d7-5a1657dcc1c7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:30.738677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3a2ad78-ff7f-4eef-b8d7-5a1657dcc1c7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:30.739439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3a2ad78-ff7f-4eef-b8d7-5a1657dcc1c7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:30.742165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3a2ad78-ff7f-4eef-b8d7-5a1657dcc1c7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:30.743287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3a2ad78-ff7f-4eef-b8d7-5a1657dcc1c7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:30.744936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3a2ad78-ff7f-4eef-b8d7-5a1657dcc1c7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:30.776611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c3a2ad78-ff7f-4eef-b8d7-5a1657dcc1c7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Going to try to terminate instance {{(pid=124673) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:48:31.147335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c3a2ad78-ff7f-4eef-b8d7-5a1657dcc1c7 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "DELETE /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 204 len: 0 microversion: 2.1 time: 0.428320 Aug 08 08:48:31.151276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 401/825] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:48:30 2022] DELETE /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:48:31.156724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2bccf365-9647-48bc-bae3-93e3d9f86e56 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:31.157392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2bccf365-9647-48bc-bae3-93e3d9f86e56 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:31.165587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bccf365-9647-48bc-bae3-93e3d9f86e56 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:31.166075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bccf365-9647-48bc-bae3-93e3d9f86e56 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:31.166512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bccf365-9647-48bc-bae3-93e3d9f86e56 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:31.167218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bccf365-9647-48bc-bae3-93e3d9f86e56 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:31.167663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bccf365-9647-48bc-bae3-93e3d9f86e56 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:31.168282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bccf365-9647-48bc-bae3-93e3d9f86e56 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:31.311831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2bccf365-9647-48bc-bae3-93e3d9f86e56 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:31.322540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2bccf365-9647-48bc-bae3-93e3d9f86e56 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1504 microversion: 2.1 time: 0.169462 Aug 08 08:48:31.323127 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 425/826] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:31 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:32.148156 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a94a3e47-3bb1-4018-beff-8cc611956837 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] Action: 'create', calling method: .version_select at 0x7f4795a2dd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2002084409", "metadata": {"Type": "work"}}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:48:32.344412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8d4be740-9a7d-4a10-a89c-8d26ac05caf5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:32.345026 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8d4be740-9a7d-4a10-a89c-8d26ac05caf5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:32.351560 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d4be740-9a7d-4a10-a89c-8d26ac05caf5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:32.352047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d4be740-9a7d-4a10-a89c-8d26ac05caf5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:32.354129 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d4be740-9a7d-4a10-a89c-8d26ac05caf5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:32.354129 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d4be740-9a7d-4a10-a89c-8d26ac05caf5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:32.354129 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d4be740-9a7d-4a10-a89c-8d26ac05caf5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:32.354405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8d4be740-9a7d-4a10-a89c-8d26ac05caf5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:32.487855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8d4be740-9a7d-4a10-a89c-8d26ac05caf5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:32.496434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8d4be740-9a7d-4a10-a89c-8d26ac05caf5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1504 microversion: 2.1 time: 0.155937 Aug 08 08:48:32.497086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 426/827] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:32 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:32.800302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a94a3e47-3bb1-4018-beff-8cc611956837 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.783202 Aug 08 08:48:32.800985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 402/828] 10.222.0.33 () {60 vars in 1156 bytes} [Mon Aug 8 08:48:32 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 785 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 08:48:32.813294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-62b07038-7967-4ee3-956b-5c86cc1bd2a3 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] Calling method '.version_select at 0x7f4795b9b5e0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:32.864968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-62b07038-7967-4ee3-956b-5c86cc1bd2a3 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9" status: 200 len: 353 microversion: 2.1 time: 0.055322 Aug 08 08:48:32.865833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 427/829] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:48:32 2022] GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:33.521335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0cc6e753-0d71-4e2f-8dff-ea36a6f5d9fd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:33.522003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0cc6e753-0d71-4e2f-8dff-ea36a6f5d9fd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:33.528132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cc6e753-0d71-4e2f-8dff-ea36a6f5d9fd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:33.528625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cc6e753-0d71-4e2f-8dff-ea36a6f5d9fd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:33.529066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cc6e753-0d71-4e2f-8dff-ea36a6f5d9fd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:33.529793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cc6e753-0d71-4e2f-8dff-ea36a6f5d9fd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:33.530255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cc6e753-0d71-4e2f-8dff-ea36a6f5d9fd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:33.530684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cc6e753-0d71-4e2f-8dff-ea36a6f5d9fd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:33.663648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0cc6e753-0d71-4e2f-8dff-ea36a6f5d9fd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:33.671041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0cc6e753-0d71-4e2f-8dff-ea36a6f5d9fd tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1504 microversion: 2.1 time: 0.157172 Aug 08 08:48:33.671612 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 403/830] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:33 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:33.879685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9a564b90-f481-44a3-890e-5227aad53998 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] Calling method '.version_select at 0x7f479a45f160>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:33.926835 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9a564b90-f481-44a3-890e-5227aad53998 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9" status: 200 len: 353 microversion: 2.1 time: 0.051435 Aug 08 08:48:33.927504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 428/831] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:48:33 2022] GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:34.691990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-809d1765-ece1-4c6d-9b9f-24712e8b74da tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:34.692532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-809d1765-ece1-4c6d-9b9f-24712e8b74da tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:34.699042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-809d1765-ece1-4c6d-9b9f-24712e8b74da tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:34.703512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-809d1765-ece1-4c6d-9b9f-24712e8b74da tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:34.703512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-809d1765-ece1-4c6d-9b9f-24712e8b74da tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:34.703512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-809d1765-ece1-4c6d-9b9f-24712e8b74da tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:34.703512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-809d1765-ece1-4c6d-9b9f-24712e8b74da tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:34.703861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-809d1765-ece1-4c6d-9b9f-24712e8b74da tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:34.829313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-809d1765-ece1-4c6d-9b9f-24712e8b74da tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:34.837048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-809d1765-ece1-4c6d-9b9f-24712e8b74da tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1504 microversion: 2.1 time: 0.149723 Aug 08 08:48:34.837648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 404/832] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:34 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:48:34.940968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-067bbc8b-2fc1-415f-afca-cbb7a098dbb2 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] Calling method '.version_select at 0x7f479a40c4c0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:34.994590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-067bbc8b-2fc1-415f-afca-cbb7a098dbb2 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9" status: 200 len: 353 microversion: 2.1 time: 0.057768 Aug 08 08:48:34.995252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 429/833] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:48:34 2022] GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:35.751162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-4d20161b-92cb-4215-a212-e93401c0a5d0 req-3571e217-1cde-4738-a0e8-a241b6ba16f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e16900-a0ae-4158-a8c7-0a720dc8a8d4", "name": "network-vif-deleted", "tag": "ea1f3b61-34bd-4f55-b9df-fd1d8bac1bcb"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:48:35.762094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-4d20161b-92cb-4215-a212-e93401c0a5d0 req-3571e217-1cde-4738-a0e8-a241b6ba16f6 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:35.762565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-4d20161b-92cb-4215-a212-e93401c0a5d0 req-3571e217-1cde-4738-a0e8-a241b6ba16f6 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:35.762996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-4d20161b-92cb-4215-a212-e93401c0a5d0 req-3571e217-1cde-4738-a0e8-a241b6ba16f6 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:35.774779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-4d20161b-92cb-4215-a212-e93401c0a5d0 req-3571e217-1cde-4738-a0e8-a241b6ba16f6 service nova] Creating event network-vif-deleted:ea1f3b61-34bd-4f55-b9df-fd1d8bac1bcb for instance 66e16900-a0ae-4158-a8c7-0a720dc8a8d4 on hv-cinder-83697 Aug 08 08:48:35.779635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-4d20161b-92cb-4215-a212-e93401c0a5d0 req-3571e217-1cde-4738-a0e8-a241b6ba16f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032392 Aug 08 08:48:35.783667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 405/834] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:35.858569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2765cc1e-2763-4d5f-9600-344fe5b2df95 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:35.859115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2765cc1e-2763-4d5f-9600-344fe5b2df95 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:35.865197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2765cc1e-2763-4d5f-9600-344fe5b2df95 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:35.865685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2765cc1e-2763-4d5f-9600-344fe5b2df95 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:35.866122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2765cc1e-2763-4d5f-9600-344fe5b2df95 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:35.866815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2765cc1e-2763-4d5f-9600-344fe5b2df95 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:35.867275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2765cc1e-2763-4d5f-9600-344fe5b2df95 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:35.867705 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2765cc1e-2763-4d5f-9600-344fe5b2df95 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:35.930061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2765cc1e-2763-4d5f-9600-344fe5b2df95 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02c4fdcb5ad418d93e0629f604babea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9537e903aa1646ee8f3774b7dd417309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:48:35.938109 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2765cc1e-2763-4d5f-9600-344fe5b2df95 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 200 len: 1299 microversion: 2.1 time: 0.083508 Aug 08 08:48:35.940918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 430/835] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:35 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:36.013215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-37bdf7c6-0aaf-4d77-abe5-cf5e305adf2a tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] Calling method '.version_select at 0x7f4795a2d3a0>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:36.062099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-37bdf7c6-0aaf-4d77-abe5-cf5e305adf2a tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9" status: 200 len: 354 microversion: 2.1 time: 0.053261 Aug 08 08:48:36.067438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 406/836] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:48:36 2022] GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:36.075806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-221e6e0e-baeb-454a-89ad-26958e4246d3 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] Calling method '.version_select at 0x7f479a48daf0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:36.122952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-221e6e0e-baeb-454a-89ad-26958e4246d3 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9" status: 200 len: 354 microversion: 2.1 time: 0.050853 Aug 08 08:48:36.123519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 431/837] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:48:36 2022] GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:36.136842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a3a93d78-15a4-48f8-9d1b-ee6040cfb3a0 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] Calling method '.version_select at 0x7f4795ce74c0>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:36.335648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a3a93d78-15a4-48f8-9d1b-ee6040cfb3a0 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9" status: 202 len: 0 microversion: 2.1 time: 0.202256 Aug 08 08:48:36.336225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 407/838] 10.222.0.33 () {58 vars in 1248 bytes} [Mon Aug 8 08:48:36 2022] DELETE /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:48:36.344425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7c046234-cfec-4db6-b5e0-5b26f12d13f4 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] Calling method '.version_select at 0x7f479a45f160>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:36.476026 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7c046234-cfec-4db6-b5e0-5b26f12d13f4 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9" status: 200 len: 353 microversion: 2.1 time: 0.135258 Aug 08 08:48:36.476608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 432/839] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:48:36 2022] GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:36.960990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:36.962098 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] [instance: 66e16900-a0ae-4158-a8c7-0a720dc8a8d4] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:48:36.968601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:36.969090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:36.969558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:36.970257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:48:36.970796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:48:36.971225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:48:36.986444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] HTTP exception thrown: Instance 66e16900-a0ae-4158-a8c7-0a720dc8a8d4 could not be found. Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Request method failure captured: Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 HTTP/1.1 Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8M23WDks7dYsImF8Imsnm43Uh9IHqooZ6d5Y4DwP5AhNakPfcxuxFh4ab6zTnYPHeJlzZfz2rQPl0C3sO1KIy6ZmNFDi5KVPYoNX-SFBIqGreBc7fRZonG2TiHw93rwnlHNd2IEP063sSSeIjFpf2Nin_2PCqKQsJLariuKZx1Ys45I Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: 9537e903aa1646ee8f3774b7dd417309 Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-VolumesActionsTest-1490822032 Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:48:36.987129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9537e903aa1646ee8f3774b7dd417309"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9537e903aa1646ee8f3774b7dd417309"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9537e903aa1646ee8f3774b7dd417309"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9537e903aa1646ee8f3774b7dd417309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-VolumesActionsTest-1490822032 Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: 9537e903aa1646ee8f3774b7dd417309 Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-VolumesActionsTest-1490822032 Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-VolumesActionsTest-1490822032-project Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: a02c4fdcb5ad418d93e0629f604babea Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-VolumesActionsTest-1490822032-project Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 66e16900-a0ae-4158-a8c7-0a720dc8a8d4 could not be found. Aug 08 08:48:36.989627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '66e16900-a0ae-4158-a8c7-0a720dc8a8d4'} Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e16900-a0ae-4158-a8c7-0a720dc8a8d4 could not be found. Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:36.990609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e16900-a0ae-4158-a8c7-0a720dc8a8d4 could not be found. Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e16900-a0ae-4158-a8c7-0a720dc8a8d4 could not be found. Aug 08 08:48:36.992168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:48:36.994765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] Returning 404 to user: Instance 66e16900-a0ae-4158-a8c7-0a720dc8a8d4 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:36.994765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cc4b72c4-9daa-4418-8c7f-98be683b9fd5 tempest-VolumesActionsTest-1490822032 tempest-VolumesActionsTest-1490822032-project] 10.222.0.33 "GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4" status: 404 len: 111 microversion: 2.1 time: 0.032982 Aug 08 08:48:36.994765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 408/840] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:48:36 2022] GET /compute/v2.1/servers/66e16900-a0ae-4158-a8c7-0a720dc8a8d4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:48:37.490771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dbdb2059-b0b6-4cf3-b923-648058e957a5 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] Calling method '.version_select at 0x7f479a3fdc10>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:37.613526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-dbdb2059-b0b6-4cf3-b923-648058e957a5 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] HTTP exception thrown: Volume a0eb6698-4148-479b-94e0-20fe2111b5e9 could not be found. Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dbdb2059-b0b6-4cf3-b923-648058e957a5 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] Request method failure captured: Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9 HTTP/1.1 Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M3f3tcBBgOZrRC0CtZBeEJpao2GYelOr3oaNQqeYtOAQP7MJU-XafTLu3T3piAolnYIoM9Yn0KqHQyan-RqG30TgXQQ_LxjR_mvnSZcFwPSk0SupWjPSioidBTXCz0ESC2ZbF3L0HWlLH9Ya_qQ9gaAhyZEjrsNAU9eSlT5v0e3Lw8 Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 27e36fc341ec4f369fa269b4585d8c9d Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-VolumesGetTestJSON-461791759 Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:48:37.615510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_27e36fc341ec4f369fa269b4585d8c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27e36fc341ec4f369fa269b4585d8c9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/27e36fc341ec4f369fa269b4585d8c9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/27e36fc341ec4f369fa269b4585d8c9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-VolumesGetTestJSON-461791759 Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 27e36fc341ec4f369fa269b4585d8c9d Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-VolumesGetTestJSON-461791759 Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-VolumesGetTestJSON-461791759-project Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 7a669e81f3994fdea127294c43913bdc Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-VolumesGetTestJSON-461791759-project Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Volume a0eb6698-4148-479b-94e0-20fe2111b5e9 could not be found. Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': 'a0eb6698-4148-479b-94e0-20fe2111b5e9'} Aug 08 08:48:37.616919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0eb6698-4148-479b-94e0-20fe2111b5e9 could not be found. (HTTP 404) (Request-ID: req-e7af8134-832e-47a9-876e-ddf9e9f9cd7c) Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:37.617991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 08:48:37.619158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0eb6698-4148-479b-94e0-20fe2111b5e9 could not be found. Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 08:48:37.620281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:48:37.621452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0eb6698-4148-479b-94e0-20fe2111b5e9 could not be found. Aug 08 08:48:37.621452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:37.621452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:48:37.621452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:37.621452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:48:37.621452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:48:37.621452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:48:37.621452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:48:37.621452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:48:37.621452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0eb6698-4148-479b-94e0-20fe2111b5e9 could not be found. Aug 08 08:48:37.621452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:48:37.622998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dbdb2059-b0b6-4cf3-b923-648058e957a5 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] Returning 404 to user: Volume a0eb6698-4148-479b-94e0-20fe2111b5e9 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:48:37.624256 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dbdb2059-b0b6-4cf3-b923-648058e957a5 tempest-VolumesGetTestJSON-461791759 tempest-VolumesGetTestJSON-461791759-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9" status: 404 len: 109 microversion: 2.1 time: 0.138174 Aug 08 08:48:37.624818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 433/841] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:48:37 2022] GET /compute/v2.1/os-volumes/a0eb6698-4148-479b-94e0-20fe2111b5e9 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 08:48:44.552663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9229be14-93c6-44bf-bdbd-dc51abe835f7 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] Calling method '.version_select at 0x7f4795a2d160>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:44.603213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9229be14-93c6-44bf-bdbd-dc51abe835f7 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c1eedd8a-096a-45b0-8c44-6cc8526f6e30" status: 200 len: 350 microversion: 2.1 time: 0.052193 Aug 08 08:48:44.603213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 409/842] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:48:44 2022] GET /compute/v2.1/os-volumes/c1eedd8a-096a-45b0-8c44-6cc8526f6e30 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:46.240151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5a0ffe76-a0e0-4f33-a317-d9c58a2e54e7 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] Calling method '.version_select at 0x7f479a48d0d0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:46.249580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:46.251053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:46.319018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5a0ffe76-a0e0-4f33-a317-d9c58a2e54e7 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/e6802893-ced7-46bd-9d5c-27ff018d3f3f" status: 200 len: 350 microversion: 2.1 time: 0.085832 Aug 08 08:48:46.319575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 434/843] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:48:46 2022] GET /compute/v2.1/os-volumes/e6802893-ced7-46bd-9d5c-27ff018d3f3f => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:49.204928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:49.206606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:48:49.213956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c66b0f81-6aa9-4876-bb39-c618f0f1fe70 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] Calling method '.version_select at 0x7f47959eb280>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:49.285281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c66b0f81-6aa9-4876-bb39-c618f0f1fe70 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f74489fc-8720-480b-bf3b-01c9215ed24c" status: 200 len: 351 microversion: 2.1 time: 0.081476 Aug 08 08:48:49.285783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 410/844] 10.222.0.33 () {58 vars in 1245 bytes} [Mon Aug 8 08:48:49 2022] GET /compute/v2.1/os-volumes/f74489fc-8720-480b-bf3b-01c9215ed24c => generated 351 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:49.305372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-270492a7-f891-4e70-8a50-8dd4beff6525 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] Calling method '.version_select at 0x7f479a3fd1f0>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:49.436029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-270492a7-f891-4e70-8a50-8dd4beff6525 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.136341 Aug 08 08:48:49.436671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 435/845] 10.222.0.33 () {58 vars in 1134 bytes} [Mon Aug 8 08:48:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:49.454301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0eb65cac-2d84-4e2a-a7ce-5d15c8c25cd5 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] Calling method '.version_select at 0x7f4795a2df70>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:49.588487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0eb65cac-2d84-4e2a-a7ce-5d15c8c25cd5 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.138144 Aug 08 08:48:49.599481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 411/846] 10.222.0.33 () {58 vars in 1149 bytes} [Mon Aug 8 08:48:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:49.608329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8bcdd0d2-99d9-45ed-ba59-3de5494be51b tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] Calling method '.version_select at 0x7f4795b9bf70>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:49.700871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8bcdd0d2-99d9-45ed-ba59-3de5494be51b tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.098037 Aug 08 08:48:49.702060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 436/847] 10.222.0.33 () {58 vars in 1134 bytes} [Mon Aug 8 08:48:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:49.722249 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-da5c4afe-5a2a-4837-821a-748b1c2d0446 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] Calling method '.version_select at 0x7f4795a0e430>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:49.838113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-da5c4afe-5a2a-4837-821a-748b1c2d0446 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.119605 Aug 08 08:48:49.838676 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 412/848] 10.222.0.33 () {58 vars in 1167 bytes} [Mon Aug 8 08:48:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:48:49.852037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-621243d1-b968-4ffb-98a1-b3c4f8fe0d73 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] Calling method '.version_select at 0x7f479a49dd30>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:49.989063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-621243d1-b968-4ffb-98a1-b3c4f8fe0d73 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.137151 Aug 08 08:48:49.989063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 437/849] 10.222.0.33 () {58 vars in 1170 bytes} [Mon Aug 8 08:48:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:50.004051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-feb66e06-1725-401a-94e3-a436d3dbd329 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] Calling method '.version_select at 0x7f47959d60d0>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:50.103805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-feb66e06-1725-401a-94e3-a436d3dbd329 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.103908 Aug 08 08:48:50.109694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 413/850] 10.222.0.33 () {58 vars in 1155 bytes} [Mon Aug 8 08:48:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:48:50.126524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-86543060-ae3c-48d8-b45c-77b2431ad877 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] Calling method '.version_select at 0x7f479a41f820>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:50.425296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-86543060-ae3c-48d8-b45c-77b2431ad877 tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.302909 Aug 08 08:48:50.426014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 438/851] 10.222.0.33 () {58 vars in 1188 bytes} [Mon Aug 8 08:48:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:48:50.441646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4e9ac6a7-3474-41a5-879e-2996eac904ee tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] Calling method '.version_select at 0x7f47959d6160>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:48:50.541139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4e9ac6a7-3474-41a5-879e-2996eac904ee tempest-VolumesTestJSON-1458688835 tempest-VolumesTestJSON-1458688835-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.103700 Aug 08 08:48:50.541900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 414/852] 10.222.0.33 () {58 vars in 1155 bytes} [Mon Aug 8 08:48:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:18.896323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1680838116", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "networks": [{"uuid": "0594f4ef-2c8a-4834-894f-6a2a75461dda"}]}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:49:18.952319 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] validate_networks() for [('0594f4ef-2c8a-4834-894f-6a2a75461dda', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:49:19.664665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:49:19.675693 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:49:19.676197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:49:19.676619 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:49:19.677039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:49:19.687116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:19.687608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:19.688038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:19.688760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:19.689426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:19.689849 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:19.709776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Getting quotas for project b0ea80c4a39f47e1a9f3d050c46fe2bb. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:49:19.713995 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Getting quotas for user d89b729776114f7ab97c7a99f5a777c2 and project b0ea80c4a39f47e1a9f3d050c46fe2bb. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:49:19.724998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:49:19.727265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:49:19.836238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-48b48708-6880-4ad8-ac36-43dd204d79d0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944554 Aug 08 08:49:19.838429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 439/853] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:49:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:49:19.851396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1372cf88-fee8-46be-a30c-3518b90a04f4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:19.852126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1372cf88-fee8-46be-a30c-3518b90a04f4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:19.923936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1372cf88-fee8-46be-a30c-3518b90a04f4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:19.931034 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1372cf88-fee8-46be-a30c-3518b90a04f4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1219 microversion: 2.1 time: 0.086078 Aug 08 08:49:19.931767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 415/854] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:19 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:20.952582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ef67f627-efb2-4b8b-8008-8641ccb42cff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:20.953345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ef67f627-efb2-4b8b-8008-8641ccb42cff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:21.018680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ef67f627-efb2-4b8b-8008-8641ccb42cff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:21.026492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ef67f627-efb2-4b8b-8008-8641ccb42cff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1219 microversion: 2.1 time: 0.078587 Aug 08 08:49:21.027051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 440/855] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:20 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:22.047818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0ac94e01-bb19-4ea7-b8e8-a79f4aa39a02 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:22.048877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0ac94e01-bb19-4ea7-b8e8-a79f4aa39a02 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:22.062685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ac94e01-bb19-4ea7-b8e8-a79f4aa39a02 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:22.064923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ac94e01-bb19-4ea7-b8e8-a79f4aa39a02 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:22.065425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ac94e01-bb19-4ea7-b8e8-a79f4aa39a02 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:22.066125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ac94e01-bb19-4ea7-b8e8-a79f4aa39a02 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:22.066612 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ac94e01-bb19-4ea7-b8e8-a79f4aa39a02 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:22.067151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ac94e01-bb19-4ea7-b8e8-a79f4aa39a02 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:22.145853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0ac94e01-bb19-4ea7-b8e8-a79f4aa39a02 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:22.154807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0ac94e01-bb19-4ea7-b8e8-a79f4aa39a02 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1271 microversion: 2.1 time: 0.111066 Aug 08 08:49:22.155469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 416/856] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:22 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:23.177681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-180197fd-7c63-4608-a0e8-fbd18e60357d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:23.179565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-180197fd-7c63-4608-a0e8-fbd18e60357d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:23.186438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-180197fd-7c63-4608-a0e8-fbd18e60357d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:23.187168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-180197fd-7c63-4608-a0e8-fbd18e60357d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:23.187772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-180197fd-7c63-4608-a0e8-fbd18e60357d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:23.188651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-180197fd-7c63-4608-a0e8-fbd18e60357d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:23.189321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-180197fd-7c63-4608-a0e8-fbd18e60357d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:23.189662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-180197fd-7c63-4608-a0e8-fbd18e60357d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:23.256735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-180197fd-7c63-4608-a0e8-fbd18e60357d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:23.270147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-180197fd-7c63-4608-a0e8-fbd18e60357d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1277 microversion: 2.1 time: 0.096203 Aug 08 08:49:23.270749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 441/857] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:23 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:24.290985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-909f154f-8346-4933-9c45-dd251073f3df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:24.293356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-909f154f-8346-4933-9c45-dd251073f3df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:24.300826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-909f154f-8346-4933-9c45-dd251073f3df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:24.304199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-909f154f-8346-4933-9c45-dd251073f3df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:24.304199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-909f154f-8346-4933-9c45-dd251073f3df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:24.304199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-909f154f-8346-4933-9c45-dd251073f3df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:24.304199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-909f154f-8346-4933-9c45-dd251073f3df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:24.304737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-909f154f-8346-4933-9c45-dd251073f3df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:24.563870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-71db0aff-d419-4872-9135-6d2382fa4474 req-6a0502f8-0084-427e-aa45-b00f2f553641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a22a3234-6e6a-4901-a390-8e621ef8134f", "tag": "7af76892-bfb7-446e-acfa-8d90f914ba2f"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:49:24.574646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-71db0aff-d419-4872-9135-6d2382fa4474 req-6a0502f8-0084-427e-aa45-b00f2f553641 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:24.575131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-71db0aff-d419-4872-9135-6d2382fa4474 req-6a0502f8-0084-427e-aa45-b00f2f553641 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:24.575560 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-71db0aff-d419-4872-9135-6d2382fa4474 req-6a0502f8-0084-427e-aa45-b00f2f553641 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:24.587075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-71db0aff-d419-4872-9135-6d2382fa4474 req-6a0502f8-0084-427e-aa45-b00f2f553641 service nova] Creating event network-changed:7af76892-bfb7-446e-acfa-8d90f914ba2f for instance a22a3234-6e6a-4901-a390-8e621ef8134f on hv-cinder-83697 Aug 08 08:49:24.588943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-909f154f-8346-4933-9c45-dd251073f3df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:24.593161 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-71db0aff-d419-4872-9135-6d2382fa4474 req-6a0502f8-0084-427e-aa45-b00f2f553641 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033047 Aug 08 08:49:24.594447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 442/858] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:49:24.612937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-909f154f-8346-4933-9c45-dd251073f3df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1319 microversion: 2.1 time: 0.325784 Aug 08 08:49:24.619607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 417/859] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:24 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:25.643910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3892579b-4e94-43c7-b0fd-0a045cd3ab81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:25.646002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3892579b-4e94-43c7-b0fd-0a045cd3ab81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:25.656068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3892579b-4e94-43c7-b0fd-0a045cd3ab81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:25.657100 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3892579b-4e94-43c7-b0fd-0a045cd3ab81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:25.657907 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3892579b-4e94-43c7-b0fd-0a045cd3ab81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:25.658843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3892579b-4e94-43c7-b0fd-0a045cd3ab81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:25.660748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3892579b-4e94-43c7-b0fd-0a045cd3ab81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:25.660748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3892579b-4e94-43c7-b0fd-0a045cd3ab81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:25.867984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3892579b-4e94-43c7-b0fd-0a045cd3ab81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:25.878357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3892579b-4e94-43c7-b0fd-0a045cd3ab81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1319 microversion: 2.1 time: 0.243186 Aug 08 08:49:25.892195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 443/860] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:25 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:26.901526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fc145459-c627-4ca4-9bfb-bc9c20be070a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:26.902136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fc145459-c627-4ca4-9bfb-bc9c20be070a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:26.911114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc145459-c627-4ca4-9bfb-bc9c20be070a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:26.915309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc145459-c627-4ca4-9bfb-bc9c20be070a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:26.915865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc145459-c627-4ca4-9bfb-bc9c20be070a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:26.916671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc145459-c627-4ca4-9bfb-bc9c20be070a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:26.919513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc145459-c627-4ca4-9bfb-bc9c20be070a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:26.920033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc145459-c627-4ca4-9bfb-bc9c20be070a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:27.123847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fc145459-c627-4ca4-9bfb-bc9c20be070a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:27.134464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fc145459-c627-4ca4-9bfb-bc9c20be070a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1319 microversion: 2.1 time: 0.238416 Aug 08 08:49:27.135033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 418/861] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:26 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:28.154388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9dfd33f8-e404-4c87-8f84-067663446ec6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:28.155689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9dfd33f8-e404-4c87-8f84-067663446ec6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:28.166150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dfd33f8-e404-4c87-8f84-067663446ec6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:28.166995 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dfd33f8-e404-4c87-8f84-067663446ec6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:28.168728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dfd33f8-e404-4c87-8f84-067663446ec6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:28.169652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dfd33f8-e404-4c87-8f84-067663446ec6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:28.170112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dfd33f8-e404-4c87-8f84-067663446ec6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:28.170876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dfd33f8-e404-4c87-8f84-067663446ec6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:28.491203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9dfd33f8-e404-4c87-8f84-067663446ec6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:28.500043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9dfd33f8-e404-4c87-8f84-067663446ec6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1319 microversion: 2.1 time: 0.349260 Aug 08 08:49:28.513443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 444/862] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:28 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:29.523757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3b07d382-7231-4d6b-87eb-31e6370afccf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:29.524383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3b07d382-7231-4d6b-87eb-31e6370afccf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:29.542908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b07d382-7231-4d6b-87eb-31e6370afccf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:29.543455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b07d382-7231-4d6b-87eb-31e6370afccf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:29.546088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b07d382-7231-4d6b-87eb-31e6370afccf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:29.546827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b07d382-7231-4d6b-87eb-31e6370afccf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:29.547303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b07d382-7231-4d6b-87eb-31e6370afccf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:29.547743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b07d382-7231-4d6b-87eb-31e6370afccf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:29.803825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3b07d382-7231-4d6b-87eb-31e6370afccf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:29.811414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3b07d382-7231-4d6b-87eb-31e6370afccf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1319 microversion: 2.1 time: 0.293230 Aug 08 08:49:29.812528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 419/863] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:29 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:30.832010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-64423b8b-71e7-4efe-963d-0d6d82a05ebc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:30.832687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-64423b8b-71e7-4efe-963d-0d6d82a05ebc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:30.838775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:49:30.844038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64423b8b-71e7-4efe-963d-0d6d82a05ebc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:30.844038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64423b8b-71e7-4efe-963d-0d6d82a05ebc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:30.844038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64423b8b-71e7-4efe-963d-0d6d82a05ebc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:30.844038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64423b8b-71e7-4efe-963d-0d6d82a05ebc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:30.844514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64423b8b-71e7-4efe-963d-0d6d82a05ebc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:30.844514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64423b8b-71e7-4efe-963d-0d6d82a05ebc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:31.023685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=8 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:49:31.048471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-64423b8b-71e7-4efe-963d-0d6d82a05ebc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:31.058336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-64423b8b-71e7-4efe-963d-0d6d82a05ebc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1319 microversion: 2.1 time: 0.230122 Aug 08 08:49:31.059183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 445/864] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:30 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:31.544037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-b2903545-74fc-4a51-b694-1506f4d31910 req-2d006d28-b430-4259-87f5-c9a16d824965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a22a3234-6e6a-4901-a390-8e621ef8134f", "name": "network-vif-plugged", "status": "completed", "tag": "7af76892-bfb7-446e-acfa-8d90f914ba2f"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:49:31.549012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:49:31.555968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-b2903545-74fc-4a51-b694-1506f4d31910 req-2d006d28-b430-4259-87f5-c9a16d824965 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:31.556456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-b2903545-74fc-4a51-b694-1506f4d31910 req-2d006d28-b430-4259-87f5-c9a16d824965 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:31.556884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-b2903545-74fc-4a51-b694-1506f4d31910 req-2d006d28-b430-4259-87f5-c9a16d824965 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:31.582820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-b2903545-74fc-4a51-b694-1506f4d31910 req-2d006d28-b430-4259-87f5-c9a16d824965 service nova] Creating event network-vif-plugged:7af76892-bfb7-446e-acfa-8d90f914ba2f for instance a22a3234-6e6a-4901-a390-8e621ef8134f on hv-cinder-83697 Aug 08 08:49:31.588910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-b2903545-74fc-4a51-b694-1506f4d31910 req-2d006d28-b430-4259-87f5-c9a16d824965 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049644 Aug 08 08:49:31.589826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 420/865] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:49:32.080580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c05d4b45-5b30-4d42-b09f-7ef8a94e1ea8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:32.081552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c05d4b45-5b30-4d42-b09f-7ef8a94e1ea8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:32.104115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05d4b45-5b30-4d42-b09f-7ef8a94e1ea8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:32.106241 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05d4b45-5b30-4d42-b09f-7ef8a94e1ea8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:32.106241 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05d4b45-5b30-4d42-b09f-7ef8a94e1ea8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:32.108044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05d4b45-5b30-4d42-b09f-7ef8a94e1ea8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:32.109679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05d4b45-5b30-4d42-b09f-7ef8a94e1ea8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:32.110342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c05d4b45-5b30-4d42-b09f-7ef8a94e1ea8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:32.578132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c05d4b45-5b30-4d42-b09f-7ef8a94e1ea8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:32.589615 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c05d4b45-5b30-4d42-b09f-7ef8a94e1ea8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1319 microversion: 2.1 time: 0.513095 Aug 08 08:49:32.590542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 446/866] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:32 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:33.613757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ffa26d2a-b72b-4621-ba72-4f8b5fe43c22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:33.614487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ffa26d2a-b72b-4621-ba72-4f8b5fe43c22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:33.632171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffa26d2a-b72b-4621-ba72-4f8b5fe43c22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:33.632687 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffa26d2a-b72b-4621-ba72-4f8b5fe43c22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:33.633133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffa26d2a-b72b-4621-ba72-4f8b5fe43c22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:33.639415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffa26d2a-b72b-4621-ba72-4f8b5fe43c22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:33.641808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffa26d2a-b72b-4621-ba72-4f8b5fe43c22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:33.641808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffa26d2a-b72b-4621-ba72-4f8b5fe43c22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:33.922567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ffa26d2a-b72b-4621-ba72-4f8b5fe43c22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:33.937279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ffa26d2a-b72b-4621-ba72-4f8b5fe43c22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1319 microversion: 2.1 time: 0.325473 Aug 08 08:49:33.937705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 421/867] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:33 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:34.961717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-16a0a079-1b6c-47a0-8260-55c437144f81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:34.962956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-16a0a079-1b6c-47a0-8260-55c437144f81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:34.971022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16a0a079-1b6c-47a0-8260-55c437144f81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:34.972093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16a0a079-1b6c-47a0-8260-55c437144f81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:34.972717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16a0a079-1b6c-47a0-8260-55c437144f81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:34.973625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16a0a079-1b6c-47a0-8260-55c437144f81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:34.974983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16a0a079-1b6c-47a0-8260-55c437144f81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:34.975569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16a0a079-1b6c-47a0-8260-55c437144f81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:35.148348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-16a0a079-1b6c-47a0-8260-55c437144f81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:35.163568 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-16a0a079-1b6c-47a0-8260-55c437144f81 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1319 microversion: 2.1 time: 0.201709 Aug 08 08:49:35.164283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 447/868] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:34 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:49:36.185598 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-de4ed045-f88b-43cd-8f32-857c88009e9b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:36.187362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-de4ed045-f88b-43cd-8f32-857c88009e9b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:36.199303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de4ed045-f88b-43cd-8f32-857c88009e9b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:36.199303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de4ed045-f88b-43cd-8f32-857c88009e9b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:36.199303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de4ed045-f88b-43cd-8f32-857c88009e9b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:36.199303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de4ed045-f88b-43cd-8f32-857c88009e9b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:36.200209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de4ed045-f88b-43cd-8f32-857c88009e9b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:36.200209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de4ed045-f88b-43cd-8f32-857c88009e9b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:36.338434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-de4ed045-f88b-43cd-8f32-857c88009e9b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:36.346442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-de4ed045-f88b-43cd-8f32-857c88009e9b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1319 microversion: 2.1 time: 0.165565 Aug 08 08:49:36.347213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 422/869] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:36 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:37.367956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-96e7ab64-89c5-4f87-aea0-f564866f9ff8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:37.368727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-96e7ab64-89c5-4f87-aea0-f564866f9ff8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:37.375142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96e7ab64-89c5-4f87-aea0-f564866f9ff8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:37.375637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96e7ab64-89c5-4f87-aea0-f564866f9ff8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:37.376121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96e7ab64-89c5-4f87-aea0-f564866f9ff8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:37.376855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96e7ab64-89c5-4f87-aea0-f564866f9ff8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:37.377344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96e7ab64-89c5-4f87-aea0-f564866f9ff8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:37.377781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96e7ab64-89c5-4f87-aea0-f564866f9ff8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:37.521596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-96e7ab64-89c5-4f87-aea0-f564866f9ff8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:37.536815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-96e7ab64-89c5-4f87-aea0-f564866f9ff8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1319 microversion: 2.1 time: 0.172698 Aug 08 08:49:37.538076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 448/870] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:37 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:38.557635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b43b2bb1-f1d7-438b-9e3b-4e42a5d5ab50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:38.559017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b43b2bb1-f1d7-438b-9e3b-4e42a5d5ab50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:38.594935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b43b2bb1-f1d7-438b-9e3b-4e42a5d5ab50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:38.597235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b43b2bb1-f1d7-438b-9e3b-4e42a5d5ab50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:38.603232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b43b2bb1-f1d7-438b-9e3b-4e42a5d5ab50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:38.604700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b43b2bb1-f1d7-438b-9e3b-4e42a5d5ab50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:38.605529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b43b2bb1-f1d7-438b-9e3b-4e42a5d5ab50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:38.606975 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b43b2bb1-f1d7-438b-9e3b-4e42a5d5ab50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:38.783622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b43b2bb1-f1d7-438b-9e3b-4e42a5d5ab50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:38.791369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b43b2bb1-f1d7-438b-9e3b-4e42a5d5ab50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1508 microversion: 2.1 time: 0.238396 Aug 08 08:49:38.805503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 423/871] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:38 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:46.122648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-65430856", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1650248059", "security_groups": [{"name": "tempest-secgroup-smoke-306397345"}], "block_device_mapping_v2": [{"uuid": "69b2e643-44c7-417b-80cd-fcb446fbcab2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aded838a-535a-491c-a5f4-94feae65f9aa"}]}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:49:46.297948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] validate_networks() for [('aded838a-535a-491c-a5f4-94feae65f9aa', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:49:46.733553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:49:46.733978 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:49:46.734453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:49:46.735000 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:49:46.735419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:49:46.750445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:46.750934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:46.751369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:46.752095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:46.752555 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:46.752982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:46.771948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Getting quotas for project e87616891fa34cd9aca388a5d101f3f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:49:46.776150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Getting quotas for user cd870619247a47ac810fea1aa636ac65 and project e87616891fa34cd9aca388a5d101f3f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:49:46.843786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:49:46.846048 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69b2e643-44c7-417b-80cd-fcb446fbcab2',volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:49:47.588442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ede0d2e8-4979-49c6-9fd6-86453eead5cd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.469537 Aug 08 08:49:47.589084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 449/872] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:49:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:49:47.632266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-504bc08c-7b34-471f-a45f-90a86519c1e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:47.633713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-504bc08c-7b34-471f-a45f-90a86519c1e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:47.711909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-504bc08c-7b34-471f-a45f-90a86519c1e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:47.719732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-504bc08c-7b34-471f-a45f-90a86519c1e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1093 microversion: 2.1 time: 0.123473 Aug 08 08:49:47.721214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 424/873] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:47 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1093 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:48.492294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4efa4de7-fe6e-414a-8199-7cfca24488cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Action: 'create', calling method: .version_select at 0x7f479a45f160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1594176557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYs74WyvMn2p9DX2WxjBjA1t/9LNVUBdEVKA0BmPyvbwwT1wfwtFQVvgigD0RWRxSAvsGA2mscY8uWC44A7zdmXn4SS7UCx9vg0J5WeLd/0MBLVcxok3deTYSVkKmG0gQ=="}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:49:48.508493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-4efa4de7-fe6e-414a-8199-7cfca24488cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Getting quotas for project 0bbf785f7de94ef7ad423568d41af122. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:49:48.512432 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-4efa4de7-fe6e-414a-8199-7cfca24488cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Getting quotas for user 891658773e7546c78c3213a3f5233fd4 and project 0bbf785f7de94ef7ad423568d41af122. Resources: {'key_pairs'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:49:48.632823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4efa4de7-fe6e-414a-8199-7cfca24488cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.144763 Aug 08 08:49:48.633535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 450/874] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 08:49:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:49:48.682640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-923378258", "imageRef": "bd174a27-3c1d-47de-b0ef-6f1841166195", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1594176557", "networks": [{"uuid": "1b6abdc0-d493-49ac-bc33-310bf1bae210"}]}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:49:48.738976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.network.neutron [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] validate_networks() for [('1b6abdc0-d493-49ac-bc33-310bf1bae210', None, None, None, None, None)] {{(pid=124673) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:49:48.741717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3bc75111-1123-404f-8df4-b9b01db669ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:48.743445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3bc75111-1123-404f-8df4-b9b01db669ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:48.754699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3bc75111-1123-404f-8df4-b9b01db669ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:48.755996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3bc75111-1123-404f-8df4-b9b01db669ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:48.757489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3bc75111-1123-404f-8df4-b9b01db669ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:48.757489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3bc75111-1123-404f-8df4-b9b01db669ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:48.757719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3bc75111-1123-404f-8df4-b9b01db669ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:48.758359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3bc75111-1123-404f-8df4-b9b01db669ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:48.788183 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=44 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:49:48.844254 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3bc75111-1123-404f-8df4-b9b01db669ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:48.852768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3bc75111-1123-404f-8df4-b9b01db669ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1143 microversion: 2.1 time: 0.116379 Aug 08 08:49:48.853577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 451/875] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:48 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1143 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:49.168388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Flavor limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:49:49.168810 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Image limits 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:49:49.169428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Flavor pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:49:49.169839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Image pref 0:0:0 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:49:49.170252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.virt.hardware [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:49:49.181228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:49.181725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:49.182158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:49.182922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:49.183439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:49.183862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:49.202521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Getting quotas for project 0bbf785f7de94ef7ad423568d41af122. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:49:49.206699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Getting quotas for user 891658773e7546c78c3213a3f5233fd4 and project 0bbf785f7de94ef7ad423568d41af122. Resources: {'instances', 'cores', 'ram'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:49:49.218002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Going to run 1 instances... {{(pid=124673) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:49:49.220230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd174a27-3c1d-47de-b0ef-6f1841166195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:49:49.354435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-854138d9-fdb8-4981-a107-bf9550818ab9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675277 Aug 08 08:49:49.355167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 425/876] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:49:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:49:49.366936 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9604befc-df35-411c-98e7-109b3f857383 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:49.367589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9604befc-df35-411c-98e7-109b3f857383 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:49.372168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=7 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:49:49.449908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9604befc-df35-411c-98e7-109b3f857383 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:49.456379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9604befc-df35-411c-98e7-109b3f857383 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1258 microversion: 2.1 time: 0.094662 Aug 08 08:49:49.457171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 452/877] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1258 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:49.875004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bbb2e31a-ee7d-4705-a393-1b764e255e42 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:49.877932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bbb2e31a-ee7d-4705-a393-1b764e255e42 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:49.879646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:49:50.046151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bbb2e31a-ee7d-4705-a393-1b764e255e42 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:50.046678 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bbb2e31a-ee7d-4705-a393-1b764e255e42 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:50.047121 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bbb2e31a-ee7d-4705-a393-1b764e255e42 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:50.047850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bbb2e31a-ee7d-4705-a393-1b764e255e42 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:50.048312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bbb2e31a-ee7d-4705-a393-1b764e255e42 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:50.048747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bbb2e31a-ee7d-4705-a393-1b764e255e42 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:50.114439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bbb2e31a-ee7d-4705-a393-1b764e255e42 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:50.122485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bbb2e31a-ee7d-4705-a393-1b764e255e42 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1135 microversion: 2.1 time: 0.252964 Aug 08 08:49:50.123049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 426/878] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:49 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1135 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:50.477694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b7253ae4-deef-4402-b198-5e73d7883e77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:50.478454 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b7253ae4-deef-4402-b198-5e73d7883e77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:50.546685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b7253ae4-deef-4402-b198-5e73d7883e77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:50.556433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b7253ae4-deef-4402-b198-5e73d7883e77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1258 microversion: 2.1 time: 0.082256 Aug 08 08:49:50.556555 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 453/879] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:50 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:51.143747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9da37aa1-aec9-4e70-9917-fbd83e36e8ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:51.144535 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9da37aa1-aec9-4e70-9917-fbd83e36e8ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:51.152067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9da37aa1-aec9-4e70-9917-fbd83e36e8ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:51.152602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9da37aa1-aec9-4e70-9917-fbd83e36e8ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:51.153087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9da37aa1-aec9-4e70-9917-fbd83e36e8ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:51.156835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9da37aa1-aec9-4e70-9917-fbd83e36e8ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:51.156835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9da37aa1-aec9-4e70-9917-fbd83e36e8ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:51.156835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9da37aa1-aec9-4e70-9917-fbd83e36e8ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:51.240277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9da37aa1-aec9-4e70-9917-fbd83e36e8ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:51.252645 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9da37aa1-aec9-4e70-9917-fbd83e36e8ff tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1199 microversion: 2.1 time: 0.111524 Aug 08 08:49:51.267069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 427/880] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:51 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1199 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:51.576325 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-543372f8-6890-43a5-8498-21b9ac8884f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:51.576947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-543372f8-6890-43a5-8498-21b9ac8884f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:51.583572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-543372f8-6890-43a5-8498-21b9ac8884f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:51.584296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-543372f8-6890-43a5-8498-21b9ac8884f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:51.584740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-543372f8-6890-43a5-8498-21b9ac8884f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:51.586353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-543372f8-6890-43a5-8498-21b9ac8884f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:51.587014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-543372f8-6890-43a5-8498-21b9ac8884f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:51.587795 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-543372f8-6890-43a5-8498-21b9ac8884f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:51.592228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=55 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:49:51.680753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-543372f8-6890-43a5-8498-21b9ac8884f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:51.687768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-543372f8-6890-43a5-8498-21b9ac8884f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1310 microversion: 2.1 time: 0.115746 Aug 08 08:49:51.688562 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 454/881] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:51 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1310 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:52.276940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6adb9757-27d3-4d15-85c9-fd16064eacf4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:52.278201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6adb9757-27d3-4d15-85c9-fd16064eacf4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:52.284151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6adb9757-27d3-4d15-85c9-fd16064eacf4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:52.284638 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6adb9757-27d3-4d15-85c9-fd16064eacf4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:52.285277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6adb9757-27d3-4d15-85c9-fd16064eacf4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:52.286569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6adb9757-27d3-4d15-85c9-fd16064eacf4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:52.287029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6adb9757-27d3-4d15-85c9-fd16064eacf4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:52.287460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6adb9757-27d3-4d15-85c9-fd16064eacf4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:52.576907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6adb9757-27d3-4d15-85c9-fd16064eacf4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:52.589087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6adb9757-27d3-4d15-85c9-fd16064eacf4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1276 microversion: 2.1 time: 0.316860 Aug 08 08:49:52.589850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 428/882] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:52 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1276 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:52.716278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d9424768-3644-4eb4-9e6b-b79e817ae209 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:52.717591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d9424768-3644-4eb4-9e6b-b79e817ae209 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:52.728446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9424768-3644-4eb4-9e6b-b79e817ae209 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:52.731943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9424768-3644-4eb4-9e6b-b79e817ae209 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:52.732899 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9424768-3644-4eb4-9e6b-b79e817ae209 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:52.735462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9424768-3644-4eb4-9e6b-b79e817ae209 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:52.737738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9424768-3644-4eb4-9e6b-b79e817ae209 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:52.744135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9424768-3644-4eb4-9e6b-b79e817ae209 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:52.907213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d9424768-3644-4eb4-9e6b-b79e817ae209 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:52.916676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d9424768-3644-4eb4-9e6b-b79e817ae209 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1316 microversion: 2.1 time: 0.209943 Aug 08 08:49:52.917263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 455/883] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:52 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:53.624668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3c4da620-ebe1-4086-93cb-e57f39e0b097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:53.627233 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3c4da620-ebe1-4086-93cb-e57f39e0b097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:53.629011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-1927acfd-23a2-461b-af58-e421295eb687 req-05ff00ea-7e72-4424-b25d-fea7d4873aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ee0e71-bef8-4c22-ac1f-1b08e564b14d", "tag": "59038d45-a91c-43ab-a6da-241301aba11f"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:49:53.647608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4da620-ebe1-4086-93cb-e57f39e0b097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:53.649038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4da620-ebe1-4086-93cb-e57f39e0b097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:53.649782 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4da620-ebe1-4086-93cb-e57f39e0b097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:53.654684 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-1927acfd-23a2-461b-af58-e421295eb687 req-05ff00ea-7e72-4424-b25d-fea7d4873aad service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:53.655934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4da620-ebe1-4086-93cb-e57f39e0b097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:53.656190 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4da620-ebe1-4086-93cb-e57f39e0b097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:53.656776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4da620-ebe1-4086-93cb-e57f39e0b097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:53.659028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-1927acfd-23a2-461b-af58-e421295eb687 req-05ff00ea-7e72-4424-b25d-fea7d4873aad service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:53.661592 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-1927acfd-23a2-461b-af58-e421295eb687 req-05ff00ea-7e72-4424-b25d-fea7d4873aad service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:53.691526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-1927acfd-23a2-461b-af58-e421295eb687 req-05ff00ea-7e72-4424-b25d-fea7d4873aad service nova] Creating event network-changed:59038d45-a91c-43ab-a6da-241301aba11f for instance e4ee0e71-bef8-4c22-ac1f-1b08e564b14d on hv-cinder-83697 Aug 08 08:49:53.699180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-1927acfd-23a2-461b-af58-e421295eb687 req-05ff00ea-7e72-4424-b25d-fea7d4873aad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083152 Aug 08 08:49:53.701317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 456/884] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:49:53.935990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3c4da620-ebe1-4086-93cb-e57f39e0b097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:53.940006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ce053e4d-28c8-4cbd-9f15-2d43633b71ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:53.940722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ce053e4d-28c8-4cbd-9f15-2d43633b71ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:53.948144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3c4da620-ebe1-4086-93cb-e57f39e0b097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.339854 Aug 08 08:49:53.949493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce053e4d-28c8-4cbd-9f15-2d43633b71ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:53.950032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 429/885] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:53 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:53.950434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce053e4d-28c8-4cbd-9f15-2d43633b71ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:53.951032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce053e4d-28c8-4cbd-9f15-2d43633b71ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:53.951752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce053e4d-28c8-4cbd-9f15-2d43633b71ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:53.952207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce053e4d-28c8-4cbd-9f15-2d43633b71ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:53.952974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce053e4d-28c8-4cbd-9f15-2d43633b71ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:54.194198 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ce053e4d-28c8-4cbd-9f15-2d43633b71ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:54.202271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ce053e4d-28c8-4cbd-9f15-2d43633b71ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.266537 Aug 08 08:49:54.203065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 457/886] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:53 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:49:54.376731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-36a06fec-5ed1-402d-a3ee-c4ddbcec4c1c req-e4ff9851-dd91-420d-8f81-47e3afea0799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83365b2d-9f2c-4966-bdb6-789059348c37", "tag": "19d95122-9b77-4b3d-adf8-fcfd43a61168"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:49:54.384775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-36a06fec-5ed1-402d-a3ee-c4ddbcec4c1c req-e4ff9851-dd91-420d-8f81-47e3afea0799 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:54.385523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-36a06fec-5ed1-402d-a3ee-c4ddbcec4c1c req-e4ff9851-dd91-420d-8f81-47e3afea0799 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:54.385958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-36a06fec-5ed1-402d-a3ee-c4ddbcec4c1c req-e4ff9851-dd91-420d-8f81-47e3afea0799 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:54.400865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-36a06fec-5ed1-402d-a3ee-c4ddbcec4c1c req-e4ff9851-dd91-420d-8f81-47e3afea0799 service nova] Creating event network-changed:19d95122-9b77-4b3d-adf8-fcfd43a61168 for instance 83365b2d-9f2c-4966-bdb6-789059348c37 on hv-cinder-83697 Aug 08 08:49:54.406615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-36a06fec-5ed1-402d-a3ee-c4ddbcec4c1c req-e4ff9851-dd91-420d-8f81-47e3afea0799 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036157 Aug 08 08:49:54.407364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 430/887] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:49:54.970479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5d1bf4cd-0c56-47df-8583-05f306c7f9aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:54.971097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5d1bf4cd-0c56-47df-8583-05f306c7f9aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:54.977808 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d1bf4cd-0c56-47df-8583-05f306c7f9aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:54.978303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d1bf4cd-0c56-47df-8583-05f306c7f9aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:54.978988 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d1bf4cd-0c56-47df-8583-05f306c7f9aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:54.979886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d1bf4cd-0c56-47df-8583-05f306c7f9aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:54.980517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d1bf4cd-0c56-47df-8583-05f306c7f9aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:54.980949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d1bf4cd-0c56-47df-8583-05f306c7f9aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:55.123752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5d1bf4cd-0c56-47df-8583-05f306c7f9aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:55.131558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5d1bf4cd-0c56-47df-8583-05f306c7f9aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.164843 Aug 08 08:49:55.132125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 458/888] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:54 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:55.227199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b0cce421-c487-4150-8566-87e46210e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:55.227199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b0cce421-c487-4150-8566-87e46210e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:55.232464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0cce421-c487-4150-8566-87e46210e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:55.232959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0cce421-c487-4150-8566-87e46210e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:55.233455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0cce421-c487-4150-8566-87e46210e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:55.234171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0cce421-c487-4150-8566-87e46210e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:55.234633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0cce421-c487-4150-8566-87e46210e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:55.235068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b0cce421-c487-4150-8566-87e46210e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:55.371984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b0cce421-c487-4150-8566-87e46210e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:55.381266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b0cce421-c487-4150-8566-87e46210e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.161001 Aug 08 08:49:55.381883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 431/889] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:56.151801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-125c9607-81c4-4401-b35e-c52acf204a4c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:56.152411 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-125c9607-81c4-4401-b35e-c52acf204a4c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:56.158749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-125c9607-81c4-4401-b35e-c52acf204a4c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:56.159230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-125c9607-81c4-4401-b35e-c52acf204a4c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:56.159664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-125c9607-81c4-4401-b35e-c52acf204a4c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:56.160344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-125c9607-81c4-4401-b35e-c52acf204a4c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:56.160878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-125c9607-81c4-4401-b35e-c52acf204a4c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:56.161462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-125c9607-81c4-4401-b35e-c52acf204a4c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:56.298985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-125c9607-81c4-4401-b35e-c52acf204a4c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:56.306918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-125c9607-81c4-4401-b35e-c52acf204a4c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.158891 Aug 08 08:49:56.307475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 459/890] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:56 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:56.402513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a7d090b4-efcf-489f-ba41-f3fea2537873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:56.403122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a7d090b4-efcf-489f-ba41-f3fea2537873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:56.412989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d090b4-efcf-489f-ba41-f3fea2537873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:56.412989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d090b4-efcf-489f-ba41-f3fea2537873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:56.412989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d090b4-efcf-489f-ba41-f3fea2537873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:56.412989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d090b4-efcf-489f-ba41-f3fea2537873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:56.413508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d090b4-efcf-489f-ba41-f3fea2537873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:56.413508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d090b4-efcf-489f-ba41-f3fea2537873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:56.556043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a7d090b4-efcf-489f-ba41-f3fea2537873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:56.563584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a7d090b4-efcf-489f-ba41-f3fea2537873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.165411 Aug 08 08:49:56.564123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 432/891] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:57.328530 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-440a2d52-96ca-49e8-984e-1ccb0b1f9b6f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:57.329165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-440a2d52-96ca-49e8-984e-1ccb0b1f9b6f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:57.331122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:49:57.337036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-440a2d52-96ca-49e8-984e-1ccb0b1f9b6f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:57.337559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-440a2d52-96ca-49e8-984e-1ccb0b1f9b6f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:57.337998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-440a2d52-96ca-49e8-984e-1ccb0b1f9b6f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:57.338692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-440a2d52-96ca-49e8-984e-1ccb0b1f9b6f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:57.339150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-440a2d52-96ca-49e8-984e-1ccb0b1f9b6f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:57.339579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-440a2d52-96ca-49e8-984e-1ccb0b1f9b6f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:57.471546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-440a2d52-96ca-49e8-984e-1ccb0b1f9b6f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:57.479340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-440a2d52-96ca-49e8-984e-1ccb0b1f9b6f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.154377 Aug 08 08:49:57.479894 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 460/892] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:57 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:57.585255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d752b3f5-bb63-4891-bb95-3a6757b27890 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:57.585780 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d752b3f5-bb63-4891-bb95-3a6757b27890 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:57.592008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d752b3f5-bb63-4891-bb95-3a6757b27890 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:57.592489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d752b3f5-bb63-4891-bb95-3a6757b27890 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:57.592924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d752b3f5-bb63-4891-bb95-3a6757b27890 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:57.593640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d752b3f5-bb63-4891-bb95-3a6757b27890 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:57.594094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d752b3f5-bb63-4891-bb95-3a6757b27890 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:57.594516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d752b3f5-bb63-4891-bb95-3a6757b27890 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:57.725651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d752b3f5-bb63-4891-bb95-3a6757b27890 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:57.735229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d752b3f5-bb63-4891-bb95-3a6757b27890 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.154809 Aug 08 08:49:57.735805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 433/893] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:57 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:58.500280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d783734c-c528-41a9-bfc4-a18f717c2497 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:58.500851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d783734c-c528-41a9-bfc4-a18f717c2497 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:58.507624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d783734c-c528-41a9-bfc4-a18f717c2497 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:58.508118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d783734c-c528-41a9-bfc4-a18f717c2497 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:58.508559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d783734c-c528-41a9-bfc4-a18f717c2497 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:58.509290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d783734c-c528-41a9-bfc4-a18f717c2497 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:58.509754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d783734c-c528-41a9-bfc4-a18f717c2497 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:58.510183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d783734c-c528-41a9-bfc4-a18f717c2497 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:58.640490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d783734c-c528-41a9-bfc4-a18f717c2497 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:58.648670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d783734c-c528-41a9-bfc4-a18f717c2497 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.152368 Aug 08 08:49:58.649256 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 461/894] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:58 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:58.758326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6dc43ed3-96d0-453d-b3de-a55920abe24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:58.759522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6dc43ed3-96d0-453d-b3de-a55920abe24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:58.766068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc43ed3-96d0-453d-b3de-a55920abe24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:58.766564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc43ed3-96d0-453d-b3de-a55920abe24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:58.767002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc43ed3-96d0-453d-b3de-a55920abe24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:58.767693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc43ed3-96d0-453d-b3de-a55920abe24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:58.768160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc43ed3-96d0-453d-b3de-a55920abe24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:58.768590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc43ed3-96d0-453d-b3de-a55920abe24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:58.904561 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6dc43ed3-96d0-453d-b3de-a55920abe24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:58.913040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6dc43ed3-96d0-453d-b3de-a55920abe24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.159288 Aug 08 08:49:58.914016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 434/895] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:59.669310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8b435e01-20fe-4567-adc5-fc24d7f053eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:59.669925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8b435e01-20fe-4567-adc5-fc24d7f053eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:59.676292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b435e01-20fe-4567-adc5-fc24d7f053eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:59.676788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b435e01-20fe-4567-adc5-fc24d7f053eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:59.677263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b435e01-20fe-4567-adc5-fc24d7f053eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:59.677960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b435e01-20fe-4567-adc5-fc24d7f053eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:59.678901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b435e01-20fe-4567-adc5-fc24d7f053eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:59.679470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b435e01-20fe-4567-adc5-fc24d7f053eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:59.833571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8b435e01-20fe-4567-adc5-fc24d7f053eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:49:59.841946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8b435e01-20fe-4567-adc5-fc24d7f053eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.176437 Aug 08 08:49:59.842522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 462/896] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:59 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:49:59.933839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fffcc12b-0e6d-424d-89be-50e789308106 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:49:59.934387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fffcc12b-0e6d-424d-89be-50e789308106 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:49:59.936302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:49:59.936971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=8 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:49:59.942864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fffcc12b-0e6d-424d-89be-50e789308106 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:59.943584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fffcc12b-0e6d-424d-89be-50e789308106 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:59.944192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fffcc12b-0e6d-424d-89be-50e789308106 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:49:59.945137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fffcc12b-0e6d-424d-89be-50e789308106 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:49:59.945633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fffcc12b-0e6d-424d-89be-50e789308106 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:49:59.946066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fffcc12b-0e6d-424d-89be-50e789308106 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:00.110671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fffcc12b-0e6d-424d-89be-50e789308106 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:00.118673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fffcc12b-0e6d-424d-89be-50e789308106 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.188722 Aug 08 08:50:00.119336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 435/897] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:49:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:00.863960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e34c3be7-70d8-46e2-a994-ccc5e049269c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:00.865282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e34c3be7-70d8-46e2-a994-ccc5e049269c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:00.867750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=14 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:00.873614 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e34c3be7-70d8-46e2-a994-ccc5e049269c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:00.874105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e34c3be7-70d8-46e2-a994-ccc5e049269c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:00.874539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e34c3be7-70d8-46e2-a994-ccc5e049269c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:00.875269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e34c3be7-70d8-46e2-a994-ccc5e049269c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:00.875721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e34c3be7-70d8-46e2-a994-ccc5e049269c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:00.876148 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e34c3be7-70d8-46e2-a994-ccc5e049269c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:01.059990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e34c3be7-70d8-46e2-a994-ccc5e049269c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:01.068064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e34c3be7-70d8-46e2-a994-ccc5e049269c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.207867 Aug 08 08:50:01.082837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 463/898] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:00 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:50:01.139774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-904e6819-4615-4836-8c10-539b32b56011 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:01.140650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-904e6819-4615-4836-8c10-539b32b56011 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:01.148378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-904e6819-4615-4836-8c10-539b32b56011 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:01.149124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-904e6819-4615-4836-8c10-539b32b56011 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:01.149738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-904e6819-4615-4836-8c10-539b32b56011 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:01.150769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-904e6819-4615-4836-8c10-539b32b56011 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:01.151381 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-904e6819-4615-4836-8c10-539b32b56011 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:01.151961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-904e6819-4615-4836-8c10-539b32b56011 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:01.293719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-904e6819-4615-4836-8c10-539b32b56011 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:01.301289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-904e6819-4615-4836-8c10-539b32b56011 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.165521 Aug 08 08:50:01.312080 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 436/899] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:01 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:02.092337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6146e7e8-781c-44ab-82c6-f25e5e88e131 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:02.093662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6146e7e8-781c-44ab-82c6-f25e5e88e131 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:02.101072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6146e7e8-781c-44ab-82c6-f25e5e88e131 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:02.233850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6146e7e8-781c-44ab-82c6-f25e5e88e131 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:02.233850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6146e7e8-781c-44ab-82c6-f25e5e88e131 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:02.233850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6146e7e8-781c-44ab-82c6-f25e5e88e131 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:02.233850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6146e7e8-781c-44ab-82c6-f25e5e88e131 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:02.235383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6146e7e8-781c-44ab-82c6-f25e5e88e131 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:02.265325 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6146e7e8-781c-44ab-82c6-f25e5e88e131 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:02.275159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6146e7e8-781c-44ab-82c6-f25e5e88e131 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.187531 Aug 08 08:50:02.275864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 464/900] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:02 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:50:02.322821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-165ca9c6-69e1-4385-b98e-de62492e998a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:02.323478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-165ca9c6-69e1-4385-b98e-de62492e998a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:02.340523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-165ca9c6-69e1-4385-b98e-de62492e998a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:02.341764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-165ca9c6-69e1-4385-b98e-de62492e998a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:02.342528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-165ca9c6-69e1-4385-b98e-de62492e998a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:02.343579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-165ca9c6-69e1-4385-b98e-de62492e998a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:02.344571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-165ca9c6-69e1-4385-b98e-de62492e998a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:02.345339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-165ca9c6-69e1-4385-b98e-de62492e998a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:02.589832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-165ca9c6-69e1-4385-b98e-de62492e998a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:02.597267 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-165ca9c6-69e1-4385-b98e-de62492e998a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.279047 Aug 08 08:50:02.598653 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 437/901] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:02 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:03.298141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e68c77ee-9e45-4b25-ae35-9df280a387f6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:03.298801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e68c77ee-9e45-4b25-ae35-9df280a387f6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:03.305734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e68c77ee-9e45-4b25-ae35-9df280a387f6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:03.306495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e68c77ee-9e45-4b25-ae35-9df280a387f6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:03.307098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e68c77ee-9e45-4b25-ae35-9df280a387f6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:03.307977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e68c77ee-9e45-4b25-ae35-9df280a387f6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:03.308592 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e68c77ee-9e45-4b25-ae35-9df280a387f6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:03.309193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e68c77ee-9e45-4b25-ae35-9df280a387f6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:03.480740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e68c77ee-9e45-4b25-ae35-9df280a387f6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:03.482759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e68c77ee-9e45-4b25-ae35-9df280a387f6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.188737 Aug 08 08:50:03.483327 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 465/902] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:03 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:03.623188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d59ece50-14d7-4b6a-9f59-f4e6ea1e0d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:03.623188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d59ece50-14d7-4b6a-9f59-f4e6ea1e0d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:03.629544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d59ece50-14d7-4b6a-9f59-f4e6ea1e0d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:03.630036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d59ece50-14d7-4b6a-9f59-f4e6ea1e0d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:03.630471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d59ece50-14d7-4b6a-9f59-f4e6ea1e0d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:03.631166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d59ece50-14d7-4b6a-9f59-f4e6ea1e0d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:03.632300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d59ece50-14d7-4b6a-9f59-f4e6ea1e0d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:03.633302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d59ece50-14d7-4b6a-9f59-f4e6ea1e0d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:03.826283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d59ece50-14d7-4b6a-9f59-f4e6ea1e0d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:03.837965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d59ece50-14d7-4b6a-9f59-f4e6ea1e0d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.222841 Aug 08 08:50:03.852787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 438/903] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:04.505333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-61ba17a9-5997-4550-9bd9-e8e5a70f1fa2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:04.507338 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-61ba17a9-5997-4550-9bd9-e8e5a70f1fa2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:04.513672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba17a9-5997-4550-9bd9-e8e5a70f1fa2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:04.520900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba17a9-5997-4550-9bd9-e8e5a70f1fa2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:04.520900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba17a9-5997-4550-9bd9-e8e5a70f1fa2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:04.520900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba17a9-5997-4550-9bd9-e8e5a70f1fa2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:04.520900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba17a9-5997-4550-9bd9-e8e5a70f1fa2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:04.521504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba17a9-5997-4550-9bd9-e8e5a70f1fa2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:04.711230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-61ba17a9-5997-4550-9bd9-e8e5a70f1fa2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:04.719506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-61ba17a9-5997-4550-9bd9-e8e5a70f1fa2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.218658 Aug 08 08:50:04.720607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 466/904] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:04 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:04.860727 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d80404ba-47a4-4b13-abb8-bd3929027f5a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:04.861495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d80404ba-47a4-4b13-abb8-bd3929027f5a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:04.867953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d80404ba-47a4-4b13-abb8-bd3929027f5a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:04.868443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d80404ba-47a4-4b13-abb8-bd3929027f5a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:04.868895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d80404ba-47a4-4b13-abb8-bd3929027f5a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:04.869608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d80404ba-47a4-4b13-abb8-bd3929027f5a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:04.870069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d80404ba-47a4-4b13-abb8-bd3929027f5a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:04.870496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d80404ba-47a4-4b13-abb8-bd3929027f5a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:05.013821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d80404ba-47a4-4b13-abb8-bd3929027f5a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:05.021551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d80404ba-47a4-4b13-abb8-bd3929027f5a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.164992 Aug 08 08:50:05.022909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 439/905] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:50:05.745285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dfd0805c-a964-45a7-a9ad-304aa91013f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:05.747003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dfd0805c-a964-45a7-a9ad-304aa91013f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:05.754922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfd0805c-a964-45a7-a9ad-304aa91013f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:05.761817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfd0805c-a964-45a7-a9ad-304aa91013f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:05.762300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfd0805c-a964-45a7-a9ad-304aa91013f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:05.763311 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfd0805c-a964-45a7-a9ad-304aa91013f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:05.763538 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfd0805c-a964-45a7-a9ad-304aa91013f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:05.763978 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfd0805c-a964-45a7-a9ad-304aa91013f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:05.974430 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dfd0805c-a964-45a7-a9ad-304aa91013f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:05.986169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dfd0805c-a964-45a7-a9ad-304aa91013f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.246914 Aug 08 08:50:05.988768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 467/906] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:05 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:06.045388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1f73c311-4222-49ab-bdc0-73d7b966fe8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:06.046926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1f73c311-4222-49ab-bdc0-73d7b966fe8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:06.061455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f73c311-4222-49ab-bdc0-73d7b966fe8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:06.061455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f73c311-4222-49ab-bdc0-73d7b966fe8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:06.061455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f73c311-4222-49ab-bdc0-73d7b966fe8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:06.061455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f73c311-4222-49ab-bdc0-73d7b966fe8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:06.062228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f73c311-4222-49ab-bdc0-73d7b966fe8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:06.062228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f73c311-4222-49ab-bdc0-73d7b966fe8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:06.217643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1f73c311-4222-49ab-bdc0-73d7b966fe8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:06.227484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1f73c311-4222-49ab-bdc0-73d7b966fe8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.187805 Aug 08 08:50:06.228521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 440/907] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:06 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:50:07.010268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e3b9fb7b-84e4-4c07-9851-017c3fecdc16 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:07.010968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e3b9fb7b-84e4-4c07-9851-017c3fecdc16 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:07.017737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb7b-84e4-4c07-9851-017c3fecdc16 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:07.018307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb7b-84e4-4c07-9851-017c3fecdc16 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:07.018872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb7b-84e4-4c07-9851-017c3fecdc16 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:07.019660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb7b-84e4-4c07-9851-017c3fecdc16 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:07.020206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb7b-84e4-4c07-9851-017c3fecdc16 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:07.020706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb7b-84e4-4c07-9851-017c3fecdc16 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:07.160578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e3b9fb7b-84e4-4c07-9851-017c3fecdc16 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:07.168466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e3b9fb7b-84e4-4c07-9851-017c3fecdc16 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.162104 Aug 08 08:50:07.169027 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 468/908] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:07 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:07.248389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fcaa923d-d83e-4908-ab73-ca2f0a2ad10c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:07.248999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fcaa923d-d83e-4908-ab73-ca2f0a2ad10c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:07.255109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcaa923d-d83e-4908-ab73-ca2f0a2ad10c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:07.255595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcaa923d-d83e-4908-ab73-ca2f0a2ad10c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:07.256031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcaa923d-d83e-4908-ab73-ca2f0a2ad10c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:07.257556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcaa923d-d83e-4908-ab73-ca2f0a2ad10c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:07.258069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcaa923d-d83e-4908-ab73-ca2f0a2ad10c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:07.258499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcaa923d-d83e-4908-ab73-ca2f0a2ad10c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:07.399214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fcaa923d-d83e-4908-ab73-ca2f0a2ad10c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:07.407493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fcaa923d-d83e-4908-ab73-ca2f0a2ad10c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.162975 Aug 08 08:50:07.408062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 441/909] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:07 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:08.189551 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e06bba93-03d2-47fd-bb4f-b8699362e305 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:08.190156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e06bba93-03d2-47fd-bb4f-b8699362e305 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:08.197317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e06bba93-03d2-47fd-bb4f-b8699362e305 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:08.198016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e06bba93-03d2-47fd-bb4f-b8699362e305 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:08.198453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e06bba93-03d2-47fd-bb4f-b8699362e305 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:08.199135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e06bba93-03d2-47fd-bb4f-b8699362e305 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:08.199589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e06bba93-03d2-47fd-bb4f-b8699362e305 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:08.200009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e06bba93-03d2-47fd-bb4f-b8699362e305 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:08.330877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e06bba93-03d2-47fd-bb4f-b8699362e305 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:08.338825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e06bba93-03d2-47fd-bb4f-b8699362e305 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.153205 Aug 08 08:50:08.339363 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 469/910] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:08 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:08.429058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d4528909-1f01-43c3-8459-3093c9911340 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:08.429811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d4528909-1f01-43c3-8459-3093c9911340 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:08.436302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4528909-1f01-43c3-8459-3093c9911340 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:08.436855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4528909-1f01-43c3-8459-3093c9911340 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:08.437335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4528909-1f01-43c3-8459-3093c9911340 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:08.438029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4528909-1f01-43c3-8459-3093c9911340 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:08.438527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4528909-1f01-43c3-8459-3093c9911340 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:08.444944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4528909-1f01-43c3-8459-3093c9911340 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:08.572186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d4528909-1f01-43c3-8459-3093c9911340 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:08.575666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:08.580048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d4528909-1f01-43c3-8459-3093c9911340 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.155559 Aug 08 08:50:08.580606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 442/911] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:08 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:09.359999 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-77e2e632-0931-4e85-ba26-60c6cec26269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:09.360527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-77e2e632-0931-4e85-ba26-60c6cec26269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:09.367271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77e2e632-0931-4e85-ba26-60c6cec26269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:09.370624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77e2e632-0931-4e85-ba26-60c6cec26269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:09.370624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77e2e632-0931-4e85-ba26-60c6cec26269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:09.370624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77e2e632-0931-4e85-ba26-60c6cec26269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:09.370624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77e2e632-0931-4e85-ba26-60c6cec26269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:09.370998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77e2e632-0931-4e85-ba26-60c6cec26269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:09.505538 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-77e2e632-0931-4e85-ba26-60c6cec26269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:09.513850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-77e2e632-0931-4e85-ba26-60c6cec26269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.157741 Aug 08 08:50:09.514495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 470/912] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:09 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:09.600627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-49ca2232-ff9c-4c0f-ac62-1f4ab543568f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:09.601314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-49ca2232-ff9c-4c0f-ac62-1f4ab543568f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:09.608413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49ca2232-ff9c-4c0f-ac62-1f4ab543568f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:09.608917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49ca2232-ff9c-4c0f-ac62-1f4ab543568f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:09.609382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49ca2232-ff9c-4c0f-ac62-1f4ab543568f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:09.610164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49ca2232-ff9c-4c0f-ac62-1f4ab543568f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:09.610537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49ca2232-ff9c-4c0f-ac62-1f4ab543568f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:09.610962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49ca2232-ff9c-4c0f-ac62-1f4ab543568f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:09.743864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-49ca2232-ff9c-4c0f-ac62-1f4ab543568f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:09.751337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-49ca2232-ff9c-4c0f-ac62-1f4ab543568f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.155387 Aug 08 08:50:09.751894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 443/913] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:10.534239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b4c44fdb-317a-416e-aeda-ef243f57d826 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:10.534887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b4c44fdb-317a-416e-aeda-ef243f57d826 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:10.542104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b4c44fdb-317a-416e-aeda-ef243f57d826 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:10.542591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b4c44fdb-317a-416e-aeda-ef243f57d826 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:10.543030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b4c44fdb-317a-416e-aeda-ef243f57d826 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:10.543719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b4c44fdb-317a-416e-aeda-ef243f57d826 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:10.544177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b4c44fdb-317a-416e-aeda-ef243f57d826 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:10.544637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b4c44fdb-317a-416e-aeda-ef243f57d826 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:10.559217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:10.680966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b4c44fdb-317a-416e-aeda-ef243f57d826 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:10.688588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b4c44fdb-317a-416e-aeda-ef243f57d826 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.158203 Aug 08 08:50:10.689203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 471/914] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:10 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:10.771891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1795ea88-3cf6-4192-a752-c794b871117e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:10.772497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1795ea88-3cf6-4192-a752-c794b871117e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:10.779031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1795ea88-3cf6-4192-a752-c794b871117e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:10.779512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1795ea88-3cf6-4192-a752-c794b871117e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:10.779945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1795ea88-3cf6-4192-a752-c794b871117e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:10.780704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1795ea88-3cf6-4192-a752-c794b871117e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:10.781196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1795ea88-3cf6-4192-a752-c794b871117e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:10.781632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1795ea88-3cf6-4192-a752-c794b871117e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:10.912849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1795ea88-3cf6-4192-a752-c794b871117e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:10.919346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1795ea88-3cf6-4192-a752-c794b871117e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.151415 Aug 08 08:50:10.919908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 444/915] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:10 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:11.711586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4b17f2bc-432b-4f8b-ab21-d7ebefe6f47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:11.712197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4b17f2bc-432b-4f8b-ab21-d7ebefe6f47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:11.718857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b17f2bc-432b-4f8b-ab21-d7ebefe6f47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:11.719301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b17f2bc-432b-4f8b-ab21-d7ebefe6f47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:11.719737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b17f2bc-432b-4f8b-ab21-d7ebefe6f47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:11.720430 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b17f2bc-432b-4f8b-ab21-d7ebefe6f47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:11.720893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b17f2bc-432b-4f8b-ab21-d7ebefe6f47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:11.721360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b17f2bc-432b-4f8b-ab21-d7ebefe6f47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:11.867570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4b17f2bc-432b-4f8b-ab21-d7ebefe6f47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:11.875714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4b17f2bc-432b-4f8b-ab21-d7ebefe6f47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.168912 Aug 08 08:50:11.876288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 472/916] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:11 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:11.940229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6f54c054-5ff6-432d-999d-2eda3f9417d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:11.940881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6f54c054-5ff6-432d-999d-2eda3f9417d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:11.947628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f54c054-5ff6-432d-999d-2eda3f9417d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:11.948119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f54c054-5ff6-432d-999d-2eda3f9417d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:11.948559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f54c054-5ff6-432d-999d-2eda3f9417d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:11.949661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f54c054-5ff6-432d-999d-2eda3f9417d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:11.950090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f54c054-5ff6-432d-999d-2eda3f9417d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:11.950521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f54c054-5ff6-432d-999d-2eda3f9417d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:12.092892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6f54c054-5ff6-432d-999d-2eda3f9417d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:12.101166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6f54c054-5ff6-432d-999d-2eda3f9417d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.164990 Aug 08 08:50:12.101753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 445/917] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:11 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:12.168671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fb4b9f54-f4d4-49e8-b082-f1f0f5eba33f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23b64078-0d9c-43d6-8b79-5fc49693ad42", "device": "/dev/sdb"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:50:12.171522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fb4b9f54-f4d4-49e8-b082-f1f0f5eba33f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:12.177432 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb4b9f54-f4d4-49e8-b082-f1f0f5eba33f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:12.178093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb4b9f54-f4d4-49e8-b082-f1f0f5eba33f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:12.178591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb4b9f54-f4d4-49e8-b082-f1f0f5eba33f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:12.179290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb4b9f54-f4d4-49e8-b082-f1f0f5eba33f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:12.179753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb4b9f54-f4d4-49e8-b082-f1f0f5eba33f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:12.180190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb4b9f54-f4d4-49e8-b082-f1f0f5eba33f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:12.901023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4aef07e8-0fde-43b6-8ca8-c2f0a7d10888 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:12.901769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4aef07e8-0fde-43b6-8ca8-c2f0a7d10888 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:12.907613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4aef07e8-0fde-43b6-8ca8-c2f0a7d10888 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:12.908145 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4aef07e8-0fde-43b6-8ca8-c2f0a7d10888 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:12.908586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4aef07e8-0fde-43b6-8ca8-c2f0a7d10888 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:12.909306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4aef07e8-0fde-43b6-8ca8-c2f0a7d10888 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:12.909930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4aef07e8-0fde-43b6-8ca8-c2f0a7d10888 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:12.910360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4aef07e8-0fde-43b6-8ca8-c2f0a7d10888 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:12.992330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fb4b9f54-f4d4-49e8-b082-f1f0f5eba33f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "POST /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827419 Aug 08 08:50:13.006704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 473/918] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:50:12 2022] POST /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:50:13.057859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4aef07e8-0fde-43b6-8ca8-c2f0a7d10888 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:13.068129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4aef07e8-0fde-43b6-8ca8-c2f0a7d10888 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.170072 Aug 08 08:50:13.073360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 446/919] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:12 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:13.123262 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-372a3064-676c-4835-8898-5e88503b0ee6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:13.124133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-372a3064-676c-4835-8898-5e88503b0ee6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:13.131350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-372a3064-676c-4835-8898-5e88503b0ee6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:13.131973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-372a3064-676c-4835-8898-5e88503b0ee6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:13.132428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-372a3064-676c-4835-8898-5e88503b0ee6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:13.133163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-372a3064-676c-4835-8898-5e88503b0ee6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:13.133649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-372a3064-676c-4835-8898-5e88503b0ee6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:13.134112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-372a3064-676c-4835-8898-5e88503b0ee6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:13.288718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-372a3064-676c-4835-8898-5e88503b0ee6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:13.307429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-372a3064-676c-4835-8898-5e88503b0ee6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.177515 Aug 08 08:50:13.307429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 474/920] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:14.094397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-61c12e9d-d12f-4f1f-be5d-d626f84c3c9d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:14.096561 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-61c12e9d-d12f-4f1f-be5d-d626f84c3c9d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:14.106307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c12e9d-d12f-4f1f-be5d-d626f84c3c9d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:14.106893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c12e9d-d12f-4f1f-be5d-d626f84c3c9d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:14.107404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c12e9d-d12f-4f1f-be5d-d626f84c3c9d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:14.108538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c12e9d-d12f-4f1f-be5d-d626f84c3c9d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:14.108968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c12e9d-d12f-4f1f-be5d-d626f84c3c9d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:14.109491 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61c12e9d-d12f-4f1f-be5d-d626f84c3c9d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:14.218386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-d1648bd8-2068-4657-a543-e1adaab90253 req-b688c902-91eb-492b-8f71-384ae347b2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ee0e71-bef8-4c22-ac1f-1b08e564b14d", "name": "network-vif-plugged", "status": "completed", "tag": "59038d45-a91c-43ab-a6da-241301aba11f"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:50:14.229912 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-d1648bd8-2068-4657-a543-e1adaab90253 req-b688c902-91eb-492b-8f71-384ae347b2f8 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:14.231101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-d1648bd8-2068-4657-a543-e1adaab90253 req-b688c902-91eb-492b-8f71-384ae347b2f8 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:14.231850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-d1648bd8-2068-4657-a543-e1adaab90253 req-b688c902-91eb-492b-8f71-384ae347b2f8 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:14.247571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-d1648bd8-2068-4657-a543-e1adaab90253 req-b688c902-91eb-492b-8f71-384ae347b2f8 service nova] Creating event network-vif-plugged:59038d45-a91c-43ab-a6da-241301aba11f for instance e4ee0e71-bef8-4c22-ac1f-1b08e564b14d on hv-cinder-83697 Aug 08 08:50:14.254089 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-d1648bd8-2068-4657-a543-e1adaab90253 req-b688c902-91eb-492b-8f71-384ae347b2f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047040 Aug 08 08:50:14.255193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 475/921] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:50:14.255708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-61c12e9d-d12f-4f1f-be5d-d626f84c3c9d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:14.266121 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-61c12e9d-d12f-4f1f-be5d-d626f84c3c9d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.178125 Aug 08 08:50:14.268798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 447/922] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:14 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:14.324363 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-782ba5e7-fd74-430b-bf4f-484ba8c791b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:14.325473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-782ba5e7-fd74-430b-bf4f-484ba8c791b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:14.335497 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782ba5e7-fd74-430b-bf4f-484ba8c791b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:14.335497 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782ba5e7-fd74-430b-bf4f-484ba8c791b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:14.335497 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782ba5e7-fd74-430b-bf4f-484ba8c791b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:14.336196 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782ba5e7-fd74-430b-bf4f-484ba8c791b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:14.339237 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782ba5e7-fd74-430b-bf4f-484ba8c791b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:14.339689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782ba5e7-fd74-430b-bf4f-484ba8c791b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:14.500844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-782ba5e7-fd74-430b-bf4f-484ba8c791b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:14.512582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-782ba5e7-fd74-430b-bf4f-484ba8c791b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.193964 Aug 08 08:50:14.513251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 476/923] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:50:15.291056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a3339ef6-c26b-4957-bda8-6ee3d17f706f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:15.291719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a3339ef6-c26b-4957-bda8-6ee3d17f706f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:15.298074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3339ef6-c26b-4957-bda8-6ee3d17f706f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:15.298567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3339ef6-c26b-4957-bda8-6ee3d17f706f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:15.299005 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3339ef6-c26b-4957-bda8-6ee3d17f706f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:15.299698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3339ef6-c26b-4957-bda8-6ee3d17f706f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:15.300154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3339ef6-c26b-4957-bda8-6ee3d17f706f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:15.300583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3339ef6-c26b-4957-bda8-6ee3d17f706f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:15.438922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a3339ef6-c26b-4957-bda8-6ee3d17f706f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:15.447355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a3339ef6-c26b-4957-bda8-6ee3d17f706f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1264 microversion: 2.1 time: 0.160595 Aug 08 08:50:15.447927 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 448/924] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:15 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:15.534627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-343274df-3810-4b74-891d-997e14d5d041 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:15.535083 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-343274df-3810-4b74-891d-997e14d5d041 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:15.541967 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-343274df-3810-4b74-891d-997e14d5d041 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:15.542482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-343274df-3810-4b74-891d-997e14d5d041 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:15.542913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-343274df-3810-4b74-891d-997e14d5d041 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:15.543630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-343274df-3810-4b74-891d-997e14d5d041 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:15.544150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-343274df-3810-4b74-891d-997e14d5d041 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:15.544576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-343274df-3810-4b74-891d-997e14d5d041 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:15.695237 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-343274df-3810-4b74-891d-997e14d5d041 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:15.707071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-343274df-3810-4b74-891d-997e14d5d041 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.176589 Aug 08 08:50:15.707647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 477/925] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:15 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:16.289225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-a52b404f-5b94-48da-b865-d38ea07b2aa7 req-39fe0c70-08e0-4746-a1f5-6afdda23d39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83365b2d-9f2c-4966-bdb6-789059348c37", "name": "network-vif-plugged", "status": "completed", "tag": "19d95122-9b77-4b3d-adf8-fcfd43a61168"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:50:16.299049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-a52b404f-5b94-48da-b865-d38ea07b2aa7 req-39fe0c70-08e0-4746-a1f5-6afdda23d39e service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:16.299670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-a52b404f-5b94-48da-b865-d38ea07b2aa7 req-39fe0c70-08e0-4746-a1f5-6afdda23d39e service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:16.299979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-a52b404f-5b94-48da-b865-d38ea07b2aa7 req-39fe0c70-08e0-4746-a1f5-6afdda23d39e service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:16.311655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-a52b404f-5b94-48da-b865-d38ea07b2aa7 req-39fe0c70-08e0-4746-a1f5-6afdda23d39e service nova] Creating event network-vif-plugged:19d95122-9b77-4b3d-adf8-fcfd43a61168 for instance 83365b2d-9f2c-4966-bdb6-789059348c37 on hv-cinder-83697 Aug 08 08:50:16.316724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-a52b404f-5b94-48da-b865-d38ea07b2aa7 req-39fe0c70-08e0-4746-a1f5-6afdda23d39e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031744 Aug 08 08:50:16.317406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 449/926] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:50:16.468070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1d094efd-b19b-4c33-830b-4838bacd09d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:16.468595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1d094efd-b19b-4c33-830b-4838bacd09d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:16.475369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d094efd-b19b-4c33-830b-4838bacd09d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:16.476018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d094efd-b19b-4c33-830b-4838bacd09d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:16.476468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d094efd-b19b-4c33-830b-4838bacd09d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:16.477228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d094efd-b19b-4c33-830b-4838bacd09d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:16.477730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d094efd-b19b-4c33-830b-4838bacd09d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:16.478143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1d094efd-b19b-4c33-830b-4838bacd09d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:16.615533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1d094efd-b19b-4c33-830b-4838bacd09d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:16.623333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1d094efd-b19b-4c33-830b-4838bacd09d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1450 microversion: 2.1 time: 0.159377 Aug 08 08:50:16.623893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 478/927] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:16 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:16.645633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ebdb3577-9076-4c3a-bb11-00262c91a806 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:16.646329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ebdb3577-9076-4c3a-bb11-00262c91a806 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:16.653109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebdb3577-9076-4c3a-bb11-00262c91a806 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:16.653622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebdb3577-9076-4c3a-bb11-00262c91a806 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:16.654059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebdb3577-9076-4c3a-bb11-00262c91a806 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:16.654743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebdb3577-9076-4c3a-bb11-00262c91a806 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:16.655199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebdb3577-9076-4c3a-bb11-00262c91a806 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:16.655625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebdb3577-9076-4c3a-bb11-00262c91a806 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:16.728558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bfc1d03b-d3dd-4d62-bb76-953668a1d9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:16.729475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bfc1d03b-d3dd-4d62-bb76-953668a1d9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:16.735412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bfc1d03b-d3dd-4d62-bb76-953668a1d9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:16.735906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bfc1d03b-d3dd-4d62-bb76-953668a1d9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:16.736344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bfc1d03b-d3dd-4d62-bb76-953668a1d9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:16.737035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bfc1d03b-d3dd-4d62-bb76-953668a1d9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:16.737524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bfc1d03b-d3dd-4d62-bb76-953668a1d9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:16.737953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bfc1d03b-d3dd-4d62-bb76-953668a1d9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:16.799861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ebdb3577-9076-4c3a-bb11-00262c91a806 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:16.807654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ebdb3577-9076-4c3a-bb11-00262c91a806 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1450 microversion: 2.1 time: 0.166222 Aug 08 08:50:16.808490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 450/928] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:16 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1450 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:16.887728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bfc1d03b-d3dd-4d62-bb76-953668a1d9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:16.895099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bfc1d03b-d3dd-4d62-bb76-953668a1d9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.171081 Aug 08 08:50:16.895669 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 479/929] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:50:17.916057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2efc78e5-4d92-49de-b025-23aab97ed9e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:17.916704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2efc78e5-4d92-49de-b025-23aab97ed9e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:17.923130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2efc78e5-4d92-49de-b025-23aab97ed9e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:17.923613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2efc78e5-4d92-49de-b025-23aab97ed9e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:17.924048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2efc78e5-4d92-49de-b025-23aab97ed9e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:17.924737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2efc78e5-4d92-49de-b025-23aab97ed9e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:17.925218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2efc78e5-4d92-49de-b025-23aab97ed9e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:17.925883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2efc78e5-4d92-49de-b025-23aab97ed9e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:18.057845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2efc78e5-4d92-49de-b025-23aab97ed9e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:18.066524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2efc78e5-4d92-49de-b025-23aab97ed9e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1358 microversion: 2.1 time: 0.154458 Aug 08 08:50:18.067109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 451/930] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:17 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:18.945281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-9fc7d0b2-f49e-4c03-91e5-f6273e2b0ab2 req-34b64544-6e42-45a9-897a-4f3b4a1f6ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ee0e71-bef8-4c22-ac1f-1b08e564b14d", "tag": "59038d45-a91c-43ab-a6da-241301aba11f"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:50:18.954744 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-9fc7d0b2-f49e-4c03-91e5-f6273e2b0ab2 req-34b64544-6e42-45a9-897a-4f3b4a1f6ecf service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:18.955222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-9fc7d0b2-f49e-4c03-91e5-f6273e2b0ab2 req-34b64544-6e42-45a9-897a-4f3b4a1f6ecf service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:18.955653 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-9fc7d0b2-f49e-4c03-91e5-f6273e2b0ab2 req-34b64544-6e42-45a9-897a-4f3b4a1f6ecf service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:18.966774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-9fc7d0b2-f49e-4c03-91e5-f6273e2b0ab2 req-34b64544-6e42-45a9-897a-4f3b4a1f6ecf service nova] Creating event network-changed:59038d45-a91c-43ab-a6da-241301aba11f for instance e4ee0e71-bef8-4c22-ac1f-1b08e564b14d on hv-cinder-83697 Aug 08 08:50:18.971942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-9fc7d0b2-f49e-4c03-91e5-f6273e2b0ab2 req-34b64544-6e42-45a9-897a-4f3b4a1f6ecf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031000 Aug 08 08:50:18.972538 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 480/931] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:50:19.087917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-991c0875-f6ca-4254-9273-6e9d483dac97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:19.088463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-991c0875-f6ca-4254-9273-6e9d483dac97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:19.095226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-991c0875-f6ca-4254-9273-6e9d483dac97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:19.095724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-991c0875-f6ca-4254-9273-6e9d483dac97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:19.096166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-991c0875-f6ca-4254-9273-6e9d483dac97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:19.096878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-991c0875-f6ca-4254-9273-6e9d483dac97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:19.097377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-991c0875-f6ca-4254-9273-6e9d483dac97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:19.097811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-991c0875-f6ca-4254-9273-6e9d483dac97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:19.232414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-991c0875-f6ca-4254-9273-6e9d483dac97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:19.242492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-991c0875-f6ca-4254-9273-6e9d483dac97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1548 microversion: 2.1 time: 0.159150 Aug 08 08:50:19.243066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 452/932] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:19.268871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0d9e1a48-d416-49f2-989e-7ff98f60d491 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:19.269677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0d9e1a48-d416-49f2-989e-7ff98f60d491 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:19.277323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d9e1a48-d416-49f2-989e-7ff98f60d491 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:19.277828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d9e1a48-d416-49f2-989e-7ff98f60d491 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:19.278274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d9e1a48-d416-49f2-989e-7ff98f60d491 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:19.278988 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d9e1a48-d416-49f2-989e-7ff98f60d491 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:19.279544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d9e1a48-d416-49f2-989e-7ff98f60d491 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:19.279972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d9e1a48-d416-49f2-989e-7ff98f60d491 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:19.415032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0d9e1a48-d416-49f2-989e-7ff98f60d491 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:19.422938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0d9e1a48-d416-49f2-989e-7ff98f60d491 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1548 microversion: 2.1 time: 0.158695 Aug 08 08:50:19.437904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 481/933] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:19.445112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8d7457c8-ccd5-4faf-aec4-14ad2ff5e019 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:19.451134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8d7457c8-ccd5-4faf-aec4-14ad2ff5e019 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:19.451919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8d7457c8-ccd5-4faf-aec4-14ad2ff5e019 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Searching by: {'deleted': False, 'project_id': '0bbf785f7de94ef7ad423568d41af122'} {{(pid=124673) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 08 08:50:19.461469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7457c8-ccd5-4faf-aec4-14ad2ff5e019 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:19.461959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7457c8-ccd5-4faf-aec4-14ad2ff5e019 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:19.462646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7457c8-ccd5-4faf-aec4-14ad2ff5e019 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:19.463098 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7457c8-ccd5-4faf-aec4-14ad2ff5e019 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:19.463734 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7457c8-ccd5-4faf-aec4-14ad2ff5e019 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:19.464285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d7457c8-ccd5-4faf-aec4-14ad2ff5e019 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:19.573740 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.multi_cell_list [None req-8d7457c8-ccd5-4faf-aec4-14ad2ff5e019 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124673) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 08 08:50:19.679893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8d7457c8-ccd5-4faf-aec4-14ad2ff5e019 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.239066 Aug 08 08:50:19.680473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 453/934] 10.222.0.33 () {58 vars in 1125 bytes} [Mon Aug 8 08:50:19 2022] GET /compute/v2.1/servers => generated 342 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:50:19.697644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ff8cd2b9-a9ba-4867-832c-10b0f825128a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:19.698617 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ff8cd2b9-a9ba-4867-832c-10b0f825128a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:19.705716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff8cd2b9-a9ba-4867-832c-10b0f825128a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:19.706211 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff8cd2b9-a9ba-4867-832c-10b0f825128a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:19.706649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff8cd2b9-a9ba-4867-832c-10b0f825128a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:19.707348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff8cd2b9-a9ba-4867-832c-10b0f825128a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:19.707879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff8cd2b9-a9ba-4867-832c-10b0f825128a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:19.708310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff8cd2b9-a9ba-4867-832c-10b0f825128a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:19.869337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ff8cd2b9-a9ba-4867-832c-10b0f825128a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:19.877443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ff8cd2b9-a9ba-4867-832c-10b0f825128a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1548 microversion: 2.1 time: 0.189484 Aug 08 08:50:19.889791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 482/935] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1548 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:50:21.926384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e74389d8-5b71-4dd1-b798-473aff23d6af tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56631e1f-8b5f-49b6-91fc-c60b82e5951f"}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:50:21.928986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e74389d8-5b71-4dd1-b798-473aff23d6af tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:21.931679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=56 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:21.936331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e74389d8-5b71-4dd1-b798-473aff23d6af tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:21.936823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e74389d8-5b71-4dd1-b798-473aff23d6af tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:21.937368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e74389d8-5b71-4dd1-b798-473aff23d6af tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:21.938073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e74389d8-5b71-4dd1-b798-473aff23d6af tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:21.938535 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e74389d8-5b71-4dd1-b798-473aff23d6af tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:21.938963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e74389d8-5b71-4dd1-b798-473aff23d6af tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:25.039970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e74389d8-5b71-4dd1-b798-473aff23d6af tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "POST /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.117410 Aug 08 08:50:25.040678 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 454/936] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 08:50:21 2022] POST /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 194 bytes in 3119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:50:25.731889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1872981404", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:50:25.739191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=66 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:25.783727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] validate_networks() for None {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 08:50:26.057485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 08:50:26.057916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 08:50:26.058397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 08:50:26.058804 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 08:50:26.059215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 08:50:26.068066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:26.068639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:26.069078 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:26.069837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:26.070298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:26.070730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:26.086926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Getting quotas for project 2693983a63734f52890ae4bb41c1e915. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 08:50:26.090869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Getting quotas for user 445aaa7a942043bbac9aee5d06b3d092 and project 2693983a63734f52890ae4bb41c1e915. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 08:50:26.102165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 08:50:26.104788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 08:50:26.236745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-53f1eb41-578c-4722-b521-a77b880e260a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508894 Aug 08 08:50:26.237426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 483/937] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 08:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 08:50:26.249828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-15885964-4781-4f32-bdfd-a01af2860e57 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:26.250644 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-15885964-4781-4f32-bdfd-a01af2860e57 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:26.305068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-15885964-4781-4f32-bdfd-a01af2860e57 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:26.317462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-15885964-4781-4f32-bdfd-a01af2860e57 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1215 microversion: 2.1 time: 0.072753 Aug 08 08:50:26.318066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 455/938] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:26 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:27.338752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-09b8df71-8c03-4351-b646-b7d3a2f9e195 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:27.339428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-09b8df71-8c03-4351-b646-b7d3a2f9e195 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:27.345412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09b8df71-8c03-4351-b646-b7d3a2f9e195 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:27.345900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09b8df71-8c03-4351-b646-b7d3a2f9e195 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:27.346339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09b8df71-8c03-4351-b646-b7d3a2f9e195 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:27.347028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09b8df71-8c03-4351-b646-b7d3a2f9e195 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:27.347486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09b8df71-8c03-4351-b646-b7d3a2f9e195 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:27.347943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09b8df71-8c03-4351-b646-b7d3a2f9e195 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:27.414019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-09b8df71-8c03-4351-b646-b7d3a2f9e195 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:27.421702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-09b8df71-8c03-4351-b646-b7d3a2f9e195 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1219 microversion: 2.1 time: 0.087378 Aug 08 08:50:27.422274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 484/939] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:27 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:28.442931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c42a8e0f-d743-4f26-9ca4-e1587d75c443 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:28.444231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c42a8e0f-d743-4f26-9ca4-e1587d75c443 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:28.451135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c42a8e0f-d743-4f26-9ca4-e1587d75c443 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:28.451677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c42a8e0f-d743-4f26-9ca4-e1587d75c443 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:28.452172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c42a8e0f-d743-4f26-9ca4-e1587d75c443 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:28.454040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c42a8e0f-d743-4f26-9ca4-e1587d75c443 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:28.454040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c42a8e0f-d743-4f26-9ca4-e1587d75c443 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:28.454040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c42a8e0f-d743-4f26-9ca4-e1587d75c443 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:28.518564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c42a8e0f-d743-4f26-9ca4-e1587d75c443 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:28.526296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c42a8e0f-d743-4f26-9ca4-e1587d75c443 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1285 microversion: 2.1 time: 0.087296 Aug 08 08:50:28.528570 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 456/940] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:28 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:29.547455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a0793a60-6d78-4af1-8e57-ba70eeb06f28 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:29.548014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a0793a60-6d78-4af1-8e57-ba70eeb06f28 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:29.555492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a0793a60-6d78-4af1-8e57-ba70eeb06f28 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:29.555994 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a0793a60-6d78-4af1-8e57-ba70eeb06f28 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:29.557042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a0793a60-6d78-4af1-8e57-ba70eeb06f28 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:29.557355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a0793a60-6d78-4af1-8e57-ba70eeb06f28 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:29.557824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a0793a60-6d78-4af1-8e57-ba70eeb06f28 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:29.558243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a0793a60-6d78-4af1-8e57-ba70eeb06f28 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:29.707350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a0793a60-6d78-4af1-8e57-ba70eeb06f28 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:29.716911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a0793a60-6d78-4af1-8e57-ba70eeb06f28 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.173341 Aug 08 08:50:29.717622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 485/941] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:29 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:30.415611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-47ff973b-973a-4a12-aaf8-63cbc0b3bb00 req-c5c8b1e4-804d-417a-8d50-16c4d7e47bcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357b07bc-cb7e-4b2d-bbca-40b82a7c4b80", "tag": "f32faf20-c99f-4524-a735-4deff622b8e1"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:50:30.421201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:30.426676 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-47ff973b-973a-4a12-aaf8-63cbc0b3bb00 req-c5c8b1e4-804d-417a-8d50-16c4d7e47bcd service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:30.427789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-47ff973b-973a-4a12-aaf8-63cbc0b3bb00 req-c5c8b1e4-804d-417a-8d50-16c4d7e47bcd service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:30.428238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-47ff973b-973a-4a12-aaf8-63cbc0b3bb00 req-c5c8b1e4-804d-417a-8d50-16c4d7e47bcd service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:30.439191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-47ff973b-973a-4a12-aaf8-63cbc0b3bb00 req-c5c8b1e4-804d-417a-8d50-16c4d7e47bcd service nova] Creating event network-changed:f32faf20-c99f-4524-a735-4deff622b8e1 for instance 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 on hv-cinder-83697 Aug 08 08:50:30.444147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-47ff973b-973a-4a12-aaf8-63cbc0b3bb00 req-c5c8b1e4-804d-417a-8d50-16c4d7e47bcd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033424 Aug 08 08:50:30.444751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 457/942] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:50:30.738730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-25d4cf6f-4109-49de-b656-e45711c1975d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:30.739441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-25d4cf6f-4109-49de-b656-e45711c1975d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:30.746458 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d4cf6f-4109-49de-b656-e45711c1975d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:30.746952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d4cf6f-4109-49de-b656-e45711c1975d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:30.747391 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d4cf6f-4109-49de-b656-e45711c1975d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:30.748084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d4cf6f-4109-49de-b656-e45711c1975d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:30.748543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d4cf6f-4109-49de-b656-e45711c1975d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:30.748971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d4cf6f-4109-49de-b656-e45711c1975d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:31.133603 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-25d4cf6f-4109-49de-b656-e45711c1975d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:31.141000 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-25d4cf6f-4109-49de-b656-e45711c1975d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.406253 Aug 08 08:50:31.141591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 486/943] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:30 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:32.163342 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4966f735-b721-42b6-8567-ca8bd9da5545 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:32.164067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4966f735-b721-42b6-8567-ca8bd9da5545 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:32.170234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4966f735-b721-42b6-8567-ca8bd9da5545 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:32.170722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4966f735-b721-42b6-8567-ca8bd9da5545 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:32.171182 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4966f735-b721-42b6-8567-ca8bd9da5545 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:32.171855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4966f735-b721-42b6-8567-ca8bd9da5545 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:32.172316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4966f735-b721-42b6-8567-ca8bd9da5545 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:32.172748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4966f735-b721-42b6-8567-ca8bd9da5545 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:32.299607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4966f735-b721-42b6-8567-ca8bd9da5545 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:32.307099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4966f735-b721-42b6-8567-ca8bd9da5545 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.149375 Aug 08 08:50:32.307665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 458/944] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:32 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:33.327928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cf2cfcb0-5bd3-4673-8121-51d3ec2b35a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:33.328644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cf2cfcb0-5bd3-4673-8121-51d3ec2b35a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:33.336808 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf2cfcb0-5bd3-4673-8121-51d3ec2b35a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:33.337356 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf2cfcb0-5bd3-4673-8121-51d3ec2b35a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:33.337815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf2cfcb0-5bd3-4673-8121-51d3ec2b35a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:33.338503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf2cfcb0-5bd3-4673-8121-51d3ec2b35a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:33.338957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf2cfcb0-5bd3-4673-8121-51d3ec2b35a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:33.339378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf2cfcb0-5bd3-4673-8121-51d3ec2b35a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:33.484488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cf2cfcb0-5bd3-4673-8121-51d3ec2b35a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:33.492935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cf2cfcb0-5bd3-4673-8121-51d3ec2b35a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.169291 Aug 08 08:50:33.493525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 487/945] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:33 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:34.515307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-981a353d-5644-4680-a4b3-476e1b4e31bb tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:34.515918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-981a353d-5644-4680-a4b3-476e1b4e31bb tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:34.522842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981a353d-5644-4680-a4b3-476e1b4e31bb tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:34.523333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981a353d-5644-4680-a4b3-476e1b4e31bb tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:34.523770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981a353d-5644-4680-a4b3-476e1b4e31bb tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:34.524495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981a353d-5644-4680-a4b3-476e1b4e31bb tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:34.524982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981a353d-5644-4680-a4b3-476e1b4e31bb tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:34.525444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-981a353d-5644-4680-a4b3-476e1b4e31bb tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:34.652015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-981a353d-5644-4680-a4b3-476e1b4e31bb tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:34.659386 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-981a353d-5644-4680-a4b3-476e1b4e31bb tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.147930 Aug 08 08:50:34.659943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 459/946] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:34 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:35.679324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d1685a78-3439-4986-b507-91b595c395f8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:35.679855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d1685a78-3439-4986-b507-91b595c395f8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:35.686170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1685a78-3439-4986-b507-91b595c395f8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:35.686651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1685a78-3439-4986-b507-91b595c395f8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:35.687080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1685a78-3439-4986-b507-91b595c395f8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:35.687762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1685a78-3439-4986-b507-91b595c395f8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:35.688214 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1685a78-3439-4986-b507-91b595c395f8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:35.688631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1685a78-3439-4986-b507-91b595c395f8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:35.817929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d1685a78-3439-4986-b507-91b595c395f8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:35.820970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:35.826698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d1685a78-3439-4986-b507-91b595c395f8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.151800 Aug 08 08:50:35.830947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 488/947] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:35 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:36.847699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-92074d7c-3d5e-459b-b028-ad7d510cfe90 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:36.848312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-92074d7c-3d5e-459b-b028-ad7d510cfe90 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:36.851371 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:36.856312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92074d7c-3d5e-459b-b028-ad7d510cfe90 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:36.862260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92074d7c-3d5e-459b-b028-ad7d510cfe90 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:36.862260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92074d7c-3d5e-459b-b028-ad7d510cfe90 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:36.862260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92074d7c-3d5e-459b-b028-ad7d510cfe90 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:36.862260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92074d7c-3d5e-459b-b028-ad7d510cfe90 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:36.862630 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92074d7c-3d5e-459b-b028-ad7d510cfe90 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:36.862630 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:36.987723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-92074d7c-3d5e-459b-b028-ad7d510cfe90 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:36.995512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-92074d7c-3d5e-459b-b028-ad7d510cfe90 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.151636 Aug 08 08:50:36.996078 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 460/948] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:36 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:38.016630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3208eef5-6768-4016-87c1-b8cea1b4f17b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:38.017288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3208eef5-6768-4016-87c1-b8cea1b4f17b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:38.019498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:38.020147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=6 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:38.026015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3208eef5-6768-4016-87c1-b8cea1b4f17b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:38.027571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3208eef5-6768-4016-87c1-b8cea1b4f17b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:38.027571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3208eef5-6768-4016-87c1-b8cea1b4f17b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:38.027818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3208eef5-6768-4016-87c1-b8cea1b4f17b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:38.028285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3208eef5-6768-4016-87c1-b8cea1b4f17b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:38.028749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3208eef5-6768-4016-87c1-b8cea1b4f17b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:38.159337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3208eef5-6768-4016-87c1-b8cea1b4f17b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:38.167395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3208eef5-6768-4016-87c1-b8cea1b4f17b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.154751 Aug 08 08:50:38.169777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 489/949] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:38 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:39.188262 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b2078f34-200e-424c-b358-5b305b090af3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:39.188874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b2078f34-200e-424c-b358-5b305b090af3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:39.195868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2078f34-200e-424c-b358-5b305b090af3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:39.196352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2078f34-200e-424c-b358-5b305b090af3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:39.196791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2078f34-200e-424c-b358-5b305b090af3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:39.197511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2078f34-200e-424c-b358-5b305b090af3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:39.197968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2078f34-200e-424c-b358-5b305b090af3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:39.198399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2078f34-200e-424c-b358-5b305b090af3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:39.328986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b2078f34-200e-424c-b358-5b305b090af3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:39.336467 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b2078f34-200e-424c-b358-5b305b090af3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.151982 Aug 08 08:50:39.337029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 461/950] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:39 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:40.357840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-429a9a92-d23b-45f9-856b-67420df24226 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:40.358374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-429a9a92-d23b-45f9-856b-67420df24226 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:40.364762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a9a92-d23b-45f9-856b-67420df24226 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:40.365278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a9a92-d23b-45f9-856b-67420df24226 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:40.365720 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a9a92-d23b-45f9-856b-67420df24226 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:40.366492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a9a92-d23b-45f9-856b-67420df24226 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:40.366946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a9a92-d23b-45f9-856b-67420df24226 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:40.367367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a9a92-d23b-45f9-856b-67420df24226 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:40.495511 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-429a9a92-d23b-45f9-856b-67420df24226 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:40.503478 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-429a9a92-d23b-45f9-856b-67420df24226 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.149889 Aug 08 08:50:40.504032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 490/951] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:40 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:41.523804 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cbf18c6d-c6af-442e-8e51-6b1027e5b209 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:41.524419 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cbf18c6d-c6af-442e-8e51-6b1027e5b209 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:41.530791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbf18c6d-c6af-442e-8e51-6b1027e5b209 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:41.531282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbf18c6d-c6af-442e-8e51-6b1027e5b209 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:41.531723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbf18c6d-c6af-442e-8e51-6b1027e5b209 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:41.532409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbf18c6d-c6af-442e-8e51-6b1027e5b209 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:41.532867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbf18c6d-c6af-442e-8e51-6b1027e5b209 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:41.533324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbf18c6d-c6af-442e-8e51-6b1027e5b209 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:41.664965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cbf18c6d-c6af-442e-8e51-6b1027e5b209 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:41.672547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cbf18c6d-c6af-442e-8e51-6b1027e5b209 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.152588 Aug 08 08:50:41.673047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 462/952] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:41 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:42.693765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-25d59497-cc6f-41c4-b370-d9c4cc34119a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:42.694570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-25d59497-cc6f-41c4-b370-d9c4cc34119a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:42.700871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d59497-cc6f-41c4-b370-d9c4cc34119a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:42.701393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d59497-cc6f-41c4-b370-d9c4cc34119a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:42.701832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d59497-cc6f-41c4-b370-d9c4cc34119a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:42.702527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d59497-cc6f-41c4-b370-d9c4cc34119a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:42.702989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d59497-cc6f-41c4-b370-d9c4cc34119a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:42.703418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25d59497-cc6f-41c4-b370-d9c4cc34119a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:42.829716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-25d59497-cc6f-41c4-b370-d9c4cc34119a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:42.837654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-25d59497-cc6f-41c4-b370-d9c4cc34119a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.147661 Aug 08 08:50:42.838227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 491/953] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:42 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:43.858875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f2087af4-9798-4842-97a8-4308918d14c6 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:43.859410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f2087af4-9798-4842-97a8-4308918d14c6 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:43.866632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2087af4-9798-4842-97a8-4308918d14c6 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:43.867121 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2087af4-9798-4842-97a8-4308918d14c6 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:43.867561 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2087af4-9798-4842-97a8-4308918d14c6 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:43.868240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2087af4-9798-4842-97a8-4308918d14c6 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:43.868698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2087af4-9798-4842-97a8-4308918d14c6 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:43.869120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2087af4-9798-4842-97a8-4308918d14c6 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:43.999379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f2087af4-9798-4842-97a8-4308918d14c6 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:44.007013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f2087af4-9798-4842-97a8-4308918d14c6 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.152014 Aug 08 08:50:44.009313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 463/954] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:43 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:45.027434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ede2536d-7240-43bc-ba0d-fcc1cb3f1229 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:45.028037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ede2536d-7240-43bc-ba0d-fcc1cb3f1229 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:45.034365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede2536d-7240-43bc-ba0d-fcc1cb3f1229 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:45.034879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede2536d-7240-43bc-ba0d-fcc1cb3f1229 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:45.035311 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede2536d-7240-43bc-ba0d-fcc1cb3f1229 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:45.035993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede2536d-7240-43bc-ba0d-fcc1cb3f1229 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:45.036447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede2536d-7240-43bc-ba0d-fcc1cb3f1229 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:45.036869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ede2536d-7240-43bc-ba0d-fcc1cb3f1229 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:45.171294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ede2536d-7240-43bc-ba0d-fcc1cb3f1229 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:45.179427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ede2536d-7240-43bc-ba0d-fcc1cb3f1229 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.155065 Aug 08 08:50:45.179988 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 492/955] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:45 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:46.200112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3a4358dd-edd3-422e-95e8-b01c0829deba tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:46.200730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3a4358dd-edd3-422e-95e8-b01c0829deba tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:46.206995 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a4358dd-edd3-422e-95e8-b01c0829deba tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:46.207591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a4358dd-edd3-422e-95e8-b01c0829deba tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:46.207954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a4358dd-edd3-422e-95e8-b01c0829deba tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:46.208647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a4358dd-edd3-422e-95e8-b01c0829deba tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:46.209104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a4358dd-edd3-422e-95e8-b01c0829deba tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:46.209555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3a4358dd-edd3-422e-95e8-b01c0829deba tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:46.338694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3a4358dd-edd3-422e-95e8-b01c0829deba tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:46.345968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3a4358dd-edd3-422e-95e8-b01c0829deba tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.149604 Aug 08 08:50:46.346545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 464/956] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:46 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:47.366694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-653d80b4-6702-43b9-bea8-80ee59d3c2e1 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:47.367339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-653d80b4-6702-43b9-bea8-80ee59d3c2e1 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:47.373798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-653d80b4-6702-43b9-bea8-80ee59d3c2e1 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:47.374284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-653d80b4-6702-43b9-bea8-80ee59d3c2e1 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:47.374724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-653d80b4-6702-43b9-bea8-80ee59d3c2e1 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:47.375418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-653d80b4-6702-43b9-bea8-80ee59d3c2e1 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:47.375875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-653d80b4-6702-43b9-bea8-80ee59d3c2e1 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:47.376302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-653d80b4-6702-43b9-bea8-80ee59d3c2e1 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:47.508774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-653d80b4-6702-43b9-bea8-80ee59d3c2e1 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:47.516090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-653d80b4-6702-43b9-bea8-80ee59d3c2e1 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.153510 Aug 08 08:50:47.516650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 493/957] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:47 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:48.536091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-856cc943-e382-43ca-8f34-4a81174694fa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:48.536607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-856cc943-e382-43ca-8f34-4a81174694fa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:48.543695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-856cc943-e382-43ca-8f34-4a81174694fa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:48.544172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-856cc943-e382-43ca-8f34-4a81174694fa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:48.544605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-856cc943-e382-43ca-8f34-4a81174694fa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:48.545316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-856cc943-e382-43ca-8f34-4a81174694fa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:48.545770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-856cc943-e382-43ca-8f34-4a81174694fa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:48.546191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-856cc943-e382-43ca-8f34-4a81174694fa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:48.674302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-856cc943-e382-43ca-8f34-4a81174694fa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:48.681731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-856cc943-e382-43ca-8f34-4a81174694fa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.149497 Aug 08 08:50:48.682292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 465/958] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:48 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:49.702079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8cc2e4c7-931c-4e57-ae2f-c81b1c701a0f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:49.702684 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8cc2e4c7-931c-4e57-ae2f-c81b1c701a0f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:49.709165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc2e4c7-931c-4e57-ae2f-c81b1c701a0f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:49.709648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc2e4c7-931c-4e57-ae2f-c81b1c701a0f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:49.710112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc2e4c7-931c-4e57-ae2f-c81b1c701a0f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:49.710797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc2e4c7-931c-4e57-ae2f-c81b1c701a0f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:49.711244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc2e4c7-931c-4e57-ae2f-c81b1c701a0f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:49.711665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc2e4c7-931c-4e57-ae2f-c81b1c701a0f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:49.988757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8cc2e4c7-931c-4e57-ae2f-c81b1c701a0f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:49.996772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8cc2e4c7-931c-4e57-ae2f-c81b1c701a0f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.298518 Aug 08 08:50:49.997371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 494/959] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:49 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:51.017244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8fee23fa-18fd-4be2-b33e-84c400e3501e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:51.017919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8fee23fa-18fd-4be2-b33e-84c400e3501e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:51.024792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fee23fa-18fd-4be2-b33e-84c400e3501e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:51.025304 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fee23fa-18fd-4be2-b33e-84c400e3501e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:51.025796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fee23fa-18fd-4be2-b33e-84c400e3501e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:51.026489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fee23fa-18fd-4be2-b33e-84c400e3501e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:51.026947 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fee23fa-18fd-4be2-b33e-84c400e3501e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:51.027372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8fee23fa-18fd-4be2-b33e-84c400e3501e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:51.156618 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8fee23fa-18fd-4be2-b33e-84c400e3501e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:51.165537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8fee23fa-18fd-4be2-b33e-84c400e3501e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.152176 Aug 08 08:50:51.166095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 466/960] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:51 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:52.186114 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8fc566b4-5a76-4d92-9e5d-35e135d470a3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:52.186756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8fc566b4-5a76-4d92-9e5d-35e135d470a3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:52.193096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc566b4-5a76-4d92-9e5d-35e135d470a3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:52.193618 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc566b4-5a76-4d92-9e5d-35e135d470a3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:52.194073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc566b4-5a76-4d92-9e5d-35e135d470a3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:52.194905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc566b4-5a76-4d92-9e5d-35e135d470a3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:52.195272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc566b4-5a76-4d92-9e5d-35e135d470a3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:52.195725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8fc566b4-5a76-4d92-9e5d-35e135d470a3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:52.322643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8fc566b4-5a76-4d92-9e5d-35e135d470a3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:52.329971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8fc566b4-5a76-4d92-9e5d-35e135d470a3 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.147834 Aug 08 08:50:52.330525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 495/961] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:52 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:53.351652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-380c3da4-d9fb-44f0-bf26-31d6c8a2554b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:53.352292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-380c3da4-d9fb-44f0-bf26-31d6c8a2554b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:53.354864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=28 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:53.359517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-380c3da4-d9fb-44f0-bf26-31d6c8a2554b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:53.360009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-380c3da4-d9fb-44f0-bf26-31d6c8a2554b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:53.360453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-380c3da4-d9fb-44f0-bf26-31d6c8a2554b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:53.361258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-380c3da4-d9fb-44f0-bf26-31d6c8a2554b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:53.361729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-380c3da4-d9fb-44f0-bf26-31d6c8a2554b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:53.362162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-380c3da4-d9fb-44f0-bf26-31d6c8a2554b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:53.495026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-380c3da4-d9fb-44f0-bf26-31d6c8a2554b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:53.502426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-380c3da4-d9fb-44f0-bf26-31d6c8a2554b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.155310 Aug 08 08:50:53.502988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 467/962] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:53 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:54.524375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-46896186-9023-4bb0-91eb-680d6fdd48a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:54.524986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-46896186-9023-4bb0-91eb-680d6fdd48a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:54.531681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46896186-9023-4bb0-91eb-680d6fdd48a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:54.532162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46896186-9023-4bb0-91eb-680d6fdd48a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:54.532595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46896186-9023-4bb0-91eb-680d6fdd48a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:54.533312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46896186-9023-4bb0-91eb-680d6fdd48a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:54.533767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46896186-9023-4bb0-91eb-680d6fdd48a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:54.534180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46896186-9023-4bb0-91eb-680d6fdd48a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:54.661587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-46896186-9023-4bb0-91eb-680d6fdd48a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:54.670272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-46896186-9023-4bb0-91eb-680d6fdd48a7 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.150524 Aug 08 08:50:54.670825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 496/963] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:54 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:55.690343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9bc56dcd-ad2a-4869-a5b1-638e08f476e8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:55.690963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9bc56dcd-ad2a-4869-a5b1-638e08f476e8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:55.697989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bc56dcd-ad2a-4869-a5b1-638e08f476e8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:55.698481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bc56dcd-ad2a-4869-a5b1-638e08f476e8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:55.698923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bc56dcd-ad2a-4869-a5b1-638e08f476e8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:55.699624 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bc56dcd-ad2a-4869-a5b1-638e08f476e8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:55.700094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bc56dcd-ad2a-4869-a5b1-638e08f476e8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:55.700825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bc56dcd-ad2a-4869-a5b1-638e08f476e8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:55.832582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9bc56dcd-ad2a-4869-a5b1-638e08f476e8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:55.840136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9bc56dcd-ad2a-4869-a5b1-638e08f476e8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.153593 Aug 08 08:50:55.840703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 468/964] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:55 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:56.861208 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ef90b0c2-5f9f-4d9d-b445-6f410737328f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:56.861830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ef90b0c2-5f9f-4d9d-b445-6f410737328f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:56.864105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:50:56.869424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef90b0c2-5f9f-4d9d-b445-6f410737328f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:56.869912 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef90b0c2-5f9f-4d9d-b445-6f410737328f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:56.870351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef90b0c2-5f9f-4d9d-b445-6f410737328f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:56.871041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef90b0c2-5f9f-4d9d-b445-6f410737328f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:56.871502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef90b0c2-5f9f-4d9d-b445-6f410737328f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:56.871931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef90b0c2-5f9f-4d9d-b445-6f410737328f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:56.999674 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ef90b0c2-5f9f-4d9d-b445-6f410737328f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:57.007049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ef90b0c2-5f9f-4d9d-b445-6f410737328f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.149729 Aug 08 08:50:57.008431 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 497/965] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:56 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:58.028875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f6ad9f0a-e1d2-40f5-b1ab-07422f7fbf61 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:58.029518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f6ad9f0a-e1d2-40f5-b1ab-07422f7fbf61 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:58.038337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6ad9f0a-e1d2-40f5-b1ab-07422f7fbf61 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:58.038337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6ad9f0a-e1d2-40f5-b1ab-07422f7fbf61 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:58.038337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6ad9f0a-e1d2-40f5-b1ab-07422f7fbf61 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:58.038337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6ad9f0a-e1d2-40f5-b1ab-07422f7fbf61 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:58.038829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6ad9f0a-e1d2-40f5-b1ab-07422f7fbf61 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:58.038829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6ad9f0a-e1d2-40f5-b1ab-07422f7fbf61 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:58.165322 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f6ad9f0a-e1d2-40f5-b1ab-07422f7fbf61 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:58.173047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f6ad9f0a-e1d2-40f5-b1ab-07422f7fbf61 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.148089 Aug 08 08:50:58.173633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 469/966] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:58 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:50:59.193512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0ed4dd4d-ee8d-4187-a5a4-64b7b7e11d77 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:50:59.194320 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0ed4dd4d-ee8d-4187-a5a4-64b7b7e11d77 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:50:59.201306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ed4dd4d-ee8d-4187-a5a4-64b7b7e11d77 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:59.201786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ed4dd4d-ee8d-4187-a5a4-64b7b7e11d77 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:59.202220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ed4dd4d-ee8d-4187-a5a4-64b7b7e11d77 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:59.202904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ed4dd4d-ee8d-4187-a5a4-64b7b7e11d77 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:50:59.203357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ed4dd4d-ee8d-4187-a5a4-64b7b7e11d77 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:50:59.203783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ed4dd4d-ee8d-4187-a5a4-64b7b7e11d77 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:50:59.334791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0ed4dd4d-ee8d-4187-a5a4-64b7b7e11d77 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:50:59.342847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0ed4dd4d-ee8d-4187-a5a4-64b7b7e11d77 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.153149 Aug 08 08:50:59.343407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 498/967] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:50:59 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:00.364103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3ca0ed71-3ae8-4918-b6af-c7a6db046901 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:00.364677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3ca0ed71-3ae8-4918-b6af-c7a6db046901 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:00.371908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca0ed71-3ae8-4918-b6af-c7a6db046901 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:00.372392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca0ed71-3ae8-4918-b6af-c7a6db046901 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:00.372831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca0ed71-3ae8-4918-b6af-c7a6db046901 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:00.373566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca0ed71-3ae8-4918-b6af-c7a6db046901 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:00.374053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca0ed71-3ae8-4918-b6af-c7a6db046901 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:00.374482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca0ed71-3ae8-4918-b6af-c7a6db046901 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:00.504390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3ca0ed71-3ae8-4918-b6af-c7a6db046901 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:00.512767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3ca0ed71-3ae8-4918-b6af-c7a6db046901 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.152648 Aug 08 08:51:00.513364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 470/968] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:00 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:01.533558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b394714c-80b7-48fd-a7de-bb37c1bb4108 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:01.534176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b394714c-80b7-48fd-a7de-bb37c1bb4108 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:01.540751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b394714c-80b7-48fd-a7de-bb37c1bb4108 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:01.541284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b394714c-80b7-48fd-a7de-bb37c1bb4108 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:01.541729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b394714c-80b7-48fd-a7de-bb37c1bb4108 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:01.542427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b394714c-80b7-48fd-a7de-bb37c1bb4108 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:01.542889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b394714c-80b7-48fd-a7de-bb37c1bb4108 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:01.543326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b394714c-80b7-48fd-a7de-bb37c1bb4108 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:01.676654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b394714c-80b7-48fd-a7de-bb37c1bb4108 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:01.684713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b394714c-80b7-48fd-a7de-bb37c1bb4108 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.155039 Aug 08 08:51:01.685280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 499/969] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:01 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:02.704814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a373a8ee-51d6-4379-abf7-16a861c62c54 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:02.705435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a373a8ee-51d6-4379-abf7-16a861c62c54 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:02.712513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a373a8ee-51d6-4379-abf7-16a861c62c54 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:02.713090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a373a8ee-51d6-4379-abf7-16a861c62c54 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:02.713562 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a373a8ee-51d6-4379-abf7-16a861c62c54 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:02.714262 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a373a8ee-51d6-4379-abf7-16a861c62c54 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:02.714720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a373a8ee-51d6-4379-abf7-16a861c62c54 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:02.715148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a373a8ee-51d6-4379-abf7-16a861c62c54 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:02.841783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a373a8ee-51d6-4379-abf7-16a861c62c54 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:02.849036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a373a8ee-51d6-4379-abf7-16a861c62c54 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.148000 Aug 08 08:51:02.849629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 471/970] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:02 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:03.869826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2e5772a2-a558-4f07-b30b-fe7da0c5cdaa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:03.870341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2e5772a2-a558-4f07-b30b-fe7da0c5cdaa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:03.876589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e5772a2-a558-4f07-b30b-fe7da0c5cdaa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:03.877104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e5772a2-a558-4f07-b30b-fe7da0c5cdaa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:03.880350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e5772a2-a558-4f07-b30b-fe7da0c5cdaa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:03.880350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e5772a2-a558-4f07-b30b-fe7da0c5cdaa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:03.880350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e5772a2-a558-4f07-b30b-fe7da0c5cdaa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:03.880350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e5772a2-a558-4f07-b30b-fe7da0c5cdaa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:04.011854 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2e5772a2-a558-4f07-b30b-fe7da0c5cdaa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:04.019344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2e5772a2-a558-4f07-b30b-fe7da0c5cdaa tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.153426 Aug 08 08:51:04.019898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 500/971] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:03 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:05.040509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cc451457-b74f-4657-b0f1-cd59dd94c6b8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:05.041202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cc451457-b74f-4657-b0f1-cd59dd94c6b8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:05.047735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc451457-b74f-4657-b0f1-cd59dd94c6b8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:05.048225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc451457-b74f-4657-b0f1-cd59dd94c6b8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:05.048667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc451457-b74f-4657-b0f1-cd59dd94c6b8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:05.049404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc451457-b74f-4657-b0f1-cd59dd94c6b8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:05.049870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc451457-b74f-4657-b0f1-cd59dd94c6b8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:05.050307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc451457-b74f-4657-b0f1-cd59dd94c6b8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:05.177718 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cc451457-b74f-4657-b0f1-cd59dd94c6b8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:05.185135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cc451457-b74f-4657-b0f1-cd59dd94c6b8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.149249 Aug 08 08:51:05.185712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 472/972] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:05 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:06.205379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-699e7bf9-a8fb-4277-9841-70eba3b9f5db tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:06.205984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-699e7bf9-a8fb-4277-9841-70eba3b9f5db tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:06.212999 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-699e7bf9-a8fb-4277-9841-70eba3b9f5db tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:06.213505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-699e7bf9-a8fb-4277-9841-70eba3b9f5db tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:06.213939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-699e7bf9-a8fb-4277-9841-70eba3b9f5db tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:06.214626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-699e7bf9-a8fb-4277-9841-70eba3b9f5db tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:06.215086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-699e7bf9-a8fb-4277-9841-70eba3b9f5db tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:06.215509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-699e7bf9-a8fb-4277-9841-70eba3b9f5db tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:06.354858 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-699e7bf9-a8fb-4277-9841-70eba3b9f5db tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:06.362481 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-699e7bf9-a8fb-4277-9841-70eba3b9f5db tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.160947 Aug 08 08:51:06.363049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 501/973] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:06 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:07.384497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0d8cc43d-28b1-413c-bff4-bc38e2522361 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:07.385134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0d8cc43d-28b1-413c-bff4-bc38e2522361 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:07.391694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0d8cc43d-28b1-413c-bff4-bc38e2522361 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:07.392255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0d8cc43d-28b1-413c-bff4-bc38e2522361 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:07.392755 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0d8cc43d-28b1-413c-bff4-bc38e2522361 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:07.393484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0d8cc43d-28b1-413c-bff4-bc38e2522361 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:07.393945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0d8cc43d-28b1-413c-bff4-bc38e2522361 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:07.394401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0d8cc43d-28b1-413c-bff4-bc38e2522361 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:07.398345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=77 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:51:07.525624 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0d8cc43d-28b1-413c-bff4-bc38e2522361 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:07.532952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0d8cc43d-28b1-413c-bff4-bc38e2522361 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.153105 Aug 08 08:51:07.533538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 473/974] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:07 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:08.553048 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-30fd0fff-4d03-42a4-ba7f-3b396501f9fd tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:08.553699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-30fd0fff-4d03-42a4-ba7f-3b396501f9fd tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:08.560783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fd0fff-4d03-42a4-ba7f-3b396501f9fd tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:08.561305 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fd0fff-4d03-42a4-ba7f-3b396501f9fd tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:08.561739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fd0fff-4d03-42a4-ba7f-3b396501f9fd tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:08.562429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fd0fff-4d03-42a4-ba7f-3b396501f9fd tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:08.562885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fd0fff-4d03-42a4-ba7f-3b396501f9fd tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:08.563308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30fd0fff-4d03-42a4-ba7f-3b396501f9fd tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:08.565878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=80 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:51:08.691005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-30fd0fff-4d03-42a4-ba7f-3b396501f9fd tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:08.698489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-30fd0fff-4d03-42a4-ba7f-3b396501f9fd tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.149296 Aug 08 08:51:08.699037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 502/975] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:08 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:09.719198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-99abf646-71ba-4a65-8b7e-29df36268105 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:09.719764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-99abf646-71ba-4a65-8b7e-29df36268105 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:09.726172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99abf646-71ba-4a65-8b7e-29df36268105 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:09.726657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99abf646-71ba-4a65-8b7e-29df36268105 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:09.727190 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99abf646-71ba-4a65-8b7e-29df36268105 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:09.727970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99abf646-71ba-4a65-8b7e-29df36268105 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:09.728428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99abf646-71ba-4a65-8b7e-29df36268105 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:09.728899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99abf646-71ba-4a65-8b7e-29df36268105 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:09.861696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-99abf646-71ba-4a65-8b7e-29df36268105 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:09.869924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-99abf646-71ba-4a65-8b7e-29df36268105 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.154691 Aug 08 08:51:09.870481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 474/976] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:09 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:10.891045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9124ad22-f8c7-42ab-ac48-21b7c7f570ec tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:10.891663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9124ad22-f8c7-42ab-ac48-21b7c7f570ec tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:10.898166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9124ad22-f8c7-42ab-ac48-21b7c7f570ec tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:10.898653 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9124ad22-f8c7-42ab-ac48-21b7c7f570ec tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:10.899092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9124ad22-f8c7-42ab-ac48-21b7c7f570ec tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:10.900474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9124ad22-f8c7-42ab-ac48-21b7c7f570ec tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:10.900996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9124ad22-f8c7-42ab-ac48-21b7c7f570ec tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:10.901465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9124ad22-f8c7-42ab-ac48-21b7c7f570ec tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:11.028298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9124ad22-f8c7-42ab-ac48-21b7c7f570ec tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:11.035657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9124ad22-f8c7-42ab-ac48-21b7c7f570ec tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.148474 Aug 08 08:51:11.036220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 503/977] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:10 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:12.055724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2f506acb-650d-454c-8119-7260443c2c6a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:12.056397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2f506acb-650d-454c-8119-7260443c2c6a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:12.062754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f506acb-650d-454c-8119-7260443c2c6a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:12.063233 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f506acb-650d-454c-8119-7260443c2c6a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:12.063670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f506acb-650d-454c-8119-7260443c2c6a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:12.064358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f506acb-650d-454c-8119-7260443c2c6a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:12.064809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f506acb-650d-454c-8119-7260443c2c6a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:12.065255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f506acb-650d-454c-8119-7260443c2c6a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:12.195200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2f506acb-650d-454c-8119-7260443c2c6a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:12.203306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2f506acb-650d-454c-8119-7260443c2c6a tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.151387 Aug 08 08:51:12.203867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 475/978] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:12 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:13.225117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5c6b1670-de5e-4b26-87da-ee77b35a496d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:13.225755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5c6b1670-de5e-4b26-87da-ee77b35a496d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:13.233078 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c6b1670-de5e-4b26-87da-ee77b35a496d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:13.234140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c6b1670-de5e-4b26-87da-ee77b35a496d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:13.234285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c6b1670-de5e-4b26-87da-ee77b35a496d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:13.234871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c6b1670-de5e-4b26-87da-ee77b35a496d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:13.235324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c6b1670-de5e-4b26-87da-ee77b35a496d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:13.235923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5c6b1670-de5e-4b26-87da-ee77b35a496d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:13.375386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5c6b1670-de5e-4b26-87da-ee77b35a496d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:13.383189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5c6b1670-de5e-4b26-87da-ee77b35a496d tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.162154 Aug 08 08:51:13.383754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 504/979] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:13 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:13.840735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e61fee0e-d91a-4cc8-8774-f74c74ba4432 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:13.841401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e61fee0e-d91a-4cc8-8774-f74c74ba4432 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:13.848544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e61fee0e-d91a-4cc8-8774-f74c74ba4432 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:13.853541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e61fee0e-d91a-4cc8-8774-f74c74ba4432 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:13.853541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e61fee0e-d91a-4cc8-8774-f74c74ba4432 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:13.853541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e61fee0e-d91a-4cc8-8774-f74c74ba4432 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:13.853541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e61fee0e-d91a-4cc8-8774-f74c74ba4432 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:13.853962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e61fee0e-d91a-4cc8-8774-f74c74ba4432 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:13.980135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e61fee0e-d91a-4cc8-8774-f74c74ba4432 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:13.988132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e61fee0e-d91a-4cc8-8774-f74c74ba4432 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1594 microversion: 2.1 time: 0.151752 Aug 08 08:51:13.989092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 476/980] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:14.403984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e2a17c95-1434-44de-9516-d660167ca412 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:14.404640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e2a17c95-1434-44de-9516-d660167ca412 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:14.411422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2a17c95-1434-44de-9516-d660167ca412 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:14.411924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2a17c95-1434-44de-9516-d660167ca412 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:14.412360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2a17c95-1434-44de-9516-d660167ca412 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:14.413285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2a17c95-1434-44de-9516-d660167ca412 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:14.413909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2a17c95-1434-44de-9516-d660167ca412 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:14.414500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2a17c95-1434-44de-9516-d660167ca412 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:14.563008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e2a17c95-1434-44de-9516-d660167ca412 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:14.570956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e2a17c95-1434-44de-9516-d660167ca412 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.170950 Aug 08 08:51:14.571655 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 505/981] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:14 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:15.590424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1a920386-6485-40a1-b959-7297ee200ec8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:15.590973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1a920386-6485-40a1-b959-7297ee200ec8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:15.597315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a920386-6485-40a1-b959-7297ee200ec8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:15.597839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a920386-6485-40a1-b959-7297ee200ec8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:15.598286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a920386-6485-40a1-b959-7297ee200ec8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:15.598979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a920386-6485-40a1-b959-7297ee200ec8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:15.599436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a920386-6485-40a1-b959-7297ee200ec8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:15.599895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a920386-6485-40a1-b959-7297ee200ec8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:15.730932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1a920386-6485-40a1-b959-7297ee200ec8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:15.738475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1a920386-6485-40a1-b959-7297ee200ec8 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.152084 Aug 08 08:51:15.739049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 477/982] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:15 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:16.028015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-e47a0fa2-4ae2-44e5-b9e3-7faae2889095 req-e4e46e1c-4b4b-447d-93fe-f6cf006e74e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83365b2d-9f2c-4966-bdb6-789059348c37", "tag": "19d95122-9b77-4b3d-adf8-fcfd43a61168"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:51:16.040010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-e47a0fa2-4ae2-44e5-b9e3-7faae2889095 req-e4e46e1c-4b4b-447d-93fe-f6cf006e74e6 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:16.041278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-e47a0fa2-4ae2-44e5-b9e3-7faae2889095 req-e4e46e1c-4b4b-447d-93fe-f6cf006e74e6 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:16.041910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-e47a0fa2-4ae2-44e5-b9e3-7faae2889095 req-e4e46e1c-4b4b-447d-93fe-f6cf006e74e6 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:16.058367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-e47a0fa2-4ae2-44e5-b9e3-7faae2889095 req-e4e46e1c-4b4b-447d-93fe-f6cf006e74e6 service nova] Creating event network-changed:19d95122-9b77-4b3d-adf8-fcfd43a61168 for instance 83365b2d-9f2c-4966-bdb6-789059348c37 on hv-cinder-83697 Aug 08 08:51:16.063812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-e47a0fa2-4ae2-44e5-b9e3-7faae2889095 req-e4e46e1c-4b4b-447d-93fe-f6cf006e74e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039991 Aug 08 08:51:16.064792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 506/983] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:51:16.481829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-15cb7826-5bd3-45d4-a257-b56123b388ac req-8ad163ff-364c-4cf6-844f-d410eb21847f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357b07bc-cb7e-4b2d-bbca-40b82a7c4b80", "name": "network-vif-plugged", "status": "completed", "tag": "f32faf20-c99f-4524-a735-4deff622b8e1"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:51:16.495411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-15cb7826-5bd3-45d4-a257-b56123b388ac req-8ad163ff-364c-4cf6-844f-d410eb21847f service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:16.496169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-15cb7826-5bd3-45d4-a257-b56123b388ac req-8ad163ff-364c-4cf6-844f-d410eb21847f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:16.496897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-15cb7826-5bd3-45d4-a257-b56123b388ac req-8ad163ff-364c-4cf6-844f-d410eb21847f service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:16.510424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-15cb7826-5bd3-45d4-a257-b56123b388ac req-8ad163ff-364c-4cf6-844f-d410eb21847f service nova] Creating event network-vif-plugged:f32faf20-c99f-4524-a735-4deff622b8e1 for instance 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 on hv-cinder-83697 Aug 08 08:51:16.516273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-15cb7826-5bd3-45d4-a257-b56123b388ac req-8ad163ff-364c-4cf6-844f-d410eb21847f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040804 Aug 08 08:51:16.517764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 478/984] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:51:16.761267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c4180f06-cff0-45f8-81ec-c33049db69bf tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:16.767178 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c4180f06-cff0-45f8-81ec-c33049db69bf tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:16.768871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4180f06-cff0-45f8-81ec-c33049db69bf tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:16.769396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4180f06-cff0-45f8-81ec-c33049db69bf tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:16.769839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4180f06-cff0-45f8-81ec-c33049db69bf tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:16.770541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4180f06-cff0-45f8-81ec-c33049db69bf tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:16.771002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4180f06-cff0-45f8-81ec-c33049db69bf tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:16.771427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4180f06-cff0-45f8-81ec-c33049db69bf tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:16.960453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c4180f06-cff0-45f8-81ec-c33049db69bf tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:16.972245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c4180f06-cff0-45f8-81ec-c33049db69bf tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.216542 Aug 08 08:51:16.972736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 507/985] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:16 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:17.994695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ca059bce-5329-4f78-b112-dce858f07c4b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:17.996398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ca059bce-5329-4f78-b112-dce858f07c4b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:18.001417 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca059bce-5329-4f78-b112-dce858f07c4b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:18.001977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca059bce-5329-4f78-b112-dce858f07c4b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:18.002475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca059bce-5329-4f78-b112-dce858f07c4b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:18.003120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca059bce-5329-4f78-b112-dce858f07c4b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:18.003577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca059bce-5329-4f78-b112-dce858f07c4b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:18.004002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca059bce-5329-4f78-b112-dce858f07c4b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:18.147355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ca059bce-5329-4f78-b112-dce858f07c4b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:18.154801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ca059bce-5329-4f78-b112-dce858f07c4b tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1315 microversion: 2.1 time: 0.165484 Aug 08 08:51:18.155364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 479/986] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:17 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:18.581398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c7ecdd59-0f64-4c41-bc7b-46dd4c54fcb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-679055896"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:51:18.581873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c7ecdd59-0f64-4c41-bc7b-46dd4c54fcb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:18.589020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7ecdd59-0f64-4c41-bc7b-46dd4c54fcb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:18.589736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7ecdd59-0f64-4c41-bc7b-46dd4c54fcb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:18.590172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7ecdd59-0f64-4c41-bc7b-46dd4c54fcb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:18.590856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7ecdd59-0f64-4c41-bc7b-46dd4c54fcb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:18.591315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7ecdd59-0f64-4c41-bc7b-46dd4c54fcb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:18.591736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7ecdd59-0f64-4c41-bc7b-46dd4c54fcb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:18.722062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.network.security_group_api [None req-c7ecdd59-0f64-4c41-bc7b-46dd4c54fcb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Adding security group a770d978-24e4-4252-953c-84e0381e5405 to port 19d95122-9b77-4b3d-adf8-fcfd43a61168 Aug 08 08:51:19.100313 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c7ecdd59-0f64-4c41-bc7b-46dd4c54fcb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "POST /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/action" status: 202 len: 0 microversion: 2.1 time: 0.523154 Aug 08 08:51:19.101506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 508/987] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:51:18 2022] POST /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:51:19.113176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-be95cec4-19db-485d-9f3d-279901595b74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:19.119429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-be95cec4-19db-485d-9f3d-279901595b74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:19.121314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be95cec4-19db-485d-9f3d-279901595b74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:19.121971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be95cec4-19db-485d-9f3d-279901595b74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:19.122425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be95cec4-19db-485d-9f3d-279901595b74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:19.123325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be95cec4-19db-485d-9f3d-279901595b74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:19.123963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be95cec4-19db-485d-9f3d-279901595b74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:19.125724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be95cec4-19db-485d-9f3d-279901595b74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:19.141522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-acbf8fd6-17ab-45df-9cb8-97f6dc092848 req-8be308c0-d43a-4f50-bb51-d6e3ace99394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83365b2d-9f2c-4966-bdb6-789059348c37", "tag": "19d95122-9b77-4b3d-adf8-fcfd43a61168"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:51:19.158157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-acbf8fd6-17ab-45df-9cb8-97f6dc092848 req-8be308c0-d43a-4f50-bb51-d6e3ace99394 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:19.158904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-acbf8fd6-17ab-45df-9cb8-97f6dc092848 req-8be308c0-d43a-4f50-bb51-d6e3ace99394 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:19.159407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-acbf8fd6-17ab-45df-9cb8-97f6dc092848 req-8be308c0-d43a-4f50-bb51-d6e3ace99394 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:19.174368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-acbf8fd6-17ab-45df-9cb8-97f6dc092848 req-8be308c0-d43a-4f50-bb51-d6e3ace99394 service nova] Creating event network-changed:19d95122-9b77-4b3d-adf8-fcfd43a61168 for instance 83365b2d-9f2c-4966-bdb6-789059348c37 on hv-cinder-83697 Aug 08 08:51:19.179474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-acbf8fd6-17ab-45df-9cb8-97f6dc092848 req-8be308c0-d43a-4f50-bb51-d6e3ace99394 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042091 Aug 08 08:51:19.180260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 509/988] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:51:19.185304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-283ab1e2-194a-48d1-a6ec-e019d38d6c5f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:19.186055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-283ab1e2-194a-48d1-a6ec-e019d38d6c5f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:19.195899 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-283ab1e2-194a-48d1-a6ec-e019d38d6c5f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:19.197031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-283ab1e2-194a-48d1-a6ec-e019d38d6c5f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:19.197738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-283ab1e2-194a-48d1-a6ec-e019d38d6c5f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:19.198561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-283ab1e2-194a-48d1-a6ec-e019d38d6c5f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:19.199029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-283ab1e2-194a-48d1-a6ec-e019d38d6c5f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:19.199454 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-283ab1e2-194a-48d1-a6ec-e019d38d6c5f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:19.385707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-be95cec4-19db-485d-9f3d-279901595b74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:19.395464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-be95cec4-19db-485d-9f3d-279901595b74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1759 microversion: 2.1 time: 0.287262 Aug 08 08:51:19.396427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 480/989] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1759 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:19.406050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-283ab1e2-194a-48d1-a6ec-e019d38d6c5f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:19.417578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-283ab1e2-194a-48d1-a6ec-e019d38d6c5f tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1464 microversion: 2.1 time: 0.235302 Aug 08 08:51:19.423076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 510/990] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:19 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1464 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:19.466538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b7ac8173-98b1-4c34-bbc8-b700afeb2e93 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:19.467047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b7ac8173-98b1-4c34-bbc8-b700afeb2e93 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:19.474389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7ac8173-98b1-4c34-bbc8-b700afeb2e93 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:19.474389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7ac8173-98b1-4c34-bbc8-b700afeb2e93 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:19.474389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7ac8173-98b1-4c34-bbc8-b700afeb2e93 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:19.475114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7ac8173-98b1-4c34-bbc8-b700afeb2e93 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:19.476311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7ac8173-98b1-4c34-bbc8-b700afeb2e93 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:19.476311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b7ac8173-98b1-4c34-bbc8-b700afeb2e93 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:19.503177 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b7ac8173-98b1-4c34-bbc8-b700afeb2e93 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Going to try to terminate instance {{(pid=124673) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:51:19.835367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b7ac8173-98b1-4c34-bbc8-b700afeb2e93 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "DELETE /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 204 len: 0 microversion: 2.1 time: 0.373692 Aug 08 08:51:19.835957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 481/991] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:51:19 2022] DELETE /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:51:19.845130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9fec9483-87a2-4053-88e5-686bdaac1189 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:19.845768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9fec9483-87a2-4053-88e5-686bdaac1189 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:19.852140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9fec9483-87a2-4053-88e5-686bdaac1189 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:19.852650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9fec9483-87a2-4053-88e5-686bdaac1189 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:19.853119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9fec9483-87a2-4053-88e5-686bdaac1189 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:19.853908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9fec9483-87a2-4053-88e5-686bdaac1189 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:19.854370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9fec9483-87a2-4053-88e5-686bdaac1189 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:19.855051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9fec9483-87a2-4053-88e5-686bdaac1189 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:19.983042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9fec9483-87a2-4053-88e5-686bdaac1189 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:19.990656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9fec9483-87a2-4053-88e5-686bdaac1189 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1470 microversion: 2.1 time: 0.149463 Aug 08 08:51:19.991222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 511/992] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:19 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:20.626642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fe9e142e-66cb-49ab-b967-ac42e001954b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:51:20.629131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fe9e142e-66cb-49ab-b967-ac42e001954b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:20.636242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe9e142e-66cb-49ab-b967-ac42e001954b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:20.636724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe9e142e-66cb-49ab-b967-ac42e001954b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:20.637188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe9e142e-66cb-49ab-b967-ac42e001954b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:20.637880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe9e142e-66cb-49ab-b967-ac42e001954b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:20.638341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe9e142e-66cb-49ab-b967-ac42e001954b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:20.638771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe9e142e-66cb-49ab-b967-ac42e001954b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:20.878806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fe9e142e-66cb-49ab-b967-ac42e001954b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "POST /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/action" status: 202 len: 0 microversion: 2.1 time: 0.256308 Aug 08 08:51:20.879440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 482/993] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:51:20 2022] POST /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:51:20.888385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-651e5955-4fbd-4e59-9904-f0e01e65d711 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:20.892773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-651e5955-4fbd-4e59-9904-f0e01e65d711 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:20.895208 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-651e5955-4fbd-4e59-9904-f0e01e65d711 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:20.895693 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-651e5955-4fbd-4e59-9904-f0e01e65d711 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:20.896131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-651e5955-4fbd-4e59-9904-f0e01e65d711 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:20.896821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-651e5955-4fbd-4e59-9904-f0e01e65d711 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:20.897324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-651e5955-4fbd-4e59-9904-f0e01e65d711 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:20.897752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-651e5955-4fbd-4e59-9904-f0e01e65d711 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:21.013175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-65e346e3-a6d4-4bc4-979c-0a372ba63217 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:21.014117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-65e346e3-a6d4-4bc4-979c-0a372ba63217 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:21.020487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65e346e3-a6d4-4bc4-979c-0a372ba63217 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:21.021083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65e346e3-a6d4-4bc4-979c-0a372ba63217 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:21.021630 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65e346e3-a6d4-4bc4-979c-0a372ba63217 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:21.022367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65e346e3-a6d4-4bc4-979c-0a372ba63217 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:21.022910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65e346e3-a6d4-4bc4-979c-0a372ba63217 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:21.023336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65e346e3-a6d4-4bc4-979c-0a372ba63217 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:21.040464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-651e5955-4fbd-4e59-9904-f0e01e65d711 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:21.048711 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-651e5955-4fbd-4e59-9904-f0e01e65d711 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1751 microversion: 2.1 time: 0.164935 Aug 08 08:51:21.049392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 512/994] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:20 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:51:21.161917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-65e346e3-a6d4-4bc4-979c-0a372ba63217 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:21.170021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-65e346e3-a6d4-4bc4-979c-0a372ba63217 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1470 microversion: 2.1 time: 0.161641 Aug 08 08:51:21.170639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 483/995] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:21 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:51:21.828192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-64ce1bb4-300d-4305-a7f2-ed1632db0c63 req-8dbdeeeb-200e-4692-a52b-a4271c8b0648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357b07bc-cb7e-4b2d-bbca-40b82a7c4b80", "name": "network-vif-deleted", "tag": "f32faf20-c99f-4524-a735-4deff622b8e1"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:51:21.838532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-64ce1bb4-300d-4305-a7f2-ed1632db0c63 req-8dbdeeeb-200e-4692-a52b-a4271c8b0648 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:21.839489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-64ce1bb4-300d-4305-a7f2-ed1632db0c63 req-8dbdeeeb-200e-4692-a52b-a4271c8b0648 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:21.839929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-64ce1bb4-300d-4305-a7f2-ed1632db0c63 req-8dbdeeeb-200e-4692-a52b-a4271c8b0648 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:21.852160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-64ce1bb4-300d-4305-a7f2-ed1632db0c63 req-8dbdeeeb-200e-4692-a52b-a4271c8b0648 service nova] Creating event network-vif-deleted:f32faf20-c99f-4524-a735-4deff622b8e1 for instance 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 on hv-cinder-83697 Aug 08 08:51:21.858425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-64ce1bb4-300d-4305-a7f2-ed1632db0c63 req-8dbdeeeb-200e-4692-a52b-a4271c8b0648 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041852 Aug 08 08:51:21.859001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 513/996] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:51:22.071619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7e3b1422-ecfc-46f8-b7a3-2498c6a5d3f7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:22.072474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7e3b1422-ecfc-46f8-b7a3-2498c6a5d3f7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:22.079071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e3b1422-ecfc-46f8-b7a3-2498c6a5d3f7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:22.079565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e3b1422-ecfc-46f8-b7a3-2498c6a5d3f7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:22.083032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e3b1422-ecfc-46f8-b7a3-2498c6a5d3f7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:22.083032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e3b1422-ecfc-46f8-b7a3-2498c6a5d3f7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:22.083032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e3b1422-ecfc-46f8-b7a3-2498c6a5d3f7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:22.083032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e3b1422-ecfc-46f8-b7a3-2498c6a5d3f7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:22.193450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:22.194346 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:22.201591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:22.202618 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:22.203086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:22.203804 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:22.204464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:22.204950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:22.236473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7e3b1422-ecfc-46f8-b7a3-2498c6a5d3f7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:22.242580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:22.243123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:22.244081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:22.244769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lazy-loading 'fault' on Instance uuid 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:51:22.244890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7e3b1422-ecfc-46f8-b7a3-2498c6a5d3f7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.177304 Aug 08 08:51:22.245452 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 484/997] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:22.287730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445aaa7a942043bbac9aee5d06b3d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693983a63734f52890ae4bb41c1e915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:22.295607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4b6725fd-3186-4bda-9ceb-2bc1e334367e tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 200 len: 1305 microversion: 2.1 time: 0.107993 Aug 08 08:51:22.296166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 514/998] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:22 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:23.266887 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c81da9a4-7e39-4443-94bf-aa821bd46684 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:23.267471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c81da9a4-7e39-4443-94bf-aa821bd46684 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:23.273778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c81da9a4-7e39-4443-94bf-aa821bd46684 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:23.274287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c81da9a4-7e39-4443-94bf-aa821bd46684 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:23.274753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c81da9a4-7e39-4443-94bf-aa821bd46684 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:23.275633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c81da9a4-7e39-4443-94bf-aa821bd46684 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:23.276094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c81da9a4-7e39-4443-94bf-aa821bd46684 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:23.276546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c81da9a4-7e39-4443-94bf-aa821bd46684 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:23.316476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:23.317016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] [instance: 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:23.324058 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:23.324547 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:23.324980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:23.325707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:23.326162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:23.326586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:23.340069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] HTTP exception thrown: Instance 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 could not be found. Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Request method failure captured: Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 HTTP/1.1 Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M5N63knyvGfpnH8IzMa1OBZLGVZlvS-o2POMtOAt2n8JBv2ZUPGCtuJA9UhF35QsPmaLIq3TvguHDWTrrw5uJsF8_MlNBzuJcLWjATqQZlse0nEwwOk7URKKLK78x6t6u9WkntnB5GrzLBAgX2tdcBRguBRHCG3ay1H--lXF-Rrlok Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 2693983a63734f52890ae4bb41c1e915 Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-VolumesNegativeTest-1452040084 Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 08:51:23.341750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2693983a63734f52890ae4bb41c1e915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2693983a63734f52890ae4bb41c1e915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2693983a63734f52890ae4bb41c1e915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2693983a63734f52890ae4bb41c1e915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-VolumesNegativeTest-1452040084 Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 2693983a63734f52890ae4bb41c1e915 Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-VolumesNegativeTest-1452040084 Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-VolumesNegativeTest-1452040084-project Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 445aaa7a942043bbac9aee5d06b3d092 Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-VolumesNegativeTest-1452040084-project Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 could not be found. Aug 08 08:51:23.343213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '357b07bc-cb7e-4b2d-bbca-40b82a7c4b80'} Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 could not be found. Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:51:23.344097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 could not be found. Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 could not be found. Aug 08 08:51:23.345647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 08:51:23.347740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] Returning 404 to user: Instance 357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:51:23.347740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-113d2e4b-7c03-4e2d-8552-d8f620d56014 tempest-VolumesNegativeTest-1452040084 tempest-VolumesNegativeTest-1452040084-project] 10.222.0.33 "GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80" status: 404 len: 111 microversion: 2.1 time: 0.030627 Aug 08 08:51:23.347740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 515/999] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:23 2022] GET /compute/v2.1/servers/357b07bc-cb7e-4b2d-bbca-40b82a7c4b80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 08:51:23.426389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c81da9a4-7e39-4443-94bf-aa821bd46684 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:23.436869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c81da9a4-7e39-4443-94bf-aa821bd46684 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.173751 Aug 08 08:51:23.437477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 485/1000] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:24.458115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-41082f96-9e3a-4eee-8c06-5c07f4b5979a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:24.458694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-41082f96-9e3a-4eee-8c06-5c07f4b5979a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:24.465499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-41082f96-9e3a-4eee-8c06-5c07f4b5979a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:24.465983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-41082f96-9e3a-4eee-8c06-5c07f4b5979a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:24.466420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-41082f96-9e3a-4eee-8c06-5c07f4b5979a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:24.467112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-41082f96-9e3a-4eee-8c06-5c07f4b5979a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:24.467593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-41082f96-9e3a-4eee-8c06-5c07f4b5979a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:24.468019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-41082f96-9e3a-4eee-8c06-5c07f4b5979a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:24.614804 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-41082f96-9e3a-4eee-8c06-5c07f4b5979a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:24.623864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-41082f96-9e3a-4eee-8c06-5c07f4b5979a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.169557 Aug 08 08:51:24.624421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 516/1001] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:24 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:25.646056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-46272789-d912-4089-8213-0c44c4d5f436 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:25.646056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-46272789-d912-4089-8213-0c44c4d5f436 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:25.650389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:51:25.654500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46272789-d912-4089-8213-0c44c4d5f436 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:25.655171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46272789-d912-4089-8213-0c44c4d5f436 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:25.655609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46272789-d912-4089-8213-0c44c4d5f436 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:25.656337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46272789-d912-4089-8213-0c44c4d5f436 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:25.656807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46272789-d912-4089-8213-0c44c4d5f436 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:25.657541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46272789-d912-4089-8213-0c44c4d5f436 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:25.804852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-46272789-d912-4089-8213-0c44c4d5f436 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:25.813732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-46272789-d912-4089-8213-0c44c4d5f436 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.172272 Aug 08 08:51:25.814303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 486/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:26.839905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f808495c-38cb-44b0-a344-42586eba7eac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:26.840507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f808495c-38cb-44b0-a344-42586eba7eac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:26.847441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f808495c-38cb-44b0-a344-42586eba7eac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:26.847943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f808495c-38cb-44b0-a344-42586eba7eac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:26.848388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f808495c-38cb-44b0-a344-42586eba7eac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:26.849110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f808495c-38cb-44b0-a344-42586eba7eac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:26.849597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f808495c-38cb-44b0-a344-42586eba7eac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:26.850027 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f808495c-38cb-44b0-a344-42586eba7eac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:27.001880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f808495c-38cb-44b0-a344-42586eba7eac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:27.010604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f808495c-38cb-44b0-a344-42586eba7eac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.175590 Aug 08 08:51:27.011232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 517/1003] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:28.032128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-be1068d4-cfe9-40cf-bffa-8e9f34ff4e2a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:28.032721 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-be1068d4-cfe9-40cf-bffa-8e9f34ff4e2a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:28.038583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be1068d4-cfe9-40cf-bffa-8e9f34ff4e2a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:28.039066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be1068d4-cfe9-40cf-bffa-8e9f34ff4e2a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:28.039521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be1068d4-cfe9-40cf-bffa-8e9f34ff4e2a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:28.040956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be1068d4-cfe9-40cf-bffa-8e9f34ff4e2a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:28.041545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be1068d4-cfe9-40cf-bffa-8e9f34ff4e2a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:28.041974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be1068d4-cfe9-40cf-bffa-8e9f34ff4e2a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:28.183664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-be1068d4-cfe9-40cf-bffa-8e9f34ff4e2a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:28.185868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:51:28.192331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-be1068d4-cfe9-40cf-bffa-8e9f34ff4e2a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.164427 Aug 08 08:51:28.204146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 487/1004] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:28 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:29.213767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0b9f286e-c008-423f-8078-a3ffad522dbc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:29.214368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0b9f286e-c008-423f-8078-a3ffad522dbc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:29.216860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=44 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:51:29.221561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b9f286e-c008-423f-8078-a3ffad522dbc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:29.222048 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b9f286e-c008-423f-8078-a3ffad522dbc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:29.222489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b9f286e-c008-423f-8078-a3ffad522dbc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:29.223182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b9f286e-c008-423f-8078-a3ffad522dbc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:29.223642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b9f286e-c008-423f-8078-a3ffad522dbc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:29.224073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b9f286e-c008-423f-8078-a3ffad522dbc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:29.369495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0b9f286e-c008-423f-8078-a3ffad522dbc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:29.378265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0b9f286e-c008-423f-8078-a3ffad522dbc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.168378 Aug 08 08:51:29.378822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 518/1005] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:29 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:30.400324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f5c65e5b-c0b2-4f63-b814-5a2efe405236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:30.400941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f5c65e5b-c0b2-4f63-b814-5a2efe405236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:30.407666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5c65e5b-c0b2-4f63-b814-5a2efe405236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:30.408153 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5c65e5b-c0b2-4f63-b814-5a2efe405236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:30.408593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5c65e5b-c0b2-4f63-b814-5a2efe405236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:30.409315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5c65e5b-c0b2-4f63-b814-5a2efe405236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:30.409789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5c65e5b-c0b2-4f63-b814-5a2efe405236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:30.410207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5c65e5b-c0b2-4f63-b814-5a2efe405236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:30.683038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f5c65e5b-c0b2-4f63-b814-5a2efe405236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:30.693844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f5c65e5b-c0b2-4f63-b814-5a2efe405236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.298455 Aug 08 08:51:30.694410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 488/1006] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:30 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:31.715402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-86e35c2d-f5d0-4ef9-93fa-c30187ff1617 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:31.716014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-86e35c2d-f5d0-4ef9-93fa-c30187ff1617 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:31.722424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86e35c2d-f5d0-4ef9-93fa-c30187ff1617 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:31.722905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86e35c2d-f5d0-4ef9-93fa-c30187ff1617 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:31.723367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86e35c2d-f5d0-4ef9-93fa-c30187ff1617 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:31.724090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86e35c2d-f5d0-4ef9-93fa-c30187ff1617 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:31.724531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86e35c2d-f5d0-4ef9-93fa-c30187ff1617 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:31.724960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-86e35c2d-f5d0-4ef9-93fa-c30187ff1617 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:31.917847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-86e35c2d-f5d0-4ef9-93fa-c30187ff1617 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:31.925765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-86e35c2d-f5d0-4ef9-93fa-c30187ff1617 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.214317 Aug 08 08:51:31.926330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 519/1007] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:31 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:32.948053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1c44ae41-3828-4f52-bc89-fcdd465a269a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:32.948672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1c44ae41-3828-4f52-bc89-fcdd465a269a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:32.955129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c44ae41-3828-4f52-bc89-fcdd465a269a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:32.955689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c44ae41-3828-4f52-bc89-fcdd465a269a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:32.956049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c44ae41-3828-4f52-bc89-fcdd465a269a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:32.956740 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c44ae41-3828-4f52-bc89-fcdd465a269a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:32.957222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c44ae41-3828-4f52-bc89-fcdd465a269a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:32.957652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c44ae41-3828-4f52-bc89-fcdd465a269a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:33.096745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1c44ae41-3828-4f52-bc89-fcdd465a269a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:33.105473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1c44ae41-3828-4f52-bc89-fcdd465a269a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.161894 Aug 08 08:51:33.106038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 489/1008] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:34.127407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-47dcf4a1-e47f-42b4-b231-e2b605988311 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:34.128018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-47dcf4a1-e47f-42b4-b231-e2b605988311 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:34.134686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47dcf4a1-e47f-42b4-b231-e2b605988311 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:34.135158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47dcf4a1-e47f-42b4-b231-e2b605988311 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:34.135590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47dcf4a1-e47f-42b4-b231-e2b605988311 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:34.136271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47dcf4a1-e47f-42b4-b231-e2b605988311 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:34.136721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47dcf4a1-e47f-42b4-b231-e2b605988311 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:34.137196 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47dcf4a1-e47f-42b4-b231-e2b605988311 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:34.277271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-47dcf4a1-e47f-42b4-b231-e2b605988311 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:34.284039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-47dcf4a1-e47f-42b4-b231-e2b605988311 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.160460 Aug 08 08:51:34.284598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 520/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:35.305751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c58cffbf-a0ba-48b2-bb59-c573122ac4f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:35.307038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c58cffbf-a0ba-48b2-bb59-c573122ac4f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:35.313544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c58cffbf-a0ba-48b2-bb59-c573122ac4f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:35.314032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c58cffbf-a0ba-48b2-bb59-c573122ac4f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:35.314471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c58cffbf-a0ba-48b2-bb59-c573122ac4f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:35.315162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c58cffbf-a0ba-48b2-bb59-c573122ac4f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:35.315622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c58cffbf-a0ba-48b2-bb59-c573122ac4f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:35.316049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c58cffbf-a0ba-48b2-bb59-c573122ac4f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:35.460888 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c58cffbf-a0ba-48b2-bb59-c573122ac4f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:35.468815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c58cffbf-a0ba-48b2-bb59-c573122ac4f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.167499 Aug 08 08:51:35.469403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 490/1010] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:35 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:36.490479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-79bb5b41-ef06-4e46-a757-a3163bfd847b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:36.491090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-79bb5b41-ef06-4e46-a757-a3163bfd847b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:36.498062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bb5b41-ef06-4e46-a757-a3163bfd847b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:36.498543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bb5b41-ef06-4e46-a757-a3163bfd847b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:36.498974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bb5b41-ef06-4e46-a757-a3163bfd847b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:36.499660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bb5b41-ef06-4e46-a757-a3163bfd847b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:36.500122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bb5b41-ef06-4e46-a757-a3163bfd847b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:36.500548 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bb5b41-ef06-4e46-a757-a3163bfd847b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:36.515915 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:51:36.643438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-79bb5b41-ef06-4e46-a757-a3163bfd847b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:36.651611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-79bb5b41-ef06-4e46-a757-a3163bfd847b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.164982 Aug 08 08:51:36.652163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 521/1011] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:37.671744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1f1bcf42-f277-40dc-8373-33a7ffb6ce17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:37.672252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1f1bcf42-f277-40dc-8373-33a7ffb6ce17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:37.678591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f1bcf42-f277-40dc-8373-33a7ffb6ce17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:37.679075 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f1bcf42-f277-40dc-8373-33a7ffb6ce17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:37.679513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f1bcf42-f277-40dc-8373-33a7ffb6ce17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:37.680231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f1bcf42-f277-40dc-8373-33a7ffb6ce17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:37.680774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f1bcf42-f277-40dc-8373-33a7ffb6ce17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:37.681230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f1bcf42-f277-40dc-8373-33a7ffb6ce17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:37.823836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1f1bcf42-f277-40dc-8373-33a7ffb6ce17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:37.831663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1f1bcf42-f277-40dc-8373-33a7ffb6ce17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.163891 Aug 08 08:51:37.835229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 491/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:37 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:38.853591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3d7f2783-19c0-463b-bcc6-2a842923e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:38.854203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3d7f2783-19c0-463b-bcc6-2a842923e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:38.860785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d7f2783-19c0-463b-bcc6-2a842923e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:38.861300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d7f2783-19c0-463b-bcc6-2a842923e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:38.861736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d7f2783-19c0-463b-bcc6-2a842923e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:38.862417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d7f2783-19c0-463b-bcc6-2a842923e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:38.862945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d7f2783-19c0-463b-bcc6-2a842923e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:38.863370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d7f2783-19c0-463b-bcc6-2a842923e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:39.004821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3d7f2783-19c0-463b-bcc6-2a842923e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:39.013417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3d7f2783-19c0-463b-bcc6-2a842923e365 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.163794 Aug 08 08:51:39.013968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 522/1013] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:38 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:40.034819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8362c399-48f9-4a65-bc25-b8d8ae3166d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:40.035412 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8362c399-48f9-4a65-bc25-b8d8ae3166d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:40.042555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8362c399-48f9-4a65-bc25-b8d8ae3166d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:40.043048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8362c399-48f9-4a65-bc25-b8d8ae3166d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:40.043490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8362c399-48f9-4a65-bc25-b8d8ae3166d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:40.044242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8362c399-48f9-4a65-bc25-b8d8ae3166d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:40.044701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8362c399-48f9-4a65-bc25-b8d8ae3166d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:40.045130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8362c399-48f9-4a65-bc25-b8d8ae3166d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:40.187578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8362c399-48f9-4a65-bc25-b8d8ae3166d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:40.195330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8362c399-48f9-4a65-bc25-b8d8ae3166d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.164481 Aug 08 08:51:40.195926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 492/1014] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:40 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:41.215859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0b4f326d-f682-44af-a3d0-73c0d3f027c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:41.216475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0b4f326d-f682-44af-a3d0-73c0d3f027c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:41.222914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b4f326d-f682-44af-a3d0-73c0d3f027c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:41.223396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b4f326d-f682-44af-a3d0-73c0d3f027c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:41.223836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b4f326d-f682-44af-a3d0-73c0d3f027c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:41.224542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b4f326d-f682-44af-a3d0-73c0d3f027c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:41.225003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b4f326d-f682-44af-a3d0-73c0d3f027c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:41.225468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b4f326d-f682-44af-a3d0-73c0d3f027c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:41.367199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0b4f326d-f682-44af-a3d0-73c0d3f027c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:41.375691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0b4f326d-f682-44af-a3d0-73c0d3f027c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.163737 Aug 08 08:51:41.376250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 523/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:41 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:42.397017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-01fb63a1-ee91-44f0-9d75-2bc9179ad489 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:42.397667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-01fb63a1-ee91-44f0-9d75-2bc9179ad489 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:42.404684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01fb63a1-ee91-44f0-9d75-2bc9179ad489 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:42.405192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01fb63a1-ee91-44f0-9d75-2bc9179ad489 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:42.405629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01fb63a1-ee91-44f0-9d75-2bc9179ad489 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:42.406310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01fb63a1-ee91-44f0-9d75-2bc9179ad489 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:42.406761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01fb63a1-ee91-44f0-9d75-2bc9179ad489 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:42.407184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01fb63a1-ee91-44f0-9d75-2bc9179ad489 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:42.545402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-01fb63a1-ee91-44f0-9d75-2bc9179ad489 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:42.553172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-01fb63a1-ee91-44f0-9d75-2bc9179ad489 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.160020 Aug 08 08:51:42.553732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 493/1016] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:42 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:43.575302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ce080f2a-8c4b-49af-ac89-baad9d19c68a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:43.575934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ce080f2a-8c4b-49af-ac89-baad9d19c68a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:43.583709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce080f2a-8c4b-49af-ac89-baad9d19c68a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:43.584192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce080f2a-8c4b-49af-ac89-baad9d19c68a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:43.584625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce080f2a-8c4b-49af-ac89-baad9d19c68a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:43.585341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce080f2a-8c4b-49af-ac89-baad9d19c68a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:43.585796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce080f2a-8c4b-49af-ac89-baad9d19c68a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:43.586218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ce080f2a-8c4b-49af-ac89-baad9d19c68a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:43.730816 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ce080f2a-8c4b-49af-ac89-baad9d19c68a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:43.738764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ce080f2a-8c4b-49af-ac89-baad9d19c68a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.167936 Aug 08 08:51:43.739332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 524/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:44.760280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5f5c0bae-164c-4c04-8536-be119a0c47e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:44.760824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5f5c0bae-164c-4c04-8536-be119a0c47e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:44.767283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f5c0bae-164c-4c04-8536-be119a0c47e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:44.767774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f5c0bae-164c-4c04-8536-be119a0c47e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:44.768215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f5c0bae-164c-4c04-8536-be119a0c47e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:44.768905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f5c0bae-164c-4c04-8536-be119a0c47e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:44.769400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f5c0bae-164c-4c04-8536-be119a0c47e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:44.769833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f5c0bae-164c-4c04-8536-be119a0c47e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:44.910151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5f5c0bae-164c-4c04-8536-be119a0c47e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:44.918779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5f5c0bae-164c-4c04-8536-be119a0c47e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.162892 Aug 08 08:51:44.919344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 494/1018] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:45.939510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6d949859-8f1f-4fcd-94e2-9aacc2812357 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:45.940247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6d949859-8f1f-4fcd-94e2-9aacc2812357 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:45.947067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d949859-8f1f-4fcd-94e2-9aacc2812357 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:45.947616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d949859-8f1f-4fcd-94e2-9aacc2812357 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:45.948051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d949859-8f1f-4fcd-94e2-9aacc2812357 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:45.948736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d949859-8f1f-4fcd-94e2-9aacc2812357 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:45.949207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d949859-8f1f-4fcd-94e2-9aacc2812357 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:45.949803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d949859-8f1f-4fcd-94e2-9aacc2812357 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:46.092571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6d949859-8f1f-4fcd-94e2-9aacc2812357 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:46.100526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6d949859-8f1f-4fcd-94e2-9aacc2812357 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.164778 Aug 08 08:51:46.101081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 525/1019] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:47.122411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d9ffbd53-30a7-413f-8bd7-87af5aacd4b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:47.123015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d9ffbd53-30a7-413f-8bd7-87af5aacd4b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:47.129615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9ffbd53-30a7-413f-8bd7-87af5aacd4b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:47.130102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9ffbd53-30a7-413f-8bd7-87af5aacd4b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:47.130539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9ffbd53-30a7-413f-8bd7-87af5aacd4b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:47.131228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9ffbd53-30a7-413f-8bd7-87af5aacd4b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:47.131714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9ffbd53-30a7-413f-8bd7-87af5aacd4b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:47.132142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9ffbd53-30a7-413f-8bd7-87af5aacd4b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:47.273340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d9ffbd53-30a7-413f-8bd7-87af5aacd4b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:47.281567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d9ffbd53-30a7-413f-8bd7-87af5aacd4b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.163465 Aug 08 08:51:47.282135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 495/1020] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:48.303413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-26196dab-a23c-470f-bff7-7f8cdc6a6f20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:48.303996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-26196dab-a23c-470f-bff7-7f8cdc6a6f20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:48.310446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26196dab-a23c-470f-bff7-7f8cdc6a6f20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:48.310929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26196dab-a23c-470f-bff7-7f8cdc6a6f20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:48.311364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26196dab-a23c-470f-bff7-7f8cdc6a6f20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:48.312059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26196dab-a23c-470f-bff7-7f8cdc6a6f20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:48.312554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26196dab-a23c-470f-bff7-7f8cdc6a6f20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:48.312969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26196dab-a23c-470f-bff7-7f8cdc6a6f20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:48.538448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-26196dab-a23c-470f-bff7-7f8cdc6a6f20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:48.547125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-26196dab-a23c-470f-bff7-7f8cdc6a6f20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1756 microversion: 2.1 time: 0.247773 Aug 08 08:51:48.547690 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 526/1021] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1756 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:49.568435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-89b71f43-a9bc-4b22-a3c6-5063ba4ce4ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:49.568980 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-89b71f43-a9bc-4b22-a3c6-5063ba4ce4ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:49.576271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b71f43-a9bc-4b22-a3c6-5063ba4ce4ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:49.576750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b71f43-a9bc-4b22-a3c6-5063ba4ce4ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:49.577207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b71f43-a9bc-4b22-a3c6-5063ba4ce4ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:49.577896 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b71f43-a9bc-4b22-a3c6-5063ba4ce4ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:49.578355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b71f43-a9bc-4b22-a3c6-5063ba4ce4ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:49.578779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b71f43-a9bc-4b22-a3c6-5063ba4ce4ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:49.721092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-89b71f43-a9bc-4b22-a3c6-5063ba4ce4ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:51:49.729578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-89b71f43-a9bc-4b22-a3c6-5063ba4ce4ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1759 microversion: 2.1 time: 0.165098 Aug 08 08:51:49.730403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 496/1022] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:51:51.979757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 08:51:51.980648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 08:51:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 08:51:59.586373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c0075e4d-ddad-42c0-915c-75b028242620 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:59.587601 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c0075e4d-ddad-42c0-915c-75b028242620 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:59.588743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-17c84ea5-23b6-4888-bcfd-0bbab1081332 req-8bb2b329-567a-47fb-b533-163c2f9865b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ee0e71-bef8-4c22-ac1f-1b08e564b14d", "tag": "59038d45-a91c-43ab-a6da-241301aba11f"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:51:59.589935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=17 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:51:59.590753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=33 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:51:59.595402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=21 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:51:59.596218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0075e4d-ddad-42c0-915c-75b028242620 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:59.602141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0075e4d-ddad-42c0-915c-75b028242620 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:59.602141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0075e4d-ddad-42c0-915c-75b028242620 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:59.602141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0075e4d-ddad-42c0-915c-75b028242620 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:59.602141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0075e4d-ddad-42c0-915c-75b028242620 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:59.603001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0075e4d-ddad-42c0-915c-75b028242620 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:59.603119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-17c84ea5-23b6-4888-bcfd-0bbab1081332 req-8bb2b329-567a-47fb-b533-163c2f9865b8 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:59.603119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-17c84ea5-23b6-4888-bcfd-0bbab1081332 req-8bb2b329-567a-47fb-b533-163c2f9865b8 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:59.603119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-17c84ea5-23b6-4888-bcfd-0bbab1081332 req-8bb2b329-567a-47fb-b533-163c2f9865b8 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:59.613244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-17c84ea5-23b6-4888-bcfd-0bbab1081332 req-8bb2b329-567a-47fb-b533-163c2f9865b8 service nova] Creating event network-changed:59038d45-a91c-43ab-a6da-241301aba11f for instance e4ee0e71-bef8-4c22-ac1f-1b08e564b14d on hv-cinder-83697 Aug 08 08:51:59.620054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-17c84ea5-23b6-4888-bcfd-0bbab1081332 req-8bb2b329-567a-47fb-b533-163c2f9865b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035087 Aug 08 08:51:59.620829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 497/1023] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:51:59.633302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c0075e4d-ddad-42c0-915c-75b028242620 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 08:51:59.955341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c0075e4d-ddad-42c0-915c-75b028242620 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 204 len: 0 microversion: 2.1 time: 0.372816 Aug 08 08:51:59.968383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 527/1024] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 08:51:59 2022] DELETE /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 08:51:59.968737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-48300857-a560-4f6d-9298-9ccf6655001d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:51:59.968737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-48300857-a560-4f6d-9298-9ccf6655001d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:51:59.972573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48300857-a560-4f6d-9298-9ccf6655001d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:59.973319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48300857-a560-4f6d-9298-9ccf6655001d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:59.973771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48300857-a560-4f6d-9298-9ccf6655001d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:51:59.974477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48300857-a560-4f6d-9298-9ccf6655001d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:51:59.975005 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48300857-a560-4f6d-9298-9ccf6655001d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:51:59.975445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48300857-a560-4f6d-9298-9ccf6655001d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:00.145377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-48300857-a560-4f6d-9298-9ccf6655001d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:00.153240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-48300857-a560-4f6d-9298-9ccf6655001d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1575 microversion: 2.1 time: 0.192639 Aug 08 08:52:00.153848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 498/1025] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:51:59 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:01.175540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-30711b7c-6f43-4222-a92b-00513368fa73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:01.176355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-30711b7c-6f43-4222-a92b-00513368fa73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:01.183640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30711b7c-6f43-4222-a92b-00513368fa73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:01.184130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30711b7c-6f43-4222-a92b-00513368fa73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:01.184569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30711b7c-6f43-4222-a92b-00513368fa73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:01.185290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30711b7c-6f43-4222-a92b-00513368fa73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:01.185751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30711b7c-6f43-4222-a92b-00513368fa73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:01.186439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-30711b7c-6f43-4222-a92b-00513368fa73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:01.330542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-30711b7c-6f43-4222-a92b-00513368fa73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:01.339063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-30711b7c-6f43-4222-a92b-00513368fa73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1575 microversion: 2.1 time: 0.167830 Aug 08 08:52:01.349332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 528/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:01 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:02.146539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-7963c8e8-105f-4a2e-b371-ca4ddc65b3df req-bd2b761a-418c-4557-a392-f09b17db2434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ee0e71-bef8-4c22-ac1f-1b08e564b14d", "name": "network-vif-deleted", "tag": "59038d45-a91c-43ab-a6da-241301aba11f"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:52:02.156788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-7963c8e8-105f-4a2e-b371-ca4ddc65b3df req-bd2b761a-418c-4557-a392-f09b17db2434 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:02.160331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-7963c8e8-105f-4a2e-b371-ca4ddc65b3df req-bd2b761a-418c-4557-a392-f09b17db2434 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:02.160331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-7963c8e8-105f-4a2e-b371-ca4ddc65b3df req-bd2b761a-418c-4557-a392-f09b17db2434 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:02.161450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=64 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:52:02.169168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-7963c8e8-105f-4a2e-b371-ca4ddc65b3df req-bd2b761a-418c-4557-a392-f09b17db2434 service nova] Creating event network-vif-deleted:59038d45-a91c-43ab-a6da-241301aba11f for instance e4ee0e71-bef8-4c22-ac1f-1b08e564b14d on hv-cinder-83697 Aug 08 08:52:02.174300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-7963c8e8-105f-4a2e-b371-ca4ddc65b3df req-bd2b761a-418c-4557-a392-f09b17db2434 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031430 Aug 08 08:52:02.174896 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 499/1027] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:02.361695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4f6df44a-36b5-478a-b971-3717c76fdd54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:02.367634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4f6df44a-36b5-478a-b971-3717c76fdd54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:02.368608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6df44a-36b5-478a-b971-3717c76fdd54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:02.369097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6df44a-36b5-478a-b971-3717c76fdd54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:02.369565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6df44a-36b5-478a-b971-3717c76fdd54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:02.370260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6df44a-36b5-478a-b971-3717c76fdd54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:02.370717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6df44a-36b5-478a-b971-3717c76fdd54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:02.371141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6df44a-36b5-478a-b971-3717c76fdd54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:02.437833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4f6df44a-36b5-478a-b971-3717c76fdd54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:02.445668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4f6df44a-36b5-478a-b971-3717c76fdd54 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.087779 Aug 08 08:52:02.446735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 529/1028] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:02 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:03.468456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e49cba75-496b-42c6-a9ba-9aecdf8dc7b2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:03.469169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e49cba75-496b-42c6-a9ba-9aecdf8dc7b2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:03.475751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e49cba75-496b-42c6-a9ba-9aecdf8dc7b2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:03.476239 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e49cba75-496b-42c6-a9ba-9aecdf8dc7b2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:03.476677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e49cba75-496b-42c6-a9ba-9aecdf8dc7b2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:03.478083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e49cba75-496b-42c6-a9ba-9aecdf8dc7b2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:03.478596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e49cba75-496b-42c6-a9ba-9aecdf8dc7b2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:03.479028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e49cba75-496b-42c6-a9ba-9aecdf8dc7b2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:03.541244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e49cba75-496b-42c6-a9ba-9aecdf8dc7b2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:03.548975 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e49cba75-496b-42c6-a9ba-9aecdf8dc7b2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084967 Aug 08 08:52:03.549594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 500/1029] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:03 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:04.569971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a6338301-19f6-4005-83b2-5756d6b68a2a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:04.570588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a6338301-19f6-4005-83b2-5756d6b68a2a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:04.577952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6338301-19f6-4005-83b2-5756d6b68a2a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:04.578446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6338301-19f6-4005-83b2-5756d6b68a2a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:04.578892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6338301-19f6-4005-83b2-5756d6b68a2a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:04.579588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6338301-19f6-4005-83b2-5756d6b68a2a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:04.580051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6338301-19f6-4005-83b2-5756d6b68a2a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:04.580481 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6338301-19f6-4005-83b2-5756d6b68a2a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:04.646315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a6338301-19f6-4005-83b2-5756d6b68a2a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:04.654031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a6338301-19f6-4005-83b2-5756d6b68a2a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.087867 Aug 08 08:52:04.654589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 530/1030] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:04 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:05.674179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7a376945-1c04-4922-bf7d-d5ece1d4495e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:05.674862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7a376945-1c04-4922-bf7d-d5ece1d4495e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:05.682250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a376945-1c04-4922-bf7d-d5ece1d4495e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:05.682838 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a376945-1c04-4922-bf7d-d5ece1d4495e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:05.683450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a376945-1c04-4922-bf7d-d5ece1d4495e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:05.684196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a376945-1c04-4922-bf7d-d5ece1d4495e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:05.684658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a376945-1c04-4922-bf7d-d5ece1d4495e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:05.685091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a376945-1c04-4922-bf7d-d5ece1d4495e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:05.746623 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7a376945-1c04-4922-bf7d-d5ece1d4495e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:05.754018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7a376945-1c04-4922-bf7d-d5ece1d4495e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083696 Aug 08 08:52:05.754574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 501/1031] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:05 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:06.777210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2fe43909-c834-4895-9c1e-65afde5ef81d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:06.777790 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2fe43909-c834-4895-9c1e-65afde5ef81d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:06.784215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe43909-c834-4895-9c1e-65afde5ef81d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:06.784711 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe43909-c834-4895-9c1e-65afde5ef81d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:06.785163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe43909-c834-4895-9c1e-65afde5ef81d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:06.785892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe43909-c834-4895-9c1e-65afde5ef81d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:06.786353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe43909-c834-4895-9c1e-65afde5ef81d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:06.786786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fe43909-c834-4895-9c1e-65afde5ef81d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:06.851482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2fe43909-c834-4895-9c1e-65afde5ef81d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:06.860066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2fe43909-c834-4895-9c1e-65afde5ef81d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.088143 Aug 08 08:52:06.860625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 531/1032] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:06 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:07.881017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8f6f0829-d85f-461b-a014-6ebaa19c7b89 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:07.881674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8f6f0829-d85f-461b-a014-6ebaa19c7b89 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:07.888498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f6f0829-d85f-461b-a014-6ebaa19c7b89 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:07.888981 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f6f0829-d85f-461b-a014-6ebaa19c7b89 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:07.889439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f6f0829-d85f-461b-a014-6ebaa19c7b89 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:07.890121 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f6f0829-d85f-461b-a014-6ebaa19c7b89 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:07.890572 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f6f0829-d85f-461b-a014-6ebaa19c7b89 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:07.890991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f6f0829-d85f-461b-a014-6ebaa19c7b89 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:07.952934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8f6f0829-d85f-461b-a014-6ebaa19c7b89 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:07.960594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8f6f0829-d85f-461b-a014-6ebaa19c7b89 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083352 Aug 08 08:52:07.961155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 502/1033] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:07 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:08.981950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f795e86c-40c5-4a71-9282-89a822d33ae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:08.982499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f795e86c-40c5-4a71-9282-89a822d33ae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:08.988813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f795e86c-40c5-4a71-9282-89a822d33ae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:08.989325 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f795e86c-40c5-4a71-9282-89a822d33ae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:08.989767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f795e86c-40c5-4a71-9282-89a822d33ae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:08.990451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f795e86c-40c5-4a71-9282-89a822d33ae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:08.990901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f795e86c-40c5-4a71-9282-89a822d33ae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:08.991326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f795e86c-40c5-4a71-9282-89a822d33ae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:09.055173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f795e86c-40c5-4a71-9282-89a822d33ae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:09.063389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f795e86c-40c5-4a71-9282-89a822d33ae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085656 Aug 08 08:52:09.063938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 532/1034] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:08 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:10.083977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-64f5d58f-3469-4be3-a255-9247ae7ad81f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:10.084521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-64f5d58f-3469-4be3-a255-9247ae7ad81f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:10.091602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f5d58f-3469-4be3-a255-9247ae7ad81f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:10.092085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f5d58f-3469-4be3-a255-9247ae7ad81f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:10.092521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f5d58f-3469-4be3-a255-9247ae7ad81f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:10.093229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f5d58f-3469-4be3-a255-9247ae7ad81f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:10.093689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f5d58f-3469-4be3-a255-9247ae7ad81f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:10.094111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64f5d58f-3469-4be3-a255-9247ae7ad81f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:10.156922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-64f5d58f-3469-4be3-a255-9247ae7ad81f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:10.164275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-64f5d58f-3469-4be3-a255-9247ae7ad81f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084302 Aug 08 08:52:10.164938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 503/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:10 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:11.184569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-02384d4b-bad7-43b6-98d6-6791b1095f1a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:11.185211 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-02384d4b-bad7-43b6-98d6-6791b1095f1a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:11.191648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-02384d4b-bad7-43b6-98d6-6791b1095f1a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:11.196055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-02384d4b-bad7-43b6-98d6-6791b1095f1a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:11.196055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-02384d4b-bad7-43b6-98d6-6791b1095f1a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:11.196055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-02384d4b-bad7-43b6-98d6-6791b1095f1a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:11.196055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-02384d4b-bad7-43b6-98d6-6791b1095f1a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:11.196456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-02384d4b-bad7-43b6-98d6-6791b1095f1a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:11.255939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-02384d4b-bad7-43b6-98d6-6791b1095f1a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:11.263817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-02384d4b-bad7-43b6-98d6-6791b1095f1a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083116 Aug 08 08:52:11.264373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 533/1036] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:11 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:12.284730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e78f4040-8e5c-487a-9ee5-cd54719c90aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:12.285395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e78f4040-8e5c-487a-9ee5-cd54719c90aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:12.292447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e78f4040-8e5c-487a-9ee5-cd54719c90aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:12.292927 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e78f4040-8e5c-487a-9ee5-cd54719c90aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:12.293387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e78f4040-8e5c-487a-9ee5-cd54719c90aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:12.294072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e78f4040-8e5c-487a-9ee5-cd54719c90aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:12.294529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e78f4040-8e5c-487a-9ee5-cd54719c90aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:12.294953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e78f4040-8e5c-487a-9ee5-cd54719c90aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:12.358174 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e78f4040-8e5c-487a-9ee5-cd54719c90aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:12.365668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e78f4040-8e5c-487a-9ee5-cd54719c90aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084740 Aug 08 08:52:12.366224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 504/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:12 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:13.386926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-72d740e2-52ba-4711-85f1-00da3873a2ec tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:13.387538 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-72d740e2-52ba-4711-85f1-00da3873a2ec tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:13.393891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72d740e2-52ba-4711-85f1-00da3873a2ec tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:13.394374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72d740e2-52ba-4711-85f1-00da3873a2ec tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:13.394809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72d740e2-52ba-4711-85f1-00da3873a2ec tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:13.395501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72d740e2-52ba-4711-85f1-00da3873a2ec tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:13.395956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72d740e2-52ba-4711-85f1-00da3873a2ec tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:13.396381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72d740e2-52ba-4711-85f1-00da3873a2ec tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:13.462558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-72d740e2-52ba-4711-85f1-00da3873a2ec tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:13.470063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-72d740e2-52ba-4711-85f1-00da3873a2ec tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.087014 Aug 08 08:52:13.470625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 534/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:13 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:14.491676 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4c42ada1-c5d3-4f92-a572-c4e9f97b860d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:14.492235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4c42ada1-c5d3-4f92-a572-c4e9f97b860d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:14.499205 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c42ada1-c5d3-4f92-a572-c4e9f97b860d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:14.499689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c42ada1-c5d3-4f92-a572-c4e9f97b860d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:14.500127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c42ada1-c5d3-4f92-a572-c4e9f97b860d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:14.500811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c42ada1-c5d3-4f92-a572-c4e9f97b860d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:14.501292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c42ada1-c5d3-4f92-a572-c4e9f97b860d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:14.501750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c42ada1-c5d3-4f92-a572-c4e9f97b860d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:14.562723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4c42ada1-c5d3-4f92-a572-c4e9f97b860d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:14.570118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4c42ada1-c5d3-4f92-a572-c4e9f97b860d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082407 Aug 08 08:52:14.570686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 505/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:14 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:15.591801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-25c95c99-73e7-4528-9ce4-59690463f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:15.592416 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-25c95c99-73e7-4528-9ce4-59690463f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:15.599072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25c95c99-73e7-4528-9ce4-59690463f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:15.599560 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25c95c99-73e7-4528-9ce4-59690463f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:15.600001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25c95c99-73e7-4528-9ce4-59690463f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:15.600694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25c95c99-73e7-4528-9ce4-59690463f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:15.601172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25c95c99-73e7-4528-9ce4-59690463f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:15.601609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-25c95c99-73e7-4528-9ce4-59690463f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:15.664915 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-25c95c99-73e7-4528-9ce4-59690463f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:15.672419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-25c95c99-73e7-4528-9ce4-59690463f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084448 Aug 08 08:52:15.672980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 535/1040] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:15 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:16.693669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-13ba2e3d-4435-4f5d-a304-a69c5316d6ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:16.694227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-13ba2e3d-4435-4f5d-a304-a69c5316d6ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:16.700786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ba2e3d-4435-4f5d-a304-a69c5316d6ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:16.701288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ba2e3d-4435-4f5d-a304-a69c5316d6ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:16.701783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ba2e3d-4435-4f5d-a304-a69c5316d6ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:16.702408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ba2e3d-4435-4f5d-a304-a69c5316d6ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:16.702860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ba2e3d-4435-4f5d-a304-a69c5316d6ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:16.703281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ba2e3d-4435-4f5d-a304-a69c5316d6ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:16.763528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-13ba2e3d-4435-4f5d-a304-a69c5316d6ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:16.770905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-13ba2e3d-4435-4f5d-a304-a69c5316d6ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081175 Aug 08 08:52:16.771453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 506/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:16 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:17.791862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-58932c4c-952c-48ec-8ca0-a4045f7bbcc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:17.792474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-58932c4c-952c-48ec-8ca0-a4045f7bbcc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:17.799082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58932c4c-952c-48ec-8ca0-a4045f7bbcc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:17.799568 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58932c4c-952c-48ec-8ca0-a4045f7bbcc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:17.800002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58932c4c-952c-48ec-8ca0-a4045f7bbcc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:17.800684 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58932c4c-952c-48ec-8ca0-a4045f7bbcc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:17.801154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58932c4c-952c-48ec-8ca0-a4045f7bbcc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:17.801583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58932c4c-952c-48ec-8ca0-a4045f7bbcc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:17.865491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-58932c4c-952c-48ec-8ca0-a4045f7bbcc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:17.873340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-58932c4c-952c-48ec-8ca0-a4045f7bbcc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085924 Aug 08 08:52:17.873898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 536/1042] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:17 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:18.894356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-642c7a03-11da-4c6c-84d7-0530c80e5e30 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:18.894969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-642c7a03-11da-4c6c-84d7-0530c80e5e30 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:18.901749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-642c7a03-11da-4c6c-84d7-0530c80e5e30 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:18.902244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-642c7a03-11da-4c6c-84d7-0530c80e5e30 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:18.902688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-642c7a03-11da-4c6c-84d7-0530c80e5e30 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:18.903384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-642c7a03-11da-4c6c-84d7-0530c80e5e30 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:18.903844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-642c7a03-11da-4c6c-84d7-0530c80e5e30 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:18.904276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-642c7a03-11da-4c6c-84d7-0530c80e5e30 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:18.964593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-642c7a03-11da-4c6c-84d7-0530c80e5e30 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:18.972275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-642c7a03-11da-4c6c-84d7-0530c80e5e30 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081825 Aug 08 08:52:18.972835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 507/1043] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:18 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:19.994268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ba563d55-e72d-4570-80e0-98191238a563 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:19.994824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ba563d55-e72d-4570-80e0-98191238a563 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:20.001135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba563d55-e72d-4570-80e0-98191238a563 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:20.001659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba563d55-e72d-4570-80e0-98191238a563 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:20.002107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba563d55-e72d-4570-80e0-98191238a563 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:20.002803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba563d55-e72d-4570-80e0-98191238a563 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:20.003267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba563d55-e72d-4570-80e0-98191238a563 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:20.003698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba563d55-e72d-4570-80e0-98191238a563 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:20.093895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ba563d55-e72d-4570-80e0-98191238a563 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:20.101340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ba563d55-e72d-4570-80e0-98191238a563 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.111518 Aug 08 08:52:20.102057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 537/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:19 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:21.122409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-575558e5-3744-4630-a8f0-4df9075dd85c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:21.123004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-575558e5-3744-4630-a8f0-4df9075dd85c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:21.129408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-575558e5-3744-4630-a8f0-4df9075dd85c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:21.129891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-575558e5-3744-4630-a8f0-4df9075dd85c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:21.130329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-575558e5-3744-4630-a8f0-4df9075dd85c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:21.131016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-575558e5-3744-4630-a8f0-4df9075dd85c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:21.131465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-575558e5-3744-4630-a8f0-4df9075dd85c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:21.131893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-575558e5-3744-4630-a8f0-4df9075dd85c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:21.194871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-575558e5-3744-4630-a8f0-4df9075dd85c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:21.202937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-575558e5-3744-4630-a8f0-4df9075dd85c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084563 Aug 08 08:52:21.203497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 508/1045] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:21 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:22.223780 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-45d6d898-3273-48d4-a639-f4daf564f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:22.224391 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-45d6d898-3273-48d4-a639-f4daf564f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:22.231460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45d6d898-3273-48d4-a639-f4daf564f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:22.231945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45d6d898-3273-48d4-a639-f4daf564f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:22.232381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45d6d898-3273-48d4-a639-f4daf564f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:22.241039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45d6d898-3273-48d4-a639-f4daf564f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:22.241039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45d6d898-3273-48d4-a639-f4daf564f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:22.241039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45d6d898-3273-48d4-a639-f4daf564f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:22.298243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-45d6d898-3273-48d4-a639-f4daf564f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:22.305817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-45d6d898-3273-48d4-a639-f4daf564f25a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086019 Aug 08 08:52:22.306369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 538/1046] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:22 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:22.766465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0c1a9c09-fc08-4bda-8b26-720b9e6b2f80 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-679055896"}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:52:22.767022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0c1a9c09-fc08-4bda-8b26-720b9e6b2f80 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:22.775979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c09-fc08-4bda-8b26-720b9e6b2f80 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:22.776466 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c09-fc08-4bda-8b26-720b9e6b2f80 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:22.776908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c09-fc08-4bda-8b26-720b9e6b2f80 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:22.777631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c09-fc08-4bda-8b26-720b9e6b2f80 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:22.778086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c09-fc08-4bda-8b26-720b9e6b2f80 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:22.778510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c09-fc08-4bda-8b26-720b9e6b2f80 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:22.901139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.network.security_group_api [None req-0c1a9c09-fc08-4bda-8b26-720b9e6b2f80 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Removing security group a770d978-24e4-4252-953c-84e0381e5405 from port 19d95122-9b77-4b3d-adf8-fcfd43a61168 Aug 08 08:52:23.282519 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0c1a9c09-fc08-4bda-8b26-720b9e6b2f80 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "POST /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/action" status: 202 len: 0 microversion: 2.1 time: 0.519887 Aug 08 08:52:23.289322 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 509/1047] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:52:22 2022] POST /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:52:23.326604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-697ace56-d34b-4775-bfc0-4ee9e6b9abbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:23.327827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-697ace56-d34b-4775-bfc0-4ee9e6b9abbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:23.335344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-697ace56-d34b-4775-bfc0-4ee9e6b9abbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:23.338358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-697ace56-d34b-4775-bfc0-4ee9e6b9abbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:23.341600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-697ace56-d34b-4775-bfc0-4ee9e6b9abbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:23.342481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-697ace56-d34b-4775-bfc0-4ee9e6b9abbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:23.343646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-697ace56-d34b-4775-bfc0-4ee9e6b9abbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:23.344725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-697ace56-d34b-4775-bfc0-4ee9e6b9abbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:23.421878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-3d5ff86a-55f5-49c1-b60e-ea70bdd5ca97 req-8dd1dafa-98fd-464f-91c0-9ac704a64432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83365b2d-9f2c-4966-bdb6-789059348c37", "tag": "19d95122-9b77-4b3d-adf8-fcfd43a61168"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:52:23.436526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-3d5ff86a-55f5-49c1-b60e-ea70bdd5ca97 req-8dd1dafa-98fd-464f-91c0-9ac704a64432 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:23.437392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-3d5ff86a-55f5-49c1-b60e-ea70bdd5ca97 req-8dd1dafa-98fd-464f-91c0-9ac704a64432 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:23.438066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-3d5ff86a-55f5-49c1-b60e-ea70bdd5ca97 req-8dd1dafa-98fd-464f-91c0-9ac704a64432 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:23.454921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-697ace56-d34b-4775-bfc0-4ee9e6b9abbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:23.465686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-697ace56-d34b-4775-bfc0-4ee9e6b9abbb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.140558 Aug 08 08:52:23.466680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-3d5ff86a-55f5-49c1-b60e-ea70bdd5ca97 req-8dd1dafa-98fd-464f-91c0-9ac704a64432 service nova] Creating event network-changed:19d95122-9b77-4b3d-adf8-fcfd43a61168 for instance 83365b2d-9f2c-4966-bdb6-789059348c37 on hv-cinder-83697 Aug 08 08:52:23.469488 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 510/1048] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:23 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:52:23.475237 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-3d5ff86a-55f5-49c1-b60e-ea70bdd5ca97 req-8dd1dafa-98fd-464f-91c0-9ac704a64432 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186347 Aug 08 08:52:23.478742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 539/1049] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:24.487829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0e0d517f-3b2e-4f15-853c-6d4a1e85e69b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:24.488878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0e0d517f-3b2e-4f15-853c-6d4a1e85e69b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:24.510601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e0d517f-3b2e-4f15-853c-6d4a1e85e69b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:24.510939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e0d517f-3b2e-4f15-853c-6d4a1e85e69b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:24.511381 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e0d517f-3b2e-4f15-853c-6d4a1e85e69b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:24.512081 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e0d517f-3b2e-4f15-853c-6d4a1e85e69b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:24.512533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e0d517f-3b2e-4f15-853c-6d4a1e85e69b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:24.512953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e0d517f-3b2e-4f15-853c-6d4a1e85e69b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:24.582291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0e0d517f-3b2e-4f15-853c-6d4a1e85e69b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:24.590638 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0e0d517f-3b2e-4f15-853c-6d4a1e85e69b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.106825 Aug 08 08:52:24.591198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 511/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:24 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:24.874920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-240e3177-2d54-4325-887d-a90a3858d503 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:24.875509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-240e3177-2d54-4325-887d-a90a3858d503 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:24.882245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-240e3177-2d54-4325-887d-a90a3858d503 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:24.882736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-240e3177-2d54-4325-887d-a90a3858d503 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:24.884025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-240e3177-2d54-4325-887d-a90a3858d503 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:24.884778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-240e3177-2d54-4325-887d-a90a3858d503 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:24.885270 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-240e3177-2d54-4325-887d-a90a3858d503 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:24.885703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-240e3177-2d54-4325-887d-a90a3858d503 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:24.968634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-240e3177-2d54-4325-887d-a90a3858d503 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lazy-loading 'services' on Instance uuid 83365b2d-9f2c-4966-bdb6-789059348c37 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:52:25.187168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-240e3177-2d54-4325-887d-a90a3858d503 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f" status: 202 len: 0 microversion: 2.1 time: 0.316365 Aug 08 08:52:25.187764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 540/1051] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:52:24 2022] DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:52:25.197922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7ab2c546-ecc6-4a12-8ce7-fbe0f18d2a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:25.200387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7ab2c546-ecc6-4a12-8ce7-fbe0f18d2a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:25.206606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ab2c546-ecc6-4a12-8ce7-fbe0f18d2a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:25.207147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ab2c546-ecc6-4a12-8ce7-fbe0f18d2a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:25.207584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ab2c546-ecc6-4a12-8ce7-fbe0f18d2a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:25.208286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ab2c546-ecc6-4a12-8ce7-fbe0f18d2a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:25.208745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ab2c546-ecc6-4a12-8ce7-fbe0f18d2a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:25.209232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ab2c546-ecc6-4a12-8ce7-fbe0f18d2a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:25.238610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7ab2c546-ecc6-4a12-8ce7-fbe0f18d2a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046516 Aug 08 08:52:25.239178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 512/1052] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:25.502031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-0ba60058-fbdc-43d7-b49e-44684a629e84 req-fcbac229-4295-4f70-934c-b091ee4e6129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83365b2d-9f2c-4966-bdb6-789059348c37", "tag": "19d95122-9b77-4b3d-adf8-fcfd43a61168"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:52:25.513217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-0ba60058-fbdc-43d7-b49e-44684a629e84 req-fcbac229-4295-4f70-934c-b091ee4e6129 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:25.513699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-0ba60058-fbdc-43d7-b49e-44684a629e84 req-fcbac229-4295-4f70-934c-b091ee4e6129 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:25.514129 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-0ba60058-fbdc-43d7-b49e-44684a629e84 req-fcbac229-4295-4f70-934c-b091ee4e6129 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:25.526028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-0ba60058-fbdc-43d7-b49e-44684a629e84 req-fcbac229-4295-4f70-934c-b091ee4e6129 service nova] Creating event network-changed:19d95122-9b77-4b3d-adf8-fcfd43a61168 for instance 83365b2d-9f2c-4966-bdb6-789059348c37 on hv-cinder-83697 Aug 08 08:52:25.531051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-0ba60058-fbdc-43d7-b49e-44684a629e84 req-fcbac229-4295-4f70-934c-b091ee4e6129 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033006 Aug 08 08:52:25.531757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 541/1053] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 08:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:25.612000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3ea409a6-69d6-4886-93dc-d13433e77da6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:25.612606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3ea409a6-69d6-4886-93dc-d13433e77da6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:25.619731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ea409a6-69d6-4886-93dc-d13433e77da6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:25.620218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ea409a6-69d6-4886-93dc-d13433e77da6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:25.620655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ea409a6-69d6-4886-93dc-d13433e77da6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:25.621421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ea409a6-69d6-4886-93dc-d13433e77da6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:25.621879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ea409a6-69d6-4886-93dc-d13433e77da6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:25.622302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ea409a6-69d6-4886-93dc-d13433e77da6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:25.704989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3ea409a6-69d6-4886-93dc-d13433e77da6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:25.713301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3ea409a6-69d6-4886-93dc-d13433e77da6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.105006 Aug 08 08:52:25.713873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 513/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:25 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:26.253028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-943418af-4bc5-4762-a928-b49bc5dcb30e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:26.255296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-943418af-4bc5-4762-a928-b49bc5dcb30e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:26.262033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-943418af-4bc5-4762-a928-b49bc5dcb30e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:26.262521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-943418af-4bc5-4762-a928-b49bc5dcb30e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:26.262954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-943418af-4bc5-4762-a928-b49bc5dcb30e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:26.263662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-943418af-4bc5-4762-a928-b49bc5dcb30e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:26.264119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-943418af-4bc5-4762-a928-b49bc5dcb30e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:26.264543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-943418af-4bc5-4762-a928-b49bc5dcb30e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:26.283749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:52:26.296577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-943418af-4bc5-4762-a928-b49bc5dcb30e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047826 Aug 08 08:52:26.297128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 542/1055] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:26.735253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-16d9dda5-96c1-4bb0-af65-adc9731f04b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:26.735784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-16d9dda5-96c1-4bb0-af65-adc9731f04b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:26.745087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16d9dda5-96c1-4bb0-af65-adc9731f04b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:26.745613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16d9dda5-96c1-4bb0-af65-adc9731f04b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:26.746059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16d9dda5-96c1-4bb0-af65-adc9731f04b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:26.746756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16d9dda5-96c1-4bb0-af65-adc9731f04b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:26.747222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16d9dda5-96c1-4bb0-af65-adc9731f04b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:26.747653 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16d9dda5-96c1-4bb0-af65-adc9731f04b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:27.063783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-16d9dda5-96c1-4bb0-af65-adc9731f04b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:27.071984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-16d9dda5-96c1-4bb0-af65-adc9731f04b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.340808 Aug 08 08:52:27.072543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 514/1056] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:26 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:27.309112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-381f2a28-f634-4113-a0c2-1e1c6b57331b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:27.311385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-381f2a28-f634-4113-a0c2-1e1c6b57331b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:27.318300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381f2a28-f634-4113-a0c2-1e1c6b57331b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:27.318795 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381f2a28-f634-4113-a0c2-1e1c6b57331b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:27.319242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381f2a28-f634-4113-a0c2-1e1c6b57331b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:27.319941 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381f2a28-f634-4113-a0c2-1e1c6b57331b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:27.320413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381f2a28-f634-4113-a0c2-1e1c6b57331b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:27.321237 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-381f2a28-f634-4113-a0c2-1e1c6b57331b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:27.349728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-381f2a28-f634-4113-a0c2-1e1c6b57331b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045207 Aug 08 08:52:27.350277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 543/1057] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:27 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:28.093378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5bb7eec2-03e3-4196-b618-ed3a36335ef7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:28.093918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5bb7eec2-03e3-4196-b618-ed3a36335ef7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:28.100110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bb7eec2-03e3-4196-b618-ed3a36335ef7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:28.100598 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bb7eec2-03e3-4196-b618-ed3a36335ef7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:28.101036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bb7eec2-03e3-4196-b618-ed3a36335ef7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:28.101813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bb7eec2-03e3-4196-b618-ed3a36335ef7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:28.102211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bb7eec2-03e3-4196-b618-ed3a36335ef7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:28.107117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5bb7eec2-03e3-4196-b618-ed3a36335ef7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:28.163743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5bb7eec2-03e3-4196-b618-ed3a36335ef7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:28.171577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5bb7eec2-03e3-4196-b618-ed3a36335ef7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082216 Aug 08 08:52:28.172136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 515/1058] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:28 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:28.362787 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-81a33de5-890f-4fbf-b09f-8e29a38f188e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:28.364921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-81a33de5-890f-4fbf-b09f-8e29a38f188e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:28.372448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81a33de5-890f-4fbf-b09f-8e29a38f188e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:28.372931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81a33de5-890f-4fbf-b09f-8e29a38f188e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:28.373559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81a33de5-890f-4fbf-b09f-8e29a38f188e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:28.374247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81a33de5-890f-4fbf-b09f-8e29a38f188e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:28.374750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81a33de5-890f-4fbf-b09f-8e29a38f188e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:28.375169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-81a33de5-890f-4fbf-b09f-8e29a38f188e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:28.404339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-81a33de5-890f-4fbf-b09f-8e29a38f188e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Aug 08 08:52:28.404897 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 544/1059] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:28 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:29.192643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cbc9b8d3-fa67-4765-89d6-1f41b61de098 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:29.193290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cbc9b8d3-fa67-4765-89d6-1f41b61de098 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:29.199681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbc9b8d3-fa67-4765-89d6-1f41b61de098 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:29.200166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbc9b8d3-fa67-4765-89d6-1f41b61de098 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:29.200603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbc9b8d3-fa67-4765-89d6-1f41b61de098 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:29.201323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbc9b8d3-fa67-4765-89d6-1f41b61de098 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:29.201783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbc9b8d3-fa67-4765-89d6-1f41b61de098 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:29.202218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbc9b8d3-fa67-4765-89d6-1f41b61de098 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:29.262634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cbc9b8d3-fa67-4765-89d6-1f41b61de098 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:29.264911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:52:29.270715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cbc9b8d3-fa67-4765-89d6-1f41b61de098 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081936 Aug 08 08:52:29.271273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 516/1060] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:29 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:29.416557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-783e4587-a153-4328-86e9-4484ce200523 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:29.418863 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-783e4587-a153-4328-86e9-4484ce200523 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:29.425797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-783e4587-a153-4328-86e9-4484ce200523 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:29.426295 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-783e4587-a153-4328-86e9-4484ce200523 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:29.426742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-783e4587-a153-4328-86e9-4484ce200523 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:29.427445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-783e4587-a153-4328-86e9-4484ce200523 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:29.427914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-783e4587-a153-4328-86e9-4484ce200523 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:29.428349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-783e4587-a153-4328-86e9-4484ce200523 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:29.457648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-783e4587-a153-4328-86e9-4484ce200523 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045489 Aug 08 08:52:29.458127 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 545/1061] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:29 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:30.292728 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2b8e376b-8dd0-42c1-8f66-566d623b3b70 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:30.293373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2b8e376b-8dd0-42c1-8f66-566d623b3b70 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:30.295919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=41 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:52:30.300713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b8e376b-8dd0-42c1-8f66-566d623b3b70 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:30.301240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b8e376b-8dd0-42c1-8f66-566d623b3b70 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:30.301680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b8e376b-8dd0-42c1-8f66-566d623b3b70 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:30.302365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b8e376b-8dd0-42c1-8f66-566d623b3b70 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:30.302820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b8e376b-8dd0-42c1-8f66-566d623b3b70 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:30.303247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b8e376b-8dd0-42c1-8f66-566d623b3b70 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:30.364125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2b8e376b-8dd0-42c1-8f66-566d623b3b70 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:30.372320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2b8e376b-8dd0-42c1-8f66-566d623b3b70 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084173 Aug 08 08:52:30.372882 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 517/1062] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:30 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:30.469927 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5af9ff68-0b17-4c5b-8968-ca54508844be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:30.472073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5af9ff68-0b17-4c5b-8968-ca54508844be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:30.474370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:52:30.479643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5af9ff68-0b17-4c5b-8968-ca54508844be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:30.480125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5af9ff68-0b17-4c5b-8968-ca54508844be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:30.480810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5af9ff68-0b17-4c5b-8968-ca54508844be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:30.481578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5af9ff68-0b17-4c5b-8968-ca54508844be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:30.482032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5af9ff68-0b17-4c5b-8968-ca54508844be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:30.485256 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5af9ff68-0b17-4c5b-8968-ca54508844be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:30.511918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5af9ff68-0b17-4c5b-8968-ca54508844be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045924 Aug 08 08:52:30.512461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 546/1063] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:30 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:31.392675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-70705637-ca04-4373-b717-73998d1da711 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:31.393315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-70705637-ca04-4373-b717-73998d1da711 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:31.399987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-70705637-ca04-4373-b717-73998d1da711 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:31.400470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-70705637-ca04-4373-b717-73998d1da711 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:31.400907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-70705637-ca04-4373-b717-73998d1da711 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:31.401625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-70705637-ca04-4373-b717-73998d1da711 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:31.402083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-70705637-ca04-4373-b717-73998d1da711 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:31.402512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-70705637-ca04-4373-b717-73998d1da711 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:31.467499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-70705637-ca04-4373-b717-73998d1da711 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:31.475016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-70705637-ca04-4373-b717-73998d1da711 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086210 Aug 08 08:52:31.475574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 518/1064] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:31 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:31.523577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-17219b39-1f94-4b85-8c29-23727ea56431 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:31.525751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-17219b39-1f94-4b85-8c29-23727ea56431 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:31.532213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17219b39-1f94-4b85-8c29-23727ea56431 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:31.532692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17219b39-1f94-4b85-8c29-23727ea56431 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:31.533125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17219b39-1f94-4b85-8c29-23727ea56431 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:31.533832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17219b39-1f94-4b85-8c29-23727ea56431 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:31.534310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17219b39-1f94-4b85-8c29-23727ea56431 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:31.534736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17219b39-1f94-4b85-8c29-23727ea56431 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:31.563898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-17219b39-1f94-4b85-8c29-23727ea56431 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044567 Aug 08 08:52:31.564440 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 547/1065] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:31 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:32.495852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-880c97fb-0a88-40e8-8c48-11c3dbaddd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:32.496462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-880c97fb-0a88-40e8-8c48-11c3dbaddd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:32.502806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-880c97fb-0a88-40e8-8c48-11c3dbaddd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:32.503296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-880c97fb-0a88-40e8-8c48-11c3dbaddd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:32.503733 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-880c97fb-0a88-40e8-8c48-11c3dbaddd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:32.504423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-880c97fb-0a88-40e8-8c48-11c3dbaddd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:32.504886 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-880c97fb-0a88-40e8-8c48-11c3dbaddd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:32.505357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-880c97fb-0a88-40e8-8c48-11c3dbaddd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:32.565518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-880c97fb-0a88-40e8-8c48-11c3dbaddd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:32.573772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-880c97fb-0a88-40e8-8c48-11c3dbaddd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081829 Aug 08 08:52:32.574332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 519/1066] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:32 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:32.576493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-475325a3-7985-4d0e-aa7b-f95521448efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:32.578702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-475325a3-7985-4d0e-aa7b-f95521448efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:32.585319 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-475325a3-7985-4d0e-aa7b-f95521448efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:32.586432 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-475325a3-7985-4d0e-aa7b-f95521448efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:32.586878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-475325a3-7985-4d0e-aa7b-f95521448efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:32.587574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-475325a3-7985-4d0e-aa7b-f95521448efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:32.588035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-475325a3-7985-4d0e-aa7b-f95521448efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:32.588466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-475325a3-7985-4d0e-aa7b-f95521448efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:32.616738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-475325a3-7985-4d0e-aa7b-f95521448efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044140 Aug 08 08:52:32.617426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 548/1067] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:52:33.594530 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f3b15bc9-1851-4c72-9492-538bf6cf5aca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:33.595146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f3b15bc9-1851-4c72-9492-538bf6cf5aca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:33.602166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3b15bc9-1851-4c72-9492-538bf6cf5aca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:33.602654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3b15bc9-1851-4c72-9492-538bf6cf5aca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:33.603089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3b15bc9-1851-4c72-9492-538bf6cf5aca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:33.603778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3b15bc9-1851-4c72-9492-538bf6cf5aca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:33.604233 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3b15bc9-1851-4c72-9492-538bf6cf5aca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:33.604661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3b15bc9-1851-4c72-9492-538bf6cf5aca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:33.628890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-93a7e07f-e9b6-4fdf-84a3-a000a732eb7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:33.631073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-93a7e07f-e9b6-4fdf-84a3-a000a732eb7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:33.637682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93a7e07f-e9b6-4fdf-84a3-a000a732eb7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:33.638190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93a7e07f-e9b6-4fdf-84a3-a000a732eb7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:33.638611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93a7e07f-e9b6-4fdf-84a3-a000a732eb7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:33.639310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93a7e07f-e9b6-4fdf-84a3-a000a732eb7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:33.639851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93a7e07f-e9b6-4fdf-84a3-a000a732eb7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:33.640277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93a7e07f-e9b6-4fdf-84a3-a000a732eb7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:33.666150 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f3b15bc9-1851-4c72-9492-538bf6cf5aca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:33.671071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-93a7e07f-e9b6-4fdf-84a3-a000a732eb7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Aug 08 08:52:33.671641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 549/1068] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:33 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:52:33.673572 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f3b15bc9-1851-4c72-9492-538bf6cf5aca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082778 Aug 08 08:52:33.674123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 520/1069] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:33 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:34.682464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e3f2832a-c759-44dc-8c91-1715be5eb46e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:34.684566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e3f2832a-c759-44dc-8c91-1715be5eb46e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:34.691095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3f2832a-c759-44dc-8c91-1715be5eb46e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:34.691579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3f2832a-c759-44dc-8c91-1715be5eb46e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:34.692012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3f2832a-c759-44dc-8c91-1715be5eb46e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:34.692700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3f2832a-c759-44dc-8c91-1715be5eb46e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:34.693174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3f2832a-c759-44dc-8c91-1715be5eb46e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:34.693606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3f2832a-c759-44dc-8c91-1715be5eb46e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:34.693736 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b5c2bf6b-ec85-455e-a587-80a38aa896ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:34.694317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b5c2bf6b-ec85-455e-a587-80a38aa896ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:34.701226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5c2bf6b-ec85-455e-a587-80a38aa896ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:34.701713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5c2bf6b-ec85-455e-a587-80a38aa896ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:34.702276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5c2bf6b-ec85-455e-a587-80a38aa896ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:34.702976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5c2bf6b-ec85-455e-a587-80a38aa896ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:34.703440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5c2bf6b-ec85-455e-a587-80a38aa896ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:34.703866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5c2bf6b-ec85-455e-a587-80a38aa896ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:34.725028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e3f2832a-c759-44dc-8c91-1715be5eb46e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046599 Aug 08 08:52:34.725613 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 550/1070] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:34.764960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b5c2bf6b-ec85-455e-a587-80a38aa896ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:34.772410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b5c2bf6b-ec85-455e-a587-80a38aa896ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082581 Aug 08 08:52:34.772965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 521/1071] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:34 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:52:35.738626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cebde975-0ceb-496b-a452-cbe76a7153c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:35.740858 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cebde975-0ceb-496b-a452-cbe76a7153c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:35.747394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cebde975-0ceb-496b-a452-cbe76a7153c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:35.747878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cebde975-0ceb-496b-a452-cbe76a7153c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:35.752467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cebde975-0ceb-496b-a452-cbe76a7153c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:35.752467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cebde975-0ceb-496b-a452-cbe76a7153c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:35.752467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cebde975-0ceb-496b-a452-cbe76a7153c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:35.752467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cebde975-0ceb-496b-a452-cbe76a7153c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:35.778507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cebde975-0ceb-496b-a452-cbe76a7153c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043864 Aug 08 08:52:35.779057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 551/1072] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:35 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:35.793988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-784c1524-47fe-48fa-9ea8-9a82391ff8c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:35.794603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-784c1524-47fe-48fa-9ea8-9a82391ff8c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:35.800948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-784c1524-47fe-48fa-9ea8-9a82391ff8c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:35.801481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-784c1524-47fe-48fa-9ea8-9a82391ff8c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:35.801918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-784c1524-47fe-48fa-9ea8-9a82391ff8c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:35.802605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-784c1524-47fe-48fa-9ea8-9a82391ff8c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:35.803057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-784c1524-47fe-48fa-9ea8-9a82391ff8c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:35.803572 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-784c1524-47fe-48fa-9ea8-9a82391ff8c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:35.867944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-784c1524-47fe-48fa-9ea8-9a82391ff8c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:35.875756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-784c1524-47fe-48fa-9ea8-9a82391ff8c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085640 Aug 08 08:52:35.876323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 522/1073] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:35 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:36.790842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0535bfa2-bb42-46ff-97e3-04ce9db486fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:36.792897 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0535bfa2-bb42-46ff-97e3-04ce9db486fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:36.799250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0535bfa2-bb42-46ff-97e3-04ce9db486fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:36.799740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0535bfa2-bb42-46ff-97e3-04ce9db486fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:36.800183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0535bfa2-bb42-46ff-97e3-04ce9db486fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:36.800877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0535bfa2-bb42-46ff-97e3-04ce9db486fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:36.801368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0535bfa2-bb42-46ff-97e3-04ce9db486fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:36.801801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0535bfa2-bb42-46ff-97e3-04ce9db486fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:36.830739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0535bfa2-bb42-46ff-97e3-04ce9db486fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Aug 08 08:52:36.831283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 552/1074] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:36.896463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bb66f29a-acad-412b-9c84-177dfc254833 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:36.897077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bb66f29a-acad-412b-9c84-177dfc254833 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:36.903499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb66f29a-acad-412b-9c84-177dfc254833 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:36.903980 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb66f29a-acad-412b-9c84-177dfc254833 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:36.904417 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb66f29a-acad-412b-9c84-177dfc254833 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:36.905095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb66f29a-acad-412b-9c84-177dfc254833 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:36.905571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb66f29a-acad-412b-9c84-177dfc254833 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:36.905992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb66f29a-acad-412b-9c84-177dfc254833 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:36.966954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bb66f29a-acad-412b-9c84-177dfc254833 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:36.974243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bb66f29a-acad-412b-9c84-177dfc254833 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081640 Aug 08 08:52:36.988882 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 523/1075] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:36 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:37.842860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f0963cb2-e803-4256-ac92-80d983dd54b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:37.845099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f0963cb2-e803-4256-ac92-80d983dd54b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:37.851453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0963cb2-e803-4256-ac92-80d983dd54b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:37.851943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0963cb2-e803-4256-ac92-80d983dd54b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:37.852382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0963cb2-e803-4256-ac92-80d983dd54b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:37.853075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0963cb2-e803-4256-ac92-80d983dd54b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:37.853586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0963cb2-e803-4256-ac92-80d983dd54b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:37.853997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0963cb2-e803-4256-ac92-80d983dd54b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:37.882007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f0963cb2-e803-4256-ac92-80d983dd54b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043095 Aug 08 08:52:37.883062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 553/1076] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:37 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:38.008510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b5e0af46-bd28-4383-8349-836a679e418f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:38.009051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b5e0af46-bd28-4383-8349-836a679e418f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:38.016098 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5e0af46-bd28-4383-8349-836a679e418f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:38.016581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5e0af46-bd28-4383-8349-836a679e418f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:38.017020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5e0af46-bd28-4383-8349-836a679e418f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:38.017738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5e0af46-bd28-4383-8349-836a679e418f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:38.018196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5e0af46-bd28-4383-8349-836a679e418f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:38.018619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5e0af46-bd28-4383-8349-836a679e418f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:38.081845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b5e0af46-bd28-4383-8349-836a679e418f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:38.090313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b5e0af46-bd28-4383-8349-836a679e418f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085852 Aug 08 08:52:38.090865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 524/1077] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:38 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:38.894889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ffd81375-6d0f-4ab9-8eab-91a0d5b1010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:38.897083 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ffd81375-6d0f-4ab9-8eab-91a0d5b1010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:38.905264 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffd81375-6d0f-4ab9-8eab-91a0d5b1010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:38.905757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffd81375-6d0f-4ab9-8eab-91a0d5b1010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:38.906199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffd81375-6d0f-4ab9-8eab-91a0d5b1010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:38.906892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffd81375-6d0f-4ab9-8eab-91a0d5b1010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:38.907351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffd81375-6d0f-4ab9-8eab-91a0d5b1010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:38.907781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffd81375-6d0f-4ab9-8eab-91a0d5b1010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:38.936935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ffd81375-6d0f-4ab9-8eab-91a0d5b1010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046086 Aug 08 08:52:38.937516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 554/1078] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:38 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:39.110551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4de155cd-1516-417d-9b16-b1d24dbaf4be tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:39.111167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4de155cd-1516-417d-9b16-b1d24dbaf4be tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:39.117594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4de155cd-1516-417d-9b16-b1d24dbaf4be tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:39.118078 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4de155cd-1516-417d-9b16-b1d24dbaf4be tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:39.118518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4de155cd-1516-417d-9b16-b1d24dbaf4be tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:39.119203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4de155cd-1516-417d-9b16-b1d24dbaf4be tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:39.119656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4de155cd-1516-417d-9b16-b1d24dbaf4be tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:39.120082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4de155cd-1516-417d-9b16-b1d24dbaf4be tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:39.180081 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4de155cd-1516-417d-9b16-b1d24dbaf4be tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:39.187569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4de155cd-1516-417d-9b16-b1d24dbaf4be tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.080837 Aug 08 08:52:39.188128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 525/1079] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:39 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:39.949619 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7777ced4-9af6-47e0-a2aa-bd1c2b3089ec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:39.951686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7777ced4-9af6-47e0-a2aa-bd1c2b3089ec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:39.958021 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7777ced4-9af6-47e0-a2aa-bd1c2b3089ec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:39.958508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7777ced4-9af6-47e0-a2aa-bd1c2b3089ec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:39.958945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7777ced4-9af6-47e0-a2aa-bd1c2b3089ec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:39.959662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7777ced4-9af6-47e0-a2aa-bd1c2b3089ec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:39.960119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7777ced4-9af6-47e0-a2aa-bd1c2b3089ec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:39.961162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7777ced4-9af6-47e0-a2aa-bd1c2b3089ec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:39.990088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7777ced4-9af6-47e0-a2aa-bd1c2b3089ec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Aug 08 08:52:39.990646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 555/1080] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:39 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:40.207815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-32fc1f1e-53a4-4d36-b4d7-231fa60682d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:40.208341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-32fc1f1e-53a4-4d36-b4d7-231fa60682d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:40.214883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32fc1f1e-53a4-4d36-b4d7-231fa60682d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:40.215365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32fc1f1e-53a4-4d36-b4d7-231fa60682d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:40.215801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32fc1f1e-53a4-4d36-b4d7-231fa60682d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:40.216509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32fc1f1e-53a4-4d36-b4d7-231fa60682d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:40.216969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32fc1f1e-53a4-4d36-b4d7-231fa60682d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:40.217433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32fc1f1e-53a4-4d36-b4d7-231fa60682d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:40.281856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-32fc1f1e-53a4-4d36-b4d7-231fa60682d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:40.289460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-32fc1f1e-53a4-4d36-b4d7-231fa60682d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085554 Aug 08 08:52:40.290287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 526/1081] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:40 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:41.002079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-99e9ae23-c99c-458b-86d2-24d0ba48929f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:41.004263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-99e9ae23-c99c-458b-86d2-24d0ba48929f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:41.010554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99e9ae23-c99c-458b-86d2-24d0ba48929f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:41.011049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99e9ae23-c99c-458b-86d2-24d0ba48929f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:41.015973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99e9ae23-c99c-458b-86d2-24d0ba48929f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:41.015973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99e9ae23-c99c-458b-86d2-24d0ba48929f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:41.015973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99e9ae23-c99c-458b-86d2-24d0ba48929f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:41.015973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-99e9ae23-c99c-458b-86d2-24d0ba48929f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:41.043360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-99e9ae23-c99c-458b-86d2-24d0ba48929f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045239 Aug 08 08:52:41.043923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 556/1082] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:40 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:41.309779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4b4378cc-a636-434e-aa93-7106aac8c9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:41.310336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4b4378cc-a636-434e-aa93-7106aac8c9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:41.316878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b4378cc-a636-434e-aa93-7106aac8c9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:41.317392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b4378cc-a636-434e-aa93-7106aac8c9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:41.317827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b4378cc-a636-434e-aa93-7106aac8c9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:41.318506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b4378cc-a636-434e-aa93-7106aac8c9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:41.318955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b4378cc-a636-434e-aa93-7106aac8c9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:41.319376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b4378cc-a636-434e-aa93-7106aac8c9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:41.380221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4b4378cc-a636-434e-aa93-7106aac8c9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:41.388313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4b4378cc-a636-434e-aa93-7106aac8c9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082438 Aug 08 08:52:41.388872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 527/1083] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:41 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:42.056420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cea3b5b8-234b-49b3-b87a-cbde86faf4ed tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:42.058579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cea3b5b8-234b-49b3-b87a-cbde86faf4ed tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:42.065003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cea3b5b8-234b-49b3-b87a-cbde86faf4ed tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:42.065580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cea3b5b8-234b-49b3-b87a-cbde86faf4ed tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:42.066027 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cea3b5b8-234b-49b3-b87a-cbde86faf4ed tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:42.066727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cea3b5b8-234b-49b3-b87a-cbde86faf4ed tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:42.067190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cea3b5b8-234b-49b3-b87a-cbde86faf4ed tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:42.067623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cea3b5b8-234b-49b3-b87a-cbde86faf4ed tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:42.096407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cea3b5b8-234b-49b3-b87a-cbde86faf4ed tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Aug 08 08:52:42.096981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 557/1084] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:42 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:42.409509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-38fc49c7-0d3d-4d7a-9be1-e79c3b97a2b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:42.410142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-38fc49c7-0d3d-4d7a-9be1-e79c3b97a2b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:42.417532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38fc49c7-0d3d-4d7a-9be1-e79c3b97a2b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:42.418020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38fc49c7-0d3d-4d7a-9be1-e79c3b97a2b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:42.418839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38fc49c7-0d3d-4d7a-9be1-e79c3b97a2b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:42.419148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38fc49c7-0d3d-4d7a-9be1-e79c3b97a2b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:42.419608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38fc49c7-0d3d-4d7a-9be1-e79c3b97a2b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:42.420037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38fc49c7-0d3d-4d7a-9be1-e79c3b97a2b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:42.482283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-38fc49c7-0d3d-4d7a-9be1-e79c3b97a2b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:42.489758 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-38fc49c7-0d3d-4d7a-9be1-e79c3b97a2b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084085 Aug 08 08:52:42.490321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 528/1085] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:42 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:43.109628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3cb147eb-b816-4d49-842e-ad67fd7301dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:43.111804 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3cb147eb-b816-4d49-842e-ad67fd7301dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:43.118368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb147eb-b816-4d49-842e-ad67fd7301dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:43.118849 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb147eb-b816-4d49-842e-ad67fd7301dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:43.119286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb147eb-b816-4d49-842e-ad67fd7301dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:43.119969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb147eb-b816-4d49-842e-ad67fd7301dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:43.120455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb147eb-b816-4d49-842e-ad67fd7301dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:43.120881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb147eb-b816-4d49-842e-ad67fd7301dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:43.150508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3cb147eb-b816-4d49-842e-ad67fd7301dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Aug 08 08:52:43.151063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 558/1086] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:43.511133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0e1c7f04-a2d2-43be-b0c0-06f6b035570d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:43.511752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0e1c7f04-a2d2-43be-b0c0-06f6b035570d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:43.518197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1c7f04-a2d2-43be-b0c0-06f6b035570d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:43.518693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1c7f04-a2d2-43be-b0c0-06f6b035570d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:43.519138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1c7f04-a2d2-43be-b0c0-06f6b035570d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:43.519834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1c7f04-a2d2-43be-b0c0-06f6b035570d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:43.520297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1c7f04-a2d2-43be-b0c0-06f6b035570d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:43.520729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1c7f04-a2d2-43be-b0c0-06f6b035570d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:43.581035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0e1c7f04-a2d2-43be-b0c0-06f6b035570d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:43.588605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0e1c7f04-a2d2-43be-b0c0-06f6b035570d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081920 Aug 08 08:52:43.589179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 529/1087] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:43 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:44.163005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-75f90292-de22-42aa-aea7-b5605da18c2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:44.165842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-75f90292-de22-42aa-aea7-b5605da18c2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:44.172218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75f90292-de22-42aa-aea7-b5605da18c2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:44.172708 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75f90292-de22-42aa-aea7-b5605da18c2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:44.173165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75f90292-de22-42aa-aea7-b5605da18c2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:44.173867 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75f90292-de22-42aa-aea7-b5605da18c2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:44.174331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75f90292-de22-42aa-aea7-b5605da18c2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:44.174762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75f90292-de22-42aa-aea7-b5605da18c2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:44.178457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:52:44.203420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-75f90292-de22-42aa-aea7-b5605da18c2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044401 Aug 08 08:52:44.203970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 559/1088] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:44.609823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5f1f5251-81e4-42c7-af69-b6da13a1773f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:44.610440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5f1f5251-81e4-42c7-af69-b6da13a1773f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:44.617536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f1f5251-81e4-42c7-af69-b6da13a1773f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:44.618026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f1f5251-81e4-42c7-af69-b6da13a1773f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:44.618470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f1f5251-81e4-42c7-af69-b6da13a1773f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:44.619163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f1f5251-81e4-42c7-af69-b6da13a1773f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:44.619623 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f1f5251-81e4-42c7-af69-b6da13a1773f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:44.620054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f1f5251-81e4-42c7-af69-b6da13a1773f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:44.683400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5f1f5251-81e4-42c7-af69-b6da13a1773f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:44.690943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5f1f5251-81e4-42c7-af69-b6da13a1773f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085194 Aug 08 08:52:44.691509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 530/1089] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:44 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:45.216334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6368624a-7890-47c7-87f6-97cb236352f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:45.218536 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6368624a-7890-47c7-87f6-97cb236352f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:45.225485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6368624a-7890-47c7-87f6-97cb236352f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:45.226062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6368624a-7890-47c7-87f6-97cb236352f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:45.226511 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6368624a-7890-47c7-87f6-97cb236352f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:45.227210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6368624a-7890-47c7-87f6-97cb236352f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:45.227672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6368624a-7890-47c7-87f6-97cb236352f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:45.228107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6368624a-7890-47c7-87f6-97cb236352f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:45.256545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6368624a-7890-47c7-87f6-97cb236352f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044174 Aug 08 08:52:45.257098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 560/1090] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:45.711767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6d55536d-7ef9-4338-8c16-2e25ed95a89e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:45.712441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6d55536d-7ef9-4338-8c16-2e25ed95a89e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:45.718941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d55536d-7ef9-4338-8c16-2e25ed95a89e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:45.719527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d55536d-7ef9-4338-8c16-2e25ed95a89e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:45.719969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d55536d-7ef9-4338-8c16-2e25ed95a89e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:45.720663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d55536d-7ef9-4338-8c16-2e25ed95a89e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:45.721122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d55536d-7ef9-4338-8c16-2e25ed95a89e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:45.721579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d55536d-7ef9-4338-8c16-2e25ed95a89e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:45.783434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6d55536d-7ef9-4338-8c16-2e25ed95a89e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:45.790807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6d55536d-7ef9-4338-8c16-2e25ed95a89e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083205 Aug 08 08:52:45.791361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 531/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:45 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:46.269402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-89b89f12-2b49-4489-85c5-c534a2e92ff3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:46.271561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-89b89f12-2b49-4489-85c5-c534a2e92ff3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:46.278515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89b89f12-2b49-4489-85c5-c534a2e92ff3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:46.279031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89b89f12-2b49-4489-85c5-c534a2e92ff3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:46.279472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89b89f12-2b49-4489-85c5-c534a2e92ff3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:46.280174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89b89f12-2b49-4489-85c5-c534a2e92ff3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:46.280637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89b89f12-2b49-4489-85c5-c534a2e92ff3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:46.281070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89b89f12-2b49-4489-85c5-c534a2e92ff3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:46.310045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-89b89f12-2b49-4489-85c5-c534a2e92ff3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 Aug 08 08:52:46.310598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 561/1092] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:46 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:46.811097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2c1c49ee-679e-4a5d-bc5d-72de39074c3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:46.811709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2c1c49ee-679e-4a5d-bc5d-72de39074c3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:46.818037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c1c49ee-679e-4a5d-bc5d-72de39074c3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:46.818522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c1c49ee-679e-4a5d-bc5d-72de39074c3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:46.818957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c1c49ee-679e-4a5d-bc5d-72de39074c3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:46.819638 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c1c49ee-679e-4a5d-bc5d-72de39074c3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:46.820091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c1c49ee-679e-4a5d-bc5d-72de39074c3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:46.820511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c1c49ee-679e-4a5d-bc5d-72de39074c3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:46.881386 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2c1c49ee-679e-4a5d-bc5d-72de39074c3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:46.888874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2c1c49ee-679e-4a5d-bc5d-72de39074c3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081556 Aug 08 08:52:46.889473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 532/1093] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:46 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:47.322798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1149685e-9728-47e7-bc56-127dadde48cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:47.325009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1149685e-9728-47e7-bc56-127dadde48cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:47.331354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1149685e-9728-47e7-bc56-127dadde48cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:47.331835 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1149685e-9728-47e7-bc56-127dadde48cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:47.332266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1149685e-9728-47e7-bc56-127dadde48cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:47.332947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1149685e-9728-47e7-bc56-127dadde48cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:47.333460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1149685e-9728-47e7-bc56-127dadde48cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:47.333882 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1149685e-9728-47e7-bc56-127dadde48cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:47.362835 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1149685e-9728-47e7-bc56-127dadde48cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Aug 08 08:52:47.363372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 562/1094] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:47.908587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-15dbd85f-108d-405d-b85e-69b178f28daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:47.909226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-15dbd85f-108d-405d-b85e-69b178f28daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:47.916194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15dbd85f-108d-405d-b85e-69b178f28daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:47.916670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15dbd85f-108d-405d-b85e-69b178f28daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:47.917187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15dbd85f-108d-405d-b85e-69b178f28daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:47.917869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15dbd85f-108d-405d-b85e-69b178f28daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:47.918321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15dbd85f-108d-405d-b85e-69b178f28daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:47.918745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15dbd85f-108d-405d-b85e-69b178f28daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:47.933101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:52:47.979573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-15dbd85f-108d-405d-b85e-69b178f28daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:47.987221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-15dbd85f-108d-405d-b85e-69b178f28daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082550 Aug 08 08:52:47.987787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 533/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:47 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:48.375277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2cdf1b5b-b823-48a7-a0ac-4a28335ca836 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:48.377498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2cdf1b5b-b823-48a7-a0ac-4a28335ca836 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:48.384354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5b-b823-48a7-a0ac-4a28335ca836 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:48.384841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5b-b823-48a7-a0ac-4a28335ca836 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:48.385307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5b-b823-48a7-a0ac-4a28335ca836 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:48.385997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5b-b823-48a7-a0ac-4a28335ca836 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:48.386498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5b-b823-48a7-a0ac-4a28335ca836 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:48.386921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2cdf1b5b-b823-48a7-a0ac-4a28335ca836 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:48.415677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2cdf1b5b-b823-48a7-a0ac-4a28335ca836 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Aug 08 08:52:48.416234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 563/1096] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:49.008380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8c2c2341-ce37-46b9-8d90-f27ff351fd34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:49.008911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8c2c2341-ce37-46b9-8d90-f27ff351fd34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:49.015318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c2c2341-ce37-46b9-8d90-f27ff351fd34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:49.015795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c2c2341-ce37-46b9-8d90-f27ff351fd34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:49.016230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c2c2341-ce37-46b9-8d90-f27ff351fd34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:49.016914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c2c2341-ce37-46b9-8d90-f27ff351fd34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:49.017393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c2c2341-ce37-46b9-8d90-f27ff351fd34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:49.017816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c2c2341-ce37-46b9-8d90-f27ff351fd34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:49.081508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8c2c2341-ce37-46b9-8d90-f27ff351fd34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:49.089322 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8c2c2341-ce37-46b9-8d90-f27ff351fd34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085303 Aug 08 08:52:49.089882 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 534/1097] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:49 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:49.427915 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2e03d9d5-31d1-4c26-8704-d744ec6fcb3a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:49.430776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2e03d9d5-31d1-4c26-8704-d744ec6fcb3a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:49.437164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e03d9d5-31d1-4c26-8704-d744ec6fcb3a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:49.437661 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e03d9d5-31d1-4c26-8704-d744ec6fcb3a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:49.438101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e03d9d5-31d1-4c26-8704-d744ec6fcb3a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:49.438792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e03d9d5-31d1-4c26-8704-d744ec6fcb3a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:49.439271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e03d9d5-31d1-4c26-8704-d744ec6fcb3a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:49.439701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e03d9d5-31d1-4c26-8704-d744ec6fcb3a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:49.468760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2e03d9d5-31d1-4c26-8704-d744ec6fcb3a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Aug 08 08:52:49.469345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 564/1098] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:50.110795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-96981fa0-897d-4009-b8a6-c9daab68763a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:50.111405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-96981fa0-897d-4009-b8a6-c9daab68763a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:50.118715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96981fa0-897d-4009-b8a6-c9daab68763a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:50.119206 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96981fa0-897d-4009-b8a6-c9daab68763a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:50.119647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96981fa0-897d-4009-b8a6-c9daab68763a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:50.120351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96981fa0-897d-4009-b8a6-c9daab68763a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:50.120807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96981fa0-897d-4009-b8a6-c9daab68763a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:50.121259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96981fa0-897d-4009-b8a6-c9daab68763a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:50.215439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-96981fa0-897d-4009-b8a6-c9daab68763a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:50.222938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-96981fa0-897d-4009-b8a6-c9daab68763a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.115983 Aug 08 08:52:50.223694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 535/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:50 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:50.481370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d64fc717-b27f-4b42-8234-973106f31719 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:50.483496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d64fc717-b27f-4b42-8234-973106f31719 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:50.489583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d64fc717-b27f-4b42-8234-973106f31719 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:50.490075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d64fc717-b27f-4b42-8234-973106f31719 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:50.490509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d64fc717-b27f-4b42-8234-973106f31719 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:50.491205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d64fc717-b27f-4b42-8234-973106f31719 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:50.491770 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d64fc717-b27f-4b42-8234-973106f31719 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:50.492202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d64fc717-b27f-4b42-8234-973106f31719 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:50.521033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d64fc717-b27f-4b42-8234-973106f31719 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Aug 08 08:52:50.521622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 565/1100] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:50 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:51.244507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6e0d3b7e-f447-4ebd-b8d4-6842e6291f77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:51.245122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6e0d3b7e-f447-4ebd-b8d4-6842e6291f77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:51.251595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6e0d3b7e-f447-4ebd-b8d4-6842e6291f77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:51.252085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6e0d3b7e-f447-4ebd-b8d4-6842e6291f77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:51.252531 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6e0d3b7e-f447-4ebd-b8d4-6842e6291f77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:51.253250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6e0d3b7e-f447-4ebd-b8d4-6842e6291f77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:51.253794 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6e0d3b7e-f447-4ebd-b8d4-6842e6291f77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:51.254224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6e0d3b7e-f447-4ebd-b8d4-6842e6291f77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:51.316251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6e0d3b7e-f447-4ebd-b8d4-6842e6291f77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:51.324064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6e0d3b7e-f447-4ebd-b8d4-6842e6291f77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084177 Aug 08 08:52:51.324626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 536/1101] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:51 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:51.533501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7f2a5711-9f6d-40ac-9f0e-01f2e08f47b3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:51.535605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7f2a5711-9f6d-40ac-9f0e-01f2e08f47b3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:51.542456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f2a5711-9f6d-40ac-9f0e-01f2e08f47b3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:51.542946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f2a5711-9f6d-40ac-9f0e-01f2e08f47b3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:51.543387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f2a5711-9f6d-40ac-9f0e-01f2e08f47b3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:51.544081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f2a5711-9f6d-40ac-9f0e-01f2e08f47b3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:51.544541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f2a5711-9f6d-40ac-9f0e-01f2e08f47b3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:51.544973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f2a5711-9f6d-40ac-9f0e-01f2e08f47b3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:51.573878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7f2a5711-9f6d-40ac-9f0e-01f2e08f47b3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044496 Aug 08 08:52:51.574434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 566/1102] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:51 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:52.344897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-184ccee1-5f0b-4a5b-9fa3-5a11ea562341 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:52.345532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-184ccee1-5f0b-4a5b-9fa3-5a11ea562341 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:52.352726 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-184ccee1-5f0b-4a5b-9fa3-5a11ea562341 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:52.353238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-184ccee1-5f0b-4a5b-9fa3-5a11ea562341 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:52.353680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-184ccee1-5f0b-4a5b-9fa3-5a11ea562341 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:52.354377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-184ccee1-5f0b-4a5b-9fa3-5a11ea562341 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:52.354832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-184ccee1-5f0b-4a5b-9fa3-5a11ea562341 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:52.355308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-184ccee1-5f0b-4a5b-9fa3-5a11ea562341 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:52.422503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-184ccee1-5f0b-4a5b-9fa3-5a11ea562341 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:52.430111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-184ccee1-5f0b-4a5b-9fa3-5a11ea562341 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.089005 Aug 08 08:52:52.430660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 537/1103] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:52 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:52.586663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-37c798c2-43c2-4b9e-8f65-3d9d817d8a4d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:52.588806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-37c798c2-43c2-4b9e-8f65-3d9d817d8a4d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:52.595222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37c798c2-43c2-4b9e-8f65-3d9d817d8a4d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:52.595706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37c798c2-43c2-4b9e-8f65-3d9d817d8a4d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:52.596143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37c798c2-43c2-4b9e-8f65-3d9d817d8a4d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:52.596841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37c798c2-43c2-4b9e-8f65-3d9d817d8a4d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:52.597340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37c798c2-43c2-4b9e-8f65-3d9d817d8a4d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:52.597771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37c798c2-43c2-4b9e-8f65-3d9d817d8a4d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:52.626420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-37c798c2-43c2-4b9e-8f65-3d9d817d8a4d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044417 Aug 08 08:52:52.626963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 567/1104] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:52 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:53.449779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5362900d-49cc-4654-9c22-a6bb1ba7e480 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:53.450396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5362900d-49cc-4654-9c22-a6bb1ba7e480 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:53.456709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5362900d-49cc-4654-9c22-a6bb1ba7e480 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:53.457223 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5362900d-49cc-4654-9c22-a6bb1ba7e480 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:53.457666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5362900d-49cc-4654-9c22-a6bb1ba7e480 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:53.458355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5362900d-49cc-4654-9c22-a6bb1ba7e480 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:53.458809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5362900d-49cc-4654-9c22-a6bb1ba7e480 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:53.459235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5362900d-49cc-4654-9c22-a6bb1ba7e480 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:53.519976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5362900d-49cc-4654-9c22-a6bb1ba7e480 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:53.527681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5362900d-49cc-4654-9c22-a6bb1ba7e480 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081756 Aug 08 08:52:53.528234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 538/1105] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:53 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:53.638719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fef70b77-b0b8-4f93-891d-5a1e25b39a24 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:53.640889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fef70b77-b0b8-4f93-891d-5a1e25b39a24 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:53.647436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fef70b77-b0b8-4f93-891d-5a1e25b39a24 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:53.648214 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fef70b77-b0b8-4f93-891d-5a1e25b39a24 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:53.648826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fef70b77-b0b8-4f93-891d-5a1e25b39a24 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:53.649566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fef70b77-b0b8-4f93-891d-5a1e25b39a24 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:53.650036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fef70b77-b0b8-4f93-891d-5a1e25b39a24 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:53.655241 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fef70b77-b0b8-4f93-891d-5a1e25b39a24 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:53.681518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fef70b77-b0b8-4f93-891d-5a1e25b39a24 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046622 Aug 08 08:52:53.682001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 568/1106] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:53 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:54.548404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-91a33162-74a4-454e-b5d1-960805252b9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:54.549021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-91a33162-74a4-454e-b5d1-960805252b9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:54.556046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a33162-74a4-454e-b5d1-960805252b9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:54.556527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a33162-74a4-454e-b5d1-960805252b9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:54.556965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a33162-74a4-454e-b5d1-960805252b9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:54.557682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a33162-74a4-454e-b5d1-960805252b9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:54.558144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a33162-74a4-454e-b5d1-960805252b9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:54.558576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a33162-74a4-454e-b5d1-960805252b9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:54.618500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-91a33162-74a4-454e-b5d1-960805252b9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:54.625880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-91a33162-74a4-454e-b5d1-960805252b9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081364 Aug 08 08:52:54.626442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 539/1107] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:54 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:54.693578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8f53e4f3-ad1a-4441-a093-41a66ae22e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:54.696329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8f53e4f3-ad1a-4441-a093-41a66ae22e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:54.702898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f53e4f3-ad1a-4441-a093-41a66ae22e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:54.703386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f53e4f3-ad1a-4441-a093-41a66ae22e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:54.703822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f53e4f3-ad1a-4441-a093-41a66ae22e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:54.704515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f53e4f3-ad1a-4441-a093-41a66ae22e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:54.704971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f53e4f3-ad1a-4441-a093-41a66ae22e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:54.705437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f53e4f3-ad1a-4441-a093-41a66ae22e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:54.733425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8f53e4f3-ad1a-4441-a093-41a66ae22e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043858 Aug 08 08:52:54.734261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 569/1108] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:54 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:55.646599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fdbe6e23-db87-4cc6-b43a-e3c31af7ea97 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:55.647219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fdbe6e23-db87-4cc6-b43a-e3c31af7ea97 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:55.654362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdbe6e23-db87-4cc6-b43a-e3c31af7ea97 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:55.654849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdbe6e23-db87-4cc6-b43a-e3c31af7ea97 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:55.655288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdbe6e23-db87-4cc6-b43a-e3c31af7ea97 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:55.655990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdbe6e23-db87-4cc6-b43a-e3c31af7ea97 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:55.656447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdbe6e23-db87-4cc6-b43a-e3c31af7ea97 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:55.656877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdbe6e23-db87-4cc6-b43a-e3c31af7ea97 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:55.717458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fdbe6e23-db87-4cc6-b43a-e3c31af7ea97 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:55.724889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fdbe6e23-db87-4cc6-b43a-e3c31af7ea97 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082148 Aug 08 08:52:55.725488 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 540/1109] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:55 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:55.745750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-75e061db-89c7-4628-885d-0fb186d7d36d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:55.747903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-75e061db-89c7-4628-885d-0fb186d7d36d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:55.754221 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75e061db-89c7-4628-885d-0fb186d7d36d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:55.754702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75e061db-89c7-4628-885d-0fb186d7d36d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:55.755133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75e061db-89c7-4628-885d-0fb186d7d36d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:55.755820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75e061db-89c7-4628-885d-0fb186d7d36d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:55.756276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75e061db-89c7-4628-885d-0fb186d7d36d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:55.756700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75e061db-89c7-4628-885d-0fb186d7d36d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:55.785928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-75e061db-89c7-4628-885d-0fb186d7d36d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Aug 08 08:52:55.786486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 570/1110] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:52:56.746351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f2bc4c39-6c8e-41e2-aa75-caac8674d3f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:56.746988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f2bc4c39-6c8e-41e2-aa75-caac8674d3f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:56.752872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2bc4c39-6c8e-41e2-aa75-caac8674d3f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:56.753401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2bc4c39-6c8e-41e2-aa75-caac8674d3f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:56.753866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2bc4c39-6c8e-41e2-aa75-caac8674d3f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:56.754543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2bc4c39-6c8e-41e2-aa75-caac8674d3f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:56.754992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2bc4c39-6c8e-41e2-aa75-caac8674d3f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:56.755409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2bc4c39-6c8e-41e2-aa75-caac8674d3f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:56.798169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ed3f390d-6b8e-4894-84aa-a188dfe17425 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:56.800369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ed3f390d-6b8e-4894-84aa-a188dfe17425 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:56.807367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed3f390d-6b8e-4894-84aa-a188dfe17425 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:56.807853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed3f390d-6b8e-4894-84aa-a188dfe17425 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:56.808294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed3f390d-6b8e-4894-84aa-a188dfe17425 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:56.808993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed3f390d-6b8e-4894-84aa-a188dfe17425 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:56.809492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed3f390d-6b8e-4894-84aa-a188dfe17425 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:56.809921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed3f390d-6b8e-4894-84aa-a188dfe17425 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:56.818852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f2bc4c39-6c8e-41e2-aa75-caac8674d3f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:56.826897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f2bc4c39-6c8e-41e2-aa75-caac8674d3f3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085308 Aug 08 08:52:56.827711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 541/1111] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:56 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:56.839694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ed3f390d-6b8e-4894-84aa-a188dfe17425 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045456 Aug 08 08:52:56.840245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 571/1112] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:52:57.847090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3b87978b-3b10-41bc-afd7-d0ea89142935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:57.847717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3b87978b-3b10-41bc-afd7-d0ea89142935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:57.851520 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b59b8158-0cb8-473d-8e3d-af5c04048fa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:57.854229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b59b8158-0cb8-473d-8e3d-af5c04048fa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:57.855033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b87978b-3b10-41bc-afd7-d0ea89142935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:57.855528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b87978b-3b10-41bc-afd7-d0ea89142935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:57.856227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b87978b-3b10-41bc-afd7-d0ea89142935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:57.856929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b87978b-3b10-41bc-afd7-d0ea89142935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:57.857428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b87978b-3b10-41bc-afd7-d0ea89142935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:57.857864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b87978b-3b10-41bc-afd7-d0ea89142935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:57.860909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b59b8158-0cb8-473d-8e3d-af5c04048fa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:57.861428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b59b8158-0cb8-473d-8e3d-af5c04048fa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:57.861864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b59b8158-0cb8-473d-8e3d-af5c04048fa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:57.862554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b59b8158-0cb8-473d-8e3d-af5c04048fa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:57.863011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b59b8158-0cb8-473d-8e3d-af5c04048fa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:57.863436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b59b8158-0cb8-473d-8e3d-af5c04048fa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:57.892109 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b59b8158-0cb8-473d-8e3d-af5c04048fa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044452 Aug 08 08:52:57.892659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 572/1113] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:57 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:52:57.921477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3b87978b-3b10-41bc-afd7-d0ea89142935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:57.929105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3b87978b-3b10-41bc-afd7-d0ea89142935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085957 Aug 08 08:52:57.929695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 542/1114] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:57 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:52:58.904575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2bef3e8b-6b5e-4519-ab16-1898528df08b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:58.906793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2bef3e8b-6b5e-4519-ab16-1898528df08b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:58.913295 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bef3e8b-6b5e-4519-ab16-1898528df08b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:58.913787 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bef3e8b-6b5e-4519-ab16-1898528df08b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:58.914246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bef3e8b-6b5e-4519-ab16-1898528df08b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:58.914952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bef3e8b-6b5e-4519-ab16-1898528df08b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:58.915410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bef3e8b-6b5e-4519-ab16-1898528df08b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:58.915838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bef3e8b-6b5e-4519-ab16-1898528df08b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:58.944404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2bef3e8b-6b5e-4519-ab16-1898528df08b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 Aug 08 08:52:58.944958 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 573/1115] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:52:58.950470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-61873da4-0c06-4f88-8062-0d7e8a1b65a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:58.951141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-61873da4-0c06-4f88-8062-0d7e8a1b65a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:58.957492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61873da4-0c06-4f88-8062-0d7e8a1b65a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:58.957978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61873da4-0c06-4f88-8062-0d7e8a1b65a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:58.958418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61873da4-0c06-4f88-8062-0d7e8a1b65a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:58.959110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61873da4-0c06-4f88-8062-0d7e8a1b65a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:58.959566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61873da4-0c06-4f88-8062-0d7e8a1b65a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:58.959996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-61873da4-0c06-4f88-8062-0d7e8a1b65a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:59.020805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-61873da4-0c06-4f88-8062-0d7e8a1b65a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:52:59.028426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-61873da4-0c06-4f88-8062-0d7e8a1b65a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082759 Aug 08 08:52:59.028994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 543/1116] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:52:58 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:52:59.957040 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c0aaa2fb-a837-4971-bc7a-6adfcfc3bd65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:52:59.959141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c0aaa2fb-a837-4971-bc7a-6adfcfc3bd65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:52:59.965797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0aaa2fb-a837-4971-bc7a-6adfcfc3bd65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:59.966286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0aaa2fb-a837-4971-bc7a-6adfcfc3bd65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:59.966724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0aaa2fb-a837-4971-bc7a-6adfcfc3bd65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:59.967417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0aaa2fb-a837-4971-bc7a-6adfcfc3bd65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:52:59.967874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0aaa2fb-a837-4971-bc7a-6adfcfc3bd65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:52:59.968301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0aaa2fb-a837-4971-bc7a-6adfcfc3bd65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:52:59.997303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c0aaa2fb-a837-4971-bc7a-6adfcfc3bd65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Aug 08 08:52:59.997873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 574/1117] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:52:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:00.049398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5526ee22-3111-4cb9-a2f3-68e8607ee569 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:00.050019 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5526ee22-3111-4cb9-a2f3-68e8607ee569 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:00.057361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5526ee22-3111-4cb9-a2f3-68e8607ee569 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:00.057846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5526ee22-3111-4cb9-a2f3-68e8607ee569 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:00.058282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5526ee22-3111-4cb9-a2f3-68e8607ee569 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:00.058985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5526ee22-3111-4cb9-a2f3-68e8607ee569 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:00.059430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5526ee22-3111-4cb9-a2f3-68e8607ee569 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:00.059853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5526ee22-3111-4cb9-a2f3-68e8607ee569 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:00.123202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5526ee22-3111-4cb9-a2f3-68e8607ee569 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:00.130688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5526ee22-3111-4cb9-a2f3-68e8607ee569 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085157 Aug 08 08:53:00.131281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 544/1118] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:00 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:01.010332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7ef77490-c27f-4353-8674-d00b0059dd99 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:01.012535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7ef77490-c27f-4353-8674-d00b0059dd99 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:01.018961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ef77490-c27f-4353-8674-d00b0059dd99 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:01.019441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ef77490-c27f-4353-8674-d00b0059dd99 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:01.019874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ef77490-c27f-4353-8674-d00b0059dd99 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:01.020611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ef77490-c27f-4353-8674-d00b0059dd99 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:01.021065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ef77490-c27f-4353-8674-d00b0059dd99 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:01.021517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ef77490-c27f-4353-8674-d00b0059dd99 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:01.046649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:53:01.051315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7ef77490-c27f-4353-8674-d00b0059dd99 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045810 Aug 08 08:53:01.051871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 575/1119] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:01 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:01.154234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5de360b4-3e72-4e14-a6cb-adca22036027 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:01.154851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5de360b4-3e72-4e14-a6cb-adca22036027 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:01.157102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=56 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:53:01.161764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5de360b4-3e72-4e14-a6cb-adca22036027 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:01.162250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5de360b4-3e72-4e14-a6cb-adca22036027 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:01.162686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5de360b4-3e72-4e14-a6cb-adca22036027 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:01.163373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5de360b4-3e72-4e14-a6cb-adca22036027 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:01.163828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5de360b4-3e72-4e14-a6cb-adca22036027 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:01.164325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5de360b4-3e72-4e14-a6cb-adca22036027 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:01.229622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5de360b4-3e72-4e14-a6cb-adca22036027 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:01.237283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5de360b4-3e72-4e14-a6cb-adca22036027 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086892 Aug 08 08:53:01.240483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 545/1120] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:01 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:02.064022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-275a8b4c-ea1c-4b0a-bc9f-7e7fa7433849 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:02.066117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-275a8b4c-ea1c-4b0a-bc9f-7e7fa7433849 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:02.068407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=60 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:53:02.073367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-275a8b4c-ea1c-4b0a-bc9f-7e7fa7433849 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:02.073847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-275a8b4c-ea1c-4b0a-bc9f-7e7fa7433849 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:02.074281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-275a8b4c-ea1c-4b0a-bc9f-7e7fa7433849 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:02.074973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-275a8b4c-ea1c-4b0a-bc9f-7e7fa7433849 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:02.075466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-275a8b4c-ea1c-4b0a-bc9f-7e7fa7433849 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:02.075891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-275a8b4c-ea1c-4b0a-bc9f-7e7fa7433849 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:02.105764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-275a8b4c-ea1c-4b0a-bc9f-7e7fa7433849 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046392 Aug 08 08:53:02.106567 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 576/1121] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:02 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:02.257443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3d28367f-4b14-4b38-af35-354897c87261 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:02.258170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3d28367f-4b14-4b38-af35-354897c87261 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:02.264435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d28367f-4b14-4b38-af35-354897c87261 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:02.264912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d28367f-4b14-4b38-af35-354897c87261 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:02.265388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d28367f-4b14-4b38-af35-354897c87261 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:02.266075 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d28367f-4b14-4b38-af35-354897c87261 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:02.266527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d28367f-4b14-4b38-af35-354897c87261 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:02.266949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d28367f-4b14-4b38-af35-354897c87261 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:02.327832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3d28367f-4b14-4b38-af35-354897c87261 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:02.335262 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3d28367f-4b14-4b38-af35-354897c87261 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081695 Aug 08 08:53:02.335819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 546/1122] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:02 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:03.123246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-010bb90b-d834-49f2-ae94-03da9a3a1fae tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:03.125408 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-010bb90b-d834-49f2-ae94-03da9a3a1fae tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:03.131768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-010bb90b-d834-49f2-ae94-03da9a3a1fae tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:03.132252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-010bb90b-d834-49f2-ae94-03da9a3a1fae tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:03.132685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-010bb90b-d834-49f2-ae94-03da9a3a1fae tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:03.133558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-010bb90b-d834-49f2-ae94-03da9a3a1fae tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:03.134015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-010bb90b-d834-49f2-ae94-03da9a3a1fae tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:03.134441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-010bb90b-d834-49f2-ae94-03da9a3a1fae tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:03.162069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-010bb90b-d834-49f2-ae94-03da9a3a1fae tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 Aug 08 08:53:03.162612 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 577/1123] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:03.356924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3ec04fb6-158c-4554-9866-df2d41589829 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:03.357571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3ec04fb6-158c-4554-9866-df2d41589829 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:03.364121 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ec04fb6-158c-4554-9866-df2d41589829 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:03.364593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ec04fb6-158c-4554-9866-df2d41589829 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:03.365038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ec04fb6-158c-4554-9866-df2d41589829 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:03.365762 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ec04fb6-158c-4554-9866-df2d41589829 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:03.366224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ec04fb6-158c-4554-9866-df2d41589829 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:03.366655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ec04fb6-158c-4554-9866-df2d41589829 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:03.429454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3ec04fb6-158c-4554-9866-df2d41589829 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:03.437045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3ec04fb6-158c-4554-9866-df2d41589829 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084237 Aug 08 08:53:03.437636 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 547/1124] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:03 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:04.175639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d3ebc3a1-9770-4ae3-92fc-b1e254f17652 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:04.177812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d3ebc3a1-9770-4ae3-92fc-b1e254f17652 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:04.185018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d3ebc3a1-9770-4ae3-92fc-b1e254f17652 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:04.185549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d3ebc3a1-9770-4ae3-92fc-b1e254f17652 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:04.185990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d3ebc3a1-9770-4ae3-92fc-b1e254f17652 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:04.186692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d3ebc3a1-9770-4ae3-92fc-b1e254f17652 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:04.187152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d3ebc3a1-9770-4ae3-92fc-b1e254f17652 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:04.187583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d3ebc3a1-9770-4ae3-92fc-b1e254f17652 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:04.217099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d3ebc3a1-9770-4ae3-92fc-b1e254f17652 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045488 Aug 08 08:53:04.217687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 578/1125] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:04.457385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-99709322-3072-48bb-84d9-eb6d4f2ba1a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:04.457940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-99709322-3072-48bb-84d9-eb6d4f2ba1a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:04.464275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99709322-3072-48bb-84d9-eb6d4f2ba1a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:04.464757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99709322-3072-48bb-84d9-eb6d4f2ba1a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:04.465281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99709322-3072-48bb-84d9-eb6d4f2ba1a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:04.465962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99709322-3072-48bb-84d9-eb6d4f2ba1a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:04.466420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99709322-3072-48bb-84d9-eb6d4f2ba1a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:04.466839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99709322-3072-48bb-84d9-eb6d4f2ba1a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:04.527040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-99709322-3072-48bb-84d9-eb6d4f2ba1a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:04.534409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-99709322-3072-48bb-84d9-eb6d4f2ba1a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.080957 Aug 08 08:53:04.534966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 548/1126] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:04 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:05.230023 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-aee420c9-1e64-4659-9954-ca3448926e21 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:05.232435 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-aee420c9-1e64-4659-9954-ca3448926e21 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:05.239104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aee420c9-1e64-4659-9954-ca3448926e21 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:05.239589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aee420c9-1e64-4659-9954-ca3448926e21 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:05.240030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aee420c9-1e64-4659-9954-ca3448926e21 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:05.240726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aee420c9-1e64-4659-9954-ca3448926e21 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:05.241222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aee420c9-1e64-4659-9954-ca3448926e21 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:05.241658 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aee420c9-1e64-4659-9954-ca3448926e21 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:05.271284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-aee420c9-1e64-4659-9954-ca3448926e21 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045611 Aug 08 08:53:05.271841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 579/1127] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:05 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:05.555445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-48c99da4-350c-4c90-ace1-755c5b75a64b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:05.555973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-48c99da4-350c-4c90-ace1-755c5b75a64b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:05.562313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c99da4-350c-4c90-ace1-755c5b75a64b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:05.562800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c99da4-350c-4c90-ace1-755c5b75a64b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:05.563237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c99da4-350c-4c90-ace1-755c5b75a64b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:05.563924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c99da4-350c-4c90-ace1-755c5b75a64b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:05.564383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c99da4-350c-4c90-ace1-755c5b75a64b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:05.564810 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c99da4-350c-4c90-ace1-755c5b75a64b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:05.628351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-48c99da4-350c-4c90-ace1-755c5b75a64b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:05.636611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-48c99da4-350c-4c90-ace1-755c5b75a64b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085237 Aug 08 08:53:05.637184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 549/1128] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:05 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:06.283839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6433dadd-ceac-49e5-ad26-493c52c82ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:06.286042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6433dadd-ceac-49e5-ad26-493c52c82ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:06.292701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6433dadd-ceac-49e5-ad26-493c52c82ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:06.293216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6433dadd-ceac-49e5-ad26-493c52c82ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:06.293660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6433dadd-ceac-49e5-ad26-493c52c82ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:06.294365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6433dadd-ceac-49e5-ad26-493c52c82ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:06.294820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6433dadd-ceac-49e5-ad26-493c52c82ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:06.295244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6433dadd-ceac-49e5-ad26-493c52c82ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:06.325417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6433dadd-ceac-49e5-ad26-493c52c82ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Aug 08 08:53:06.325991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 580/1129] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:06 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:53:06.657943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-19e5427a-ebae-42f0-8131-f18a084cab0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:06.658553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-19e5427a-ebae-42f0-8131-f18a084cab0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:06.665039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e5427a-ebae-42f0-8131-f18a084cab0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:06.665559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e5427a-ebae-42f0-8131-f18a084cab0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:06.666001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e5427a-ebae-42f0-8131-f18a084cab0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:06.666702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e5427a-ebae-42f0-8131-f18a084cab0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:06.667157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e5427a-ebae-42f0-8131-f18a084cab0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:06.667587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e5427a-ebae-42f0-8131-f18a084cab0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:06.670251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:53:06.735248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-19e5427a-ebae-42f0-8131-f18a084cab0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:06.743621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-19e5427a-ebae-42f0-8131-f18a084cab0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.089485 Aug 08 08:53:06.744179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 550/1130] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:06 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:07.338351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c465962e-664c-4d6b-9ed3-3e3c7059732d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:07.340589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c465962e-664c-4d6b-9ed3-3e3c7059732d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:07.347035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c465962e-664c-4d6b-9ed3-3e3c7059732d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:07.347525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c465962e-664c-4d6b-9ed3-3e3c7059732d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:07.347965 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c465962e-664c-4d6b-9ed3-3e3c7059732d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:07.348658 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c465962e-664c-4d6b-9ed3-3e3c7059732d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:07.349118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c465962e-664c-4d6b-9ed3-3e3c7059732d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:07.349571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c465962e-664c-4d6b-9ed3-3e3c7059732d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:07.379902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c465962e-664c-4d6b-9ed3-3e3c7059732d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046329 Aug 08 08:53:07.380451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 581/1131] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:07 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:07.764225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a02b426d-3d7a-4b9b-aa3a-be25bf8debd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:07.764834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a02b426d-3d7a-4b9b-aa3a-be25bf8debd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:07.771149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a02b426d-3d7a-4b9b-aa3a-be25bf8debd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:07.771628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a02b426d-3d7a-4b9b-aa3a-be25bf8debd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:07.772061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a02b426d-3d7a-4b9b-aa3a-be25bf8debd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:07.772737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a02b426d-3d7a-4b9b-aa3a-be25bf8debd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:07.773307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a02b426d-3d7a-4b9b-aa3a-be25bf8debd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:07.774297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a02b426d-3d7a-4b9b-aa3a-be25bf8debd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:07.833332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a02b426d-3d7a-4b9b-aa3a-be25bf8debd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:07.841285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a02b426d-3d7a-4b9b-aa3a-be25bf8debd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.080869 Aug 08 08:53:07.841843 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 551/1132] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:07 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:08.392653 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-16443607-16be-46c2-9381-0b457c499089 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:08.394970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-16443607-16be-46c2-9381-0b457c499089 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:08.402627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16443607-16be-46c2-9381-0b457c499089 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:08.404641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16443607-16be-46c2-9381-0b457c499089 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:08.404641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16443607-16be-46c2-9381-0b457c499089 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:08.404641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16443607-16be-46c2-9381-0b457c499089 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:08.404946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16443607-16be-46c2-9381-0b457c499089 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:08.405240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-16443607-16be-46c2-9381-0b457c499089 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:08.434958 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-16443607-16be-46c2-9381-0b457c499089 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046341 Aug 08 08:53:08.435521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 582/1133] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:08 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:08.861758 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f5f53513-a9e5-4a8a-bf55-7e91511bbbbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:08.862309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f5f53513-a9e5-4a8a-bf55-7e91511bbbbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:08.868897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5f53513-a9e5-4a8a-bf55-7e91511bbbbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:08.869418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5f53513-a9e5-4a8a-bf55-7e91511bbbbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:08.869854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5f53513-a9e5-4a8a-bf55-7e91511bbbbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:08.870546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5f53513-a9e5-4a8a-bf55-7e91511bbbbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:08.871009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5f53513-a9e5-4a8a-bf55-7e91511bbbbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:08.871460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5f53513-a9e5-4a8a-bf55-7e91511bbbbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:08.932919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f5f53513-a9e5-4a8a-bf55-7e91511bbbbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:08.940446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f5f53513-a9e5-4a8a-bf55-7e91511bbbbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082716 Aug 08 08:53:08.941039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 552/1134] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:08 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:09.447306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-aabc262a-c67c-48cd-bc55-59d04ed055a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:09.449508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-aabc262a-c67c-48cd-bc55-59d04ed055a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:09.455876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aabc262a-c67c-48cd-bc55-59d04ed055a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:09.456363 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aabc262a-c67c-48cd-bc55-59d04ed055a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:09.456802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aabc262a-c67c-48cd-bc55-59d04ed055a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:09.457523 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aabc262a-c67c-48cd-bc55-59d04ed055a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:09.457981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aabc262a-c67c-48cd-bc55-59d04ed055a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:09.458415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aabc262a-c67c-48cd-bc55-59d04ed055a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:09.487585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-aabc262a-c67c-48cd-bc55-59d04ed055a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044310 Aug 08 08:53:09.488126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 583/1135] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:09.960524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cf2d8ead-d31f-4d02-8eb3-672cb981d219 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:09.961777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cf2d8ead-d31f-4d02-8eb3-672cb981d219 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:09.968073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf2d8ead-d31f-4d02-8eb3-672cb981d219 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:09.968558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf2d8ead-d31f-4d02-8eb3-672cb981d219 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:09.968996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf2d8ead-d31f-4d02-8eb3-672cb981d219 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:09.969721 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf2d8ead-d31f-4d02-8eb3-672cb981d219 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:09.970176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf2d8ead-d31f-4d02-8eb3-672cb981d219 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:09.970602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf2d8ead-d31f-4d02-8eb3-672cb981d219 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:10.036665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cf2d8ead-d31f-4d02-8eb3-672cb981d219 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:10.044653 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cf2d8ead-d31f-4d02-8eb3-672cb981d219 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.088041 Aug 08 08:53:10.045230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 553/1136] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:09 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:10.499351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d1c32b9e-384a-4a2c-91aa-ab4701ebe41a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:10.501541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d1c32b9e-384a-4a2c-91aa-ab4701ebe41a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:10.508448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1c32b9e-384a-4a2c-91aa-ab4701ebe41a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:10.508937 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1c32b9e-384a-4a2c-91aa-ab4701ebe41a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:10.509396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1c32b9e-384a-4a2c-91aa-ab4701ebe41a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:10.510088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1c32b9e-384a-4a2c-91aa-ab4701ebe41a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:10.510543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1c32b9e-384a-4a2c-91aa-ab4701ebe41a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:10.510967 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1c32b9e-384a-4a2c-91aa-ab4701ebe41a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:10.540075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d1c32b9e-384a-4a2c-91aa-ab4701ebe41a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044587 Aug 08 08:53:10.540565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 584/1137] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:10 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:11.065416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f5db5c1c-23e9-4047-8eaa-087f3ba2c932 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:11.066042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f5db5c1c-23e9-4047-8eaa-087f3ba2c932 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:11.073171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5db5c1c-23e9-4047-8eaa-087f3ba2c932 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:11.073668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5db5c1c-23e9-4047-8eaa-087f3ba2c932 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:11.074115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5db5c1c-23e9-4047-8eaa-087f3ba2c932 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:11.074812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5db5c1c-23e9-4047-8eaa-087f3ba2c932 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:11.075275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5db5c1c-23e9-4047-8eaa-087f3ba2c932 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:11.075708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5db5c1c-23e9-4047-8eaa-087f3ba2c932 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:11.137826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f5db5c1c-23e9-4047-8eaa-087f3ba2c932 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:11.145328 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f5db5c1c-23e9-4047-8eaa-087f3ba2c932 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083842 Aug 08 08:53:11.145892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 554/1138] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:11 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:11.551981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0654ad3b-a0b7-4bd4-b21c-0f5d9a48dea3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:11.554192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0654ad3b-a0b7-4bd4-b21c-0f5d9a48dea3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:11.561272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0654ad3b-a0b7-4bd4-b21c-0f5d9a48dea3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:11.561759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0654ad3b-a0b7-4bd4-b21c-0f5d9a48dea3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:11.562193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0654ad3b-a0b7-4bd4-b21c-0f5d9a48dea3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:11.562874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0654ad3b-a0b7-4bd4-b21c-0f5d9a48dea3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:11.563331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0654ad3b-a0b7-4bd4-b21c-0f5d9a48dea3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:11.563763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0654ad3b-a0b7-4bd4-b21c-0f5d9a48dea3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:11.591205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0654ad3b-a0b7-4bd4-b21c-0f5d9a48dea3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Aug 08 08:53:11.591750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 585/1139] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:11 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:12.166857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-eb83aa23-fc86-4eb1-8fb7-c5cac7e4da5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:12.167472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-eb83aa23-fc86-4eb1-8fb7-c5cac7e4da5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:12.173865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb83aa23-fc86-4eb1-8fb7-c5cac7e4da5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:12.174352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb83aa23-fc86-4eb1-8fb7-c5cac7e4da5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:12.174793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb83aa23-fc86-4eb1-8fb7-c5cac7e4da5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:12.175492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb83aa23-fc86-4eb1-8fb7-c5cac7e4da5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:12.175952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb83aa23-fc86-4eb1-8fb7-c5cac7e4da5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:12.176379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eb83aa23-fc86-4eb1-8fb7-c5cac7e4da5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:12.236824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-eb83aa23-fc86-4eb1-8fb7-c5cac7e4da5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:12.244644 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-eb83aa23-fc86-4eb1-8fb7-c5cac7e4da5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081656 Aug 08 08:53:12.245224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 555/1140] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:12 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:12.603799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dfe5bfe1-8ac8-483c-8e0a-29526b47fe1d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:12.606229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dfe5bfe1-8ac8-483c-8e0a-29526b47fe1d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:12.612561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfe5bfe1-8ac8-483c-8e0a-29526b47fe1d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:12.613049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfe5bfe1-8ac8-483c-8e0a-29526b47fe1d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:12.613529 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfe5bfe1-8ac8-483c-8e0a-29526b47fe1d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:12.614223 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfe5bfe1-8ac8-483c-8e0a-29526b47fe1d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:12.614680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfe5bfe1-8ac8-483c-8e0a-29526b47fe1d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:12.615107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfe5bfe1-8ac8-483c-8e0a-29526b47fe1d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:12.644262 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dfe5bfe1-8ac8-483c-8e0a-29526b47fe1d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Aug 08 08:53:12.644806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 586/1141] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:12 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:13.264845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f73b3e57-ed7c-467d-8b26-9cbd136fd80e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:13.265483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f73b3e57-ed7c-467d-8b26-9cbd136fd80e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:13.271805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f73b3e57-ed7c-467d-8b26-9cbd136fd80e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:13.272286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f73b3e57-ed7c-467d-8b26-9cbd136fd80e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:13.272723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f73b3e57-ed7c-467d-8b26-9cbd136fd80e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:13.273579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f73b3e57-ed7c-467d-8b26-9cbd136fd80e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:13.274034 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f73b3e57-ed7c-467d-8b26-9cbd136fd80e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:13.274460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f73b3e57-ed7c-467d-8b26-9cbd136fd80e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:13.334156 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f73b3e57-ed7c-467d-8b26-9cbd136fd80e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:13.341875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f73b3e57-ed7c-467d-8b26-9cbd136fd80e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.080845 Aug 08 08:53:13.342429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 556/1142] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:13 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:13.656004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-38af85ea-0d1d-43a8-8a05-a4dd5565e7b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:13.658214 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-38af85ea-0d1d-43a8-8a05-a4dd5565e7b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:13.665172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-38af85ea-0d1d-43a8-8a05-a4dd5565e7b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:13.665663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-38af85ea-0d1d-43a8-8a05-a4dd5565e7b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:13.666103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-38af85ea-0d1d-43a8-8a05-a4dd5565e7b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:13.666834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-38af85ea-0d1d-43a8-8a05-a4dd5565e7b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:13.667300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-38af85ea-0d1d-43a8-8a05-a4dd5565e7b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:13.667944 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-38af85ea-0d1d-43a8-8a05-a4dd5565e7b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:13.696691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-38af85ea-0d1d-43a8-8a05-a4dd5565e7b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044695 Aug 08 08:53:13.697274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 587/1143] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:14.362834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a130b14b-4b12-4857-8370-c8a1bdd70290 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:14.363458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a130b14b-4b12-4857-8370-c8a1bdd70290 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:14.370590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a130b14b-4b12-4857-8370-c8a1bdd70290 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:14.371079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a130b14b-4b12-4857-8370-c8a1bdd70290 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:14.371525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a130b14b-4b12-4857-8370-c8a1bdd70290 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:14.372218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a130b14b-4b12-4857-8370-c8a1bdd70290 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:14.372678 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a130b14b-4b12-4857-8370-c8a1bdd70290 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:14.373109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a130b14b-4b12-4857-8370-c8a1bdd70290 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:14.439296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a130b14b-4b12-4857-8370-c8a1bdd70290 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:14.446853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a130b14b-4b12-4857-8370-c8a1bdd70290 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.088191 Aug 08 08:53:14.447418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 557/1144] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:14 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:14.707976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1b57b51b-5f45-4a00-ae66-28829af7dd8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:14.710224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1b57b51b-5f45-4a00-ae66-28829af7dd8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:14.717094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b57b51b-5f45-4a00-ae66-28829af7dd8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:14.717605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b57b51b-5f45-4a00-ae66-28829af7dd8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:14.718065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b57b51b-5f45-4a00-ae66-28829af7dd8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:14.718749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b57b51b-5f45-4a00-ae66-28829af7dd8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:14.719201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b57b51b-5f45-4a00-ae66-28829af7dd8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:14.719622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b57b51b-5f45-4a00-ae66-28829af7dd8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:14.748532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1b57b51b-5f45-4a00-ae66-28829af7dd8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 Aug 08 08:53:14.749074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 588/1145] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:15.467448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4a176ad9-6eb2-4476-904f-07d4d941a132 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:15.468058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4a176ad9-6eb2-4476-904f-07d4d941a132 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:15.478468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a176ad9-6eb2-4476-904f-07d4d941a132 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:15.478954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a176ad9-6eb2-4476-904f-07d4d941a132 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:15.479390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a176ad9-6eb2-4476-904f-07d4d941a132 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:15.480076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a176ad9-6eb2-4476-904f-07d4d941a132 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:15.480528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a176ad9-6eb2-4476-904f-07d4d941a132 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:15.485051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a176ad9-6eb2-4476-904f-07d4d941a132 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:15.545957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4a176ad9-6eb2-4476-904f-07d4d941a132 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:15.553338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4a176ad9-6eb2-4476-904f-07d4d941a132 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.089716 Aug 08 08:53:15.553892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 558/1146] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:15 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:15.760791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-858993f5-f10e-4e9c-a3d5-4dcc72e12737 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:15.762959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-858993f5-f10e-4e9c-a3d5-4dcc72e12737 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:15.769683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-858993f5-f10e-4e9c-a3d5-4dcc72e12737 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:15.770171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-858993f5-f10e-4e9c-a3d5-4dcc72e12737 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:15.770616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-858993f5-f10e-4e9c-a3d5-4dcc72e12737 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:15.771312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-858993f5-f10e-4e9c-a3d5-4dcc72e12737 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:15.771773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-858993f5-f10e-4e9c-a3d5-4dcc72e12737 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:15.772203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-858993f5-f10e-4e9c-a3d5-4dcc72e12737 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:15.800900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-858993f5-f10e-4e9c-a3d5-4dcc72e12737 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044100 Aug 08 08:53:15.801475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 589/1147] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:15 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:16.574899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-df155113-ea6e-44ac-b551-9e0cd8b1ab59 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:16.575514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-df155113-ea6e-44ac-b551-9e0cd8b1ab59 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:16.581924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df155113-ea6e-44ac-b551-9e0cd8b1ab59 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:16.582411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df155113-ea6e-44ac-b551-9e0cd8b1ab59 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:16.582850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df155113-ea6e-44ac-b551-9e0cd8b1ab59 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:16.583538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df155113-ea6e-44ac-b551-9e0cd8b1ab59 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:16.583996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df155113-ea6e-44ac-b551-9e0cd8b1ab59 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:16.584428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df155113-ea6e-44ac-b551-9e0cd8b1ab59 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:16.644470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-df155113-ea6e-44ac-b551-9e0cd8b1ab59 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:16.652461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-df155113-ea6e-44ac-b551-9e0cd8b1ab59 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082073 Aug 08 08:53:16.653016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 559/1148] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:16 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:16.812583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-50f03ecf-facb-4ce3-80bb-48cae420deaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:16.814640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-50f03ecf-facb-4ce3-80bb-48cae420deaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:16.820946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50f03ecf-facb-4ce3-80bb-48cae420deaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:16.822069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50f03ecf-facb-4ce3-80bb-48cae420deaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:16.822521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50f03ecf-facb-4ce3-80bb-48cae420deaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:16.823204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50f03ecf-facb-4ce3-80bb-48cae420deaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:16.823661 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50f03ecf-facb-4ce3-80bb-48cae420deaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:16.824085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50f03ecf-facb-4ce3-80bb-48cae420deaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:16.853041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-50f03ecf-facb-4ce3-80bb-48cae420deaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044506 Aug 08 08:53:16.853794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 590/1149] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:17.672955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-54306631-256b-4c93-b4b0-368c3d4a6637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:17.673537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-54306631-256b-4c93-b4b0-368c3d4a6637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:17.679806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54306631-256b-4c93-b4b0-368c3d4a6637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:17.680284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54306631-256b-4c93-b4b0-368c3d4a6637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:17.680715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54306631-256b-4c93-b4b0-368c3d4a6637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:17.681454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54306631-256b-4c93-b4b0-368c3d4a6637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:17.681903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54306631-256b-4c93-b4b0-368c3d4a6637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:17.682324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54306631-256b-4c93-b4b0-368c3d4a6637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:17.742605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-54306631-256b-4c93-b4b0-368c3d4a6637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:17.750345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-54306631-256b-4c93-b4b0-368c3d4a6637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081327 Aug 08 08:53:17.750907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 560/1150] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:17 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:17.866011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ff3c1da2-0a1c-41d7-9aa1-340ea13c7bf5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:17.868136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ff3c1da2-0a1c-41d7-9aa1-340ea13c7bf5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:17.875031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff3c1da2-0a1c-41d7-9aa1-340ea13c7bf5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:17.875512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff3c1da2-0a1c-41d7-9aa1-340ea13c7bf5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:17.875946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff3c1da2-0a1c-41d7-9aa1-340ea13c7bf5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:17.876626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff3c1da2-0a1c-41d7-9aa1-340ea13c7bf5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:17.877080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff3c1da2-0a1c-41d7-9aa1-340ea13c7bf5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:17.877528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff3c1da2-0a1c-41d7-9aa1-340ea13c7bf5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:17.906097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ff3c1da2-0a1c-41d7-9aa1-340ea13c7bf5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044378 Aug 08 08:53:17.906633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 591/1151] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:17 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:18.770703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9541374a-3a65-4993-af12-4b360b5f8280 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:18.771325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9541374a-3a65-4993-af12-4b360b5f8280 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:18.778495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9541374a-3a65-4993-af12-4b360b5f8280 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:18.778983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9541374a-3a65-4993-af12-4b360b5f8280 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:18.779423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9541374a-3a65-4993-af12-4b360b5f8280 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:18.780117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9541374a-3a65-4993-af12-4b360b5f8280 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:18.780578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9541374a-3a65-4993-af12-4b360b5f8280 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:18.781009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9541374a-3a65-4993-af12-4b360b5f8280 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:18.843768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9541374a-3a65-4993-af12-4b360b5f8280 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:18.851192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9541374a-3a65-4993-af12-4b360b5f8280 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084400 Aug 08 08:53:18.851752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 561/1152] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:18 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:18.918096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-10f79e6d-3ac6-4359-9482-3955dcfb0415 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:18.920257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-10f79e6d-3ac6-4359-9482-3955dcfb0415 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:18.926607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10f79e6d-3ac6-4359-9482-3955dcfb0415 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:18.927098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10f79e6d-3ac6-4359-9482-3955dcfb0415 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:18.927537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10f79e6d-3ac6-4359-9482-3955dcfb0415 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:18.928231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10f79e6d-3ac6-4359-9482-3955dcfb0415 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:18.928689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10f79e6d-3ac6-4359-9482-3955dcfb0415 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:18.929120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10f79e6d-3ac6-4359-9482-3955dcfb0415 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:18.945837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:53:18.958192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-10f79e6d-3ac6-4359-9482-3955dcfb0415 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Aug 08 08:53:18.958676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 592/1153] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:18 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:19.872869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4e131812-b534-4012-bf03-6d447473c14d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:19.873516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4e131812-b534-4012-bf03-6d447473c14d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:19.879888 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e131812-b534-4012-bf03-6d447473c14d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:19.880378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e131812-b534-4012-bf03-6d447473c14d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:19.880820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e131812-b534-4012-bf03-6d447473c14d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:19.881560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e131812-b534-4012-bf03-6d447473c14d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:19.882026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e131812-b534-4012-bf03-6d447473c14d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:19.882458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e131812-b534-4012-bf03-6d447473c14d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:19.943870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4e131812-b534-4012-bf03-6d447473c14d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:19.952151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4e131812-b534-4012-bf03-6d447473c14d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083921 Aug 08 08:53:19.952652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 562/1154] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:19 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:19.976312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2f5b84f0-6789-4b82-b8c9-9707a53ba354 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:19.978569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2f5b84f0-6789-4b82-b8c9-9707a53ba354 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:19.985371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5b84f0-6789-4b82-b8c9-9707a53ba354 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:19.985860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5b84f0-6789-4b82-b8c9-9707a53ba354 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:19.986297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5b84f0-6789-4b82-b8c9-9707a53ba354 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:19.986990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5b84f0-6789-4b82-b8c9-9707a53ba354 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:19.987483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5b84f0-6789-4b82-b8c9-9707a53ba354 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:19.987962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5b84f0-6789-4b82-b8c9-9707a53ba354 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:20.017242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2f5b84f0-6789-4b82-b8c9-9707a53ba354 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045290 Aug 08 08:53:20.017773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 593/1155] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:20.972512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-22e3d139-c38a-4f03-90a4-aabb233ae5d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:20.973113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-22e3d139-c38a-4f03-90a4-aabb233ae5d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:20.980279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22e3d139-c38a-4f03-90a4-aabb233ae5d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:20.980768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22e3d139-c38a-4f03-90a4-aabb233ae5d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:20.981525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22e3d139-c38a-4f03-90a4-aabb233ae5d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:20.982224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22e3d139-c38a-4f03-90a4-aabb233ae5d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:20.982684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22e3d139-c38a-4f03-90a4-aabb233ae5d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:20.983140 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22e3d139-c38a-4f03-90a4-aabb233ae5d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:21.030042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e1623af3-86a5-446b-a82b-2b6b72f44050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:21.032315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e1623af3-86a5-446b-a82b-2b6b72f44050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:21.038616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e1623af3-86a5-446b-a82b-2b6b72f44050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:21.039367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e1623af3-86a5-446b-a82b-2b6b72f44050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:21.039561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e1623af3-86a5-446b-a82b-2b6b72f44050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:21.040266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e1623af3-86a5-446b-a82b-2b6b72f44050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:21.040730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e1623af3-86a5-446b-a82b-2b6b72f44050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:21.041181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e1623af3-86a5-446b-a82b-2b6b72f44050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:21.047609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-22e3d139-c38a-4f03-90a4-aabb233ae5d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:21.055063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-22e3d139-c38a-4f03-90a4-aabb233ae5d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086408 Aug 08 08:53:21.055841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 563/1156] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:20 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:21.070731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e1623af3-86a5-446b-a82b-2b6b72f44050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045241 Aug 08 08:53:21.071291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 594/1157] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:21 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:53:22.075857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4e75bbff-669f-4696-93ea-129325f69f5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:22.076391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4e75bbff-669f-4696-93ea-129325f69f5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:22.082868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e75bbff-669f-4696-93ea-129325f69f5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:22.083224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7d770f20-48e3-4b04-aea8-4f0e1016943b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:22.083629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e75bbff-669f-4696-93ea-129325f69f5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:22.083772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e75bbff-669f-4696-93ea-129325f69f5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:22.084467 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e75bbff-669f-4696-93ea-129325f69f5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:22.084923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e75bbff-669f-4696-93ea-129325f69f5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:22.085389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4e75bbff-669f-4696-93ea-129325f69f5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:22.085495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7d770f20-48e3-4b04-aea8-4f0e1016943b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:22.092291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d770f20-48e3-4b04-aea8-4f0e1016943b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:22.092777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d770f20-48e3-4b04-aea8-4f0e1016943b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:22.093234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d770f20-48e3-4b04-aea8-4f0e1016943b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:22.093926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d770f20-48e3-4b04-aea8-4f0e1016943b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:22.094382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d770f20-48e3-4b04-aea8-4f0e1016943b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:22.094803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7d770f20-48e3-4b04-aea8-4f0e1016943b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:22.124739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7d770f20-48e3-4b04-aea8-4f0e1016943b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Aug 08 08:53:22.125335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 595/1158] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:53:22.146007 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4e75bbff-669f-4696-93ea-129325f69f5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:22.154320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4e75bbff-669f-4696-93ea-129325f69f5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082390 Aug 08 08:53:22.154888 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 564/1159] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:22 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:23.137606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ddcc1755-5d2d-4180-9031-a10f2b3bfd47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:23.139787 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ddcc1755-5d2d-4180-9031-a10f2b3bfd47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:23.146116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ddcc1755-5d2d-4180-9031-a10f2b3bfd47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:23.146598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ddcc1755-5d2d-4180-9031-a10f2b3bfd47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:23.147030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ddcc1755-5d2d-4180-9031-a10f2b3bfd47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:23.147715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ddcc1755-5d2d-4180-9031-a10f2b3bfd47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:23.148167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ddcc1755-5d2d-4180-9031-a10f2b3bfd47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:23.148591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ddcc1755-5d2d-4180-9031-a10f2b3bfd47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:23.175931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f0d9c249-fe0e-4ef7-bff5-63cee1810f69 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:23.176541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ddcc1755-5d2d-4180-9031-a10f2b3bfd47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043487 Aug 08 08:53:23.176659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f0d9c249-fe0e-4ef7-bff5-63cee1810f69 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:23.177096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 596/1160] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:23.183639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d9c249-fe0e-4ef7-bff5-63cee1810f69 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:23.184133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d9c249-fe0e-4ef7-bff5-63cee1810f69 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:23.184580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d9c249-fe0e-4ef7-bff5-63cee1810f69 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:23.185348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d9c249-fe0e-4ef7-bff5-63cee1810f69 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:23.185813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d9c249-fe0e-4ef7-bff5-63cee1810f69 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:23.186247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d9c249-fe0e-4ef7-bff5-63cee1810f69 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:23.251724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f0d9c249-fe0e-4ef7-bff5-63cee1810f69 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:23.259180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f0d9c249-fe0e-4ef7-bff5-63cee1810f69 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.087731 Aug 08 08:53:23.259860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 565/1161] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:23 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:53:24.188807 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bdbe200e-898a-42d2-8596-297b3b51da0e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:24.191019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bdbe200e-898a-42d2-8596-297b3b51da0e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:24.198274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdbe200e-898a-42d2-8596-297b3b51da0e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:24.198764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdbe200e-898a-42d2-8596-297b3b51da0e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:24.199204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdbe200e-898a-42d2-8596-297b3b51da0e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:24.199903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdbe200e-898a-42d2-8596-297b3b51da0e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:24.200365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdbe200e-898a-42d2-8596-297b3b51da0e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:24.200795 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdbe200e-898a-42d2-8596-297b3b51da0e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:24.231452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bdbe200e-898a-42d2-8596-297b3b51da0e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046413 Aug 08 08:53:24.232010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 597/1162] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:24 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:24.280355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f76f86e5-cc44-4cd7-af4f-ea4ddde316b9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:24.280963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f76f86e5-cc44-4cd7-af4f-ea4ddde316b9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:24.287312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f76f86e5-cc44-4cd7-af4f-ea4ddde316b9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:24.287790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f76f86e5-cc44-4cd7-af4f-ea4ddde316b9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:24.288232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f76f86e5-cc44-4cd7-af4f-ea4ddde316b9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:24.288912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f76f86e5-cc44-4cd7-af4f-ea4ddde316b9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:24.289402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f76f86e5-cc44-4cd7-af4f-ea4ddde316b9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:24.289825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f76f86e5-cc44-4cd7-af4f-ea4ddde316b9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:24.350151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f76f86e5-cc44-4cd7-af4f-ea4ddde316b9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:24.352267 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:53:24.358350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f76f86e5-cc44-4cd7-af4f-ea4ddde316b9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081757 Aug 08 08:53:24.358905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 566/1163] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:24 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:24.978949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 08:53:24.979214 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 08:53:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 08:53:25.243997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6b08c286-b36b-488f-9af5-fc14fdf5323b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:25.246285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6b08c286-b36b-488f-9af5-fc14fdf5323b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:25.253883 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b08c286-b36b-488f-9af5-fc14fdf5323b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:25.254371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b08c286-b36b-488f-9af5-fc14fdf5323b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:25.254811 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b08c286-b36b-488f-9af5-fc14fdf5323b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:25.255517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b08c286-b36b-488f-9af5-fc14fdf5323b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:25.255980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b08c286-b36b-488f-9af5-fc14fdf5323b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:25.256412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b08c286-b36b-488f-9af5-fc14fdf5323b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:25.285692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6b08c286-b36b-488f-9af5-fc14fdf5323b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Aug 08 08:53:25.286242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 598/1164] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:25.379081 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ca8c4a91-bcf5-40b5-aef8-e1ebb82fa9e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:25.379723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ca8c4a91-bcf5-40b5-aef8-e1ebb82fa9e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:25.386587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a91-bcf5-40b5-aef8-e1ebb82fa9e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:25.387062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a91-bcf5-40b5-aef8-e1ebb82fa9e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:25.387496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a91-bcf5-40b5-aef8-e1ebb82fa9e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:25.388180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a91-bcf5-40b5-aef8-e1ebb82fa9e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:25.388631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a91-bcf5-40b5-aef8-e1ebb82fa9e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:25.389058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a91-bcf5-40b5-aef8-e1ebb82fa9e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:25.449360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ca8c4a91-bcf5-40b5-aef8-e1ebb82fa9e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:25.456652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ca8c4a91-bcf5-40b5-aef8-e1ebb82fa9e1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081413 Aug 08 08:53:25.457233 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 567/1165] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:25 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:26.297969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-726a1459-2528-43f4-a683-4bccfcb936e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:26.300106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-726a1459-2528-43f4-a683-4bccfcb936e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:26.307096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-726a1459-2528-43f4-a683-4bccfcb936e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:26.307577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-726a1459-2528-43f4-a683-4bccfcb936e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:26.308009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-726a1459-2528-43f4-a683-4bccfcb936e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:26.308700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-726a1459-2528-43f4-a683-4bccfcb936e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:26.309174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-726a1459-2528-43f4-a683-4bccfcb936e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:26.309606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-726a1459-2528-43f4-a683-4bccfcb936e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:26.336924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-726a1459-2528-43f4-a683-4bccfcb936e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 Aug 08 08:53:26.337565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 599/1166] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:26.477894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c062b025-00e8-416c-a023-f3680529407c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:26.479077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c062b025-00e8-416c-a023-f3680529407c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:26.485379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c062b025-00e8-416c-a023-f3680529407c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:26.485864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c062b025-00e8-416c-a023-f3680529407c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:26.486308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c062b025-00e8-416c-a023-f3680529407c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:26.487000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c062b025-00e8-416c-a023-f3680529407c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:26.487456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c062b025-00e8-416c-a023-f3680529407c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:26.487884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c062b025-00e8-416c-a023-f3680529407c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:26.548285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c062b025-00e8-416c-a023-f3680529407c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:26.555657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c062b025-00e8-416c-a023-f3680529407c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081756 Aug 08 08:53:26.556846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 568/1167] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:26 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:53:27.349309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6e6d1b88-7247-4e45-9bbc-6c9a4776827f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:27.351493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6e6d1b88-7247-4e45-9bbc-6c9a4776827f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:27.358253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e6d1b88-7247-4e45-9bbc-6c9a4776827f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:27.358737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e6d1b88-7247-4e45-9bbc-6c9a4776827f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:27.359177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e6d1b88-7247-4e45-9bbc-6c9a4776827f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:27.359869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e6d1b88-7247-4e45-9bbc-6c9a4776827f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:27.360401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e6d1b88-7247-4e45-9bbc-6c9a4776827f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:27.360838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e6d1b88-7247-4e45-9bbc-6c9a4776827f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:27.390562 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6e6d1b88-7247-4e45-9bbc-6c9a4776827f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045284 Aug 08 08:53:27.391108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 600/1168] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:27 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:27.576366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-945125b8-1586-44c6-8649-48aa1adb8196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:27.576945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-945125b8-1586-44c6-8649-48aa1adb8196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:27.583412 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-945125b8-1586-44c6-8649-48aa1adb8196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:27.583896 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-945125b8-1586-44c6-8649-48aa1adb8196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:27.584339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-945125b8-1586-44c6-8649-48aa1adb8196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:27.585030 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-945125b8-1586-44c6-8649-48aa1adb8196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:27.585518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-945125b8-1586-44c6-8649-48aa1adb8196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:27.585972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-945125b8-1586-44c6-8649-48aa1adb8196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:27.649611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-945125b8-1586-44c6-8649-48aa1adb8196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:27.657381 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-945125b8-1586-44c6-8649-48aa1adb8196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085485 Aug 08 08:53:27.657945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 569/1169] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:27 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:28.403530 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-220a1749-645d-4ebb-9a05-c6b7f2876f4c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:28.405732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-220a1749-645d-4ebb-9a05-c6b7f2876f4c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:28.412284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220a1749-645d-4ebb-9a05-c6b7f2876f4c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:28.412807 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220a1749-645d-4ebb-9a05-c6b7f2876f4c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:28.413307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220a1749-645d-4ebb-9a05-c6b7f2876f4c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:28.414037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220a1749-645d-4ebb-9a05-c6b7f2876f4c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:28.414480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220a1749-645d-4ebb-9a05-c6b7f2876f4c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:28.414966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220a1749-645d-4ebb-9a05-c6b7f2876f4c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:28.445307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-220a1749-645d-4ebb-9a05-c6b7f2876f4c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046359 Aug 08 08:53:28.445862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 601/1170] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:28 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:28.552565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 08:53:28.552755 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 08:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 08:53:28.677629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d773c170-8760-4865-b580-d80eea988e0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:28.678247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d773c170-8760-4865-b580-d80eea988e0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:28.684501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773c170-8760-4865-b580-d80eea988e0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:28.684981 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773c170-8760-4865-b580-d80eea988e0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:28.685450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773c170-8760-4865-b580-d80eea988e0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:28.686134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773c170-8760-4865-b580-d80eea988e0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:28.686586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773c170-8760-4865-b580-d80eea988e0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:28.687009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773c170-8760-4865-b580-d80eea988e0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:28.751632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d773c170-8760-4865-b580-d80eea988e0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:28.758986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d773c170-8760-4865-b580-d80eea988e0f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085231 Aug 08 08:53:28.760159 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 570/1171] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:28 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:53:29.457576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-952b4f21-6dee-482c-8217-4940b4c8bbaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:29.459756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-952b4f21-6dee-482c-8217-4940b4c8bbaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:29.466604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-952b4f21-6dee-482c-8217-4940b4c8bbaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:29.467087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-952b4f21-6dee-482c-8217-4940b4c8bbaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:29.467520 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-952b4f21-6dee-482c-8217-4940b4c8bbaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:29.468205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-952b4f21-6dee-482c-8217-4940b4c8bbaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:29.468657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-952b4f21-6dee-482c-8217-4940b4c8bbaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:29.469078 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-952b4f21-6dee-482c-8217-4940b4c8bbaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:29.498200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-952b4f21-6dee-482c-8217-4940b4c8bbaf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 Aug 08 08:53:29.498738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 602/1172] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:29 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:29.780511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-28964b8e-16cb-4289-8249-e3826dac0724 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:29.781124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-28964b8e-16cb-4289-8249-e3826dac0724 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:29.787471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28964b8e-16cb-4289-8249-e3826dac0724 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:29.787958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28964b8e-16cb-4289-8249-e3826dac0724 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:29.788406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28964b8e-16cb-4289-8249-e3826dac0724 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:29.789096 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28964b8e-16cb-4289-8249-e3826dac0724 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:29.789582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28964b8e-16cb-4289-8249-e3826dac0724 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:29.790011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28964b8e-16cb-4289-8249-e3826dac0724 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:29.850851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-28964b8e-16cb-4289-8249-e3826dac0724 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:29.858708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-28964b8e-16cb-4289-8249-e3826dac0724 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082097 Aug 08 08:53:29.859269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 571/1173] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:29 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:53:30.510512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f0132e64-0028-4993-9410-6cc7736efbbe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:30.512578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f0132e64-0028-4993-9410-6cc7736efbbe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:30.518954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0132e64-0028-4993-9410-6cc7736efbbe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:30.519438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0132e64-0028-4993-9410-6cc7736efbbe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:30.519870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0132e64-0028-4993-9410-6cc7736efbbe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:30.520554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0132e64-0028-4993-9410-6cc7736efbbe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:30.521010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0132e64-0028-4993-9410-6cc7736efbbe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:30.521458 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f0132e64-0028-4993-9410-6cc7736efbbe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:30.549774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f0132e64-0028-4993-9410-6cc7736efbbe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043414 Aug 08 08:53:30.550343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 603/1174] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:30 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:30.878692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5b659982-3628-438f-b33c-35241f854582 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:30.879311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5b659982-3628-438f-b33c-35241f854582 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:30.885954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b659982-3628-438f-b33c-35241f854582 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:30.886444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b659982-3628-438f-b33c-35241f854582 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:30.886889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b659982-3628-438f-b33c-35241f854582 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:30.887585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b659982-3628-438f-b33c-35241f854582 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:30.888044 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b659982-3628-438f-b33c-35241f854582 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:30.888474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b659982-3628-438f-b33c-35241f854582 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:30.953333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5b659982-3628-438f-b33c-35241f854582 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:30.960750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5b659982-3628-438f-b33c-35241f854582 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085893 Aug 08 08:53:30.961404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 572/1175] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:30 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:31.561793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3e64c987-8fae-49dd-8283-44f6c6685714 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:31.563970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3e64c987-8fae-49dd-8283-44f6c6685714 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:31.570409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e64c987-8fae-49dd-8283-44f6c6685714 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:31.570899 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e64c987-8fae-49dd-8283-44f6c6685714 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:31.571340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e64c987-8fae-49dd-8283-44f6c6685714 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:31.572763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e64c987-8fae-49dd-8283-44f6c6685714 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:31.573277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e64c987-8fae-49dd-8283-44f6c6685714 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:31.573711 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e64c987-8fae-49dd-8283-44f6c6685714 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:31.601540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3e64c987-8fae-49dd-8283-44f6c6685714 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043631 Aug 08 08:53:31.602082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 604/1176] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:31 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:31.983829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-05fb0709-536f-438e-bd22-cec11a356a81 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:31.983829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-05fb0709-536f-438e-bd22-cec11a356a81 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:31.985411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=56 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:53:31.990637 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05fb0709-536f-438e-bd22-cec11a356a81 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:31.991120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05fb0709-536f-438e-bd22-cec11a356a81 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:31.991565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05fb0709-536f-438e-bd22-cec11a356a81 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:31.992252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05fb0709-536f-438e-bd22-cec11a356a81 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:31.992706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05fb0709-536f-438e-bd22-cec11a356a81 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:31.993132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05fb0709-536f-438e-bd22-cec11a356a81 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:32.058978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-05fb0709-536f-438e-bd22-cec11a356a81 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:32.066423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-05fb0709-536f-438e-bd22-cec11a356a81 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.088603 Aug 08 08:53:32.066972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 573/1177] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:31 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:32.613703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-abfb4ef6-b78d-45f8-8fd8-69d520b98111 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:32.615853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-abfb4ef6-b78d-45f8-8fd8-69d520b98111 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:32.618158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=58 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:53:32.622786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abfb4ef6-b78d-45f8-8fd8-69d520b98111 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:32.623276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abfb4ef6-b78d-45f8-8fd8-69d520b98111 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:32.623715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abfb4ef6-b78d-45f8-8fd8-69d520b98111 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:32.624403 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abfb4ef6-b78d-45f8-8fd8-69d520b98111 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:32.624861 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abfb4ef6-b78d-45f8-8fd8-69d520b98111 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:32.625429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abfb4ef6-b78d-45f8-8fd8-69d520b98111 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:32.653922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-abfb4ef6-b78d-45f8-8fd8-69d520b98111 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 Aug 08 08:53:32.654503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 605/1178] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:33.087302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-efdc8e93-ff8a-4441-8904-4d19d95c9edb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:33.088008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-efdc8e93-ff8a-4441-8904-4d19d95c9edb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:33.094836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-efdc8e93-ff8a-4441-8904-4d19d95c9edb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:33.095324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-efdc8e93-ff8a-4441-8904-4d19d95c9edb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:33.095764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-efdc8e93-ff8a-4441-8904-4d19d95c9edb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:33.096457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-efdc8e93-ff8a-4441-8904-4d19d95c9edb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:33.096915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-efdc8e93-ff8a-4441-8904-4d19d95c9edb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:33.097375 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-efdc8e93-ff8a-4441-8904-4d19d95c9edb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:33.158212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-efdc8e93-ff8a-4441-8904-4d19d95c9edb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:33.165529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-efdc8e93-ff8a-4441-8904-4d19d95c9edb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082126 Aug 08 08:53:33.166086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 574/1179] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:33 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:33.666927 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-258bf412-03f1-4d0a-9201-ef2c595dfb00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:33.669111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-258bf412-03f1-4d0a-9201-ef2c595dfb00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:33.675251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258bf412-03f1-4d0a-9201-ef2c595dfb00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:33.675734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258bf412-03f1-4d0a-9201-ef2c595dfb00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:33.676166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258bf412-03f1-4d0a-9201-ef2c595dfb00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:33.676868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258bf412-03f1-4d0a-9201-ef2c595dfb00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:33.677331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258bf412-03f1-4d0a-9201-ef2c595dfb00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:33.677757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258bf412-03f1-4d0a-9201-ef2c595dfb00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:33.705570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-258bf412-03f1-4d0a-9201-ef2c595dfb00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043043 Aug 08 08:53:33.706114 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 606/1180] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:33 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:34.186376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8c502b5d-2b4d-451e-8e12-0fe9e7bd80d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:34.187071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8c502b5d-2b4d-451e-8e12-0fe9e7bd80d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:34.193483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c502b5d-2b4d-451e-8e12-0fe9e7bd80d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:34.193972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c502b5d-2b4d-451e-8e12-0fe9e7bd80d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:34.194440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c502b5d-2b4d-451e-8e12-0fe9e7bd80d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:34.195134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c502b5d-2b4d-451e-8e12-0fe9e7bd80d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:34.195588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c502b5d-2b4d-451e-8e12-0fe9e7bd80d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:34.196012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c502b5d-2b4d-451e-8e12-0fe9e7bd80d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:34.258366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8c502b5d-2b4d-451e-8e12-0fe9e7bd80d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:34.266720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8c502b5d-2b4d-451e-8e12-0fe9e7bd80d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084074 Aug 08 08:53:34.267304 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 575/1181] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:34 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:34.718289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-eed79e58-ce4c-446a-a683-a07cb827db18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:34.720474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-eed79e58-ce4c-446a-a683-a07cb827db18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:34.726844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed79e58-ce4c-446a-a683-a07cb827db18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:34.727333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed79e58-ce4c-446a-a683-a07cb827db18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:34.728399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed79e58-ce4c-446a-a683-a07cb827db18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:34.729165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed79e58-ce4c-446a-a683-a07cb827db18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:34.729632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed79e58-ce4c-446a-a683-a07cb827db18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:34.730082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed79e58-ce4c-446a-a683-a07cb827db18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:34.758256 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-eed79e58-ce4c-446a-a683-a07cb827db18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Aug 08 08:53:34.758799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 607/1182] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:35.287365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-80e1a24d-f97e-444f-825f-a84792c78ce5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:35.287984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-80e1a24d-f97e-444f-825f-a84792c78ce5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:35.294528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80e1a24d-f97e-444f-825f-a84792c78ce5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:35.295010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80e1a24d-f97e-444f-825f-a84792c78ce5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:35.295448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80e1a24d-f97e-444f-825f-a84792c78ce5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:35.296133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80e1a24d-f97e-444f-825f-a84792c78ce5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:35.296590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80e1a24d-f97e-444f-825f-a84792c78ce5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:35.297017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80e1a24d-f97e-444f-825f-a84792c78ce5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:35.361915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-80e1a24d-f97e-444f-825f-a84792c78ce5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:35.369849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-80e1a24d-f97e-444f-825f-a84792c78ce5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086354 Aug 08 08:53:35.370402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 576/1183] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:35 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:35.770579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-37645dec-1ebc-4c2a-9ec1-7013f7f34e95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:35.772719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-37645dec-1ebc-4c2a-9ec1-7013f7f34e95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:35.779135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37645dec-1ebc-4c2a-9ec1-7013f7f34e95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:35.779617 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37645dec-1ebc-4c2a-9ec1-7013f7f34e95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:35.780051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37645dec-1ebc-4c2a-9ec1-7013f7f34e95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:35.780738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37645dec-1ebc-4c2a-9ec1-7013f7f34e95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:35.781215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37645dec-1ebc-4c2a-9ec1-7013f7f34e95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:35.781641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-37645dec-1ebc-4c2a-9ec1-7013f7f34e95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:35.810633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-37645dec-1ebc-4c2a-9ec1-7013f7f34e95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Aug 08 08:53:35.811174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 608/1184] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:35 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:36.390089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3ecf54e5-e8b3-4a3d-a57f-c51341f798d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:36.390723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3ecf54e5-e8b3-4a3d-a57f-c51341f798d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:36.397120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ecf54e5-e8b3-4a3d-a57f-c51341f798d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:36.397622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ecf54e5-e8b3-4a3d-a57f-c51341f798d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:36.398057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ecf54e5-e8b3-4a3d-a57f-c51341f798d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:36.398735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ecf54e5-e8b3-4a3d-a57f-c51341f798d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:36.399184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ecf54e5-e8b3-4a3d-a57f-c51341f798d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:36.400137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ecf54e5-e8b3-4a3d-a57f-c51341f798d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:36.463832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3ecf54e5-e8b3-4a3d-a57f-c51341f798d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:36.471364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3ecf54e5-e8b3-4a3d-a57f-c51341f798d2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085052 Aug 08 08:53:36.471923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 577/1185] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:36 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:36.823492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f2f53eae-d5b0-4acb-b716-d6fed0fb4e89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:36.825620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f2f53eae-d5b0-4acb-b716-d6fed0fb4e89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:36.831951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2f53eae-d5b0-4acb-b716-d6fed0fb4e89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:36.832436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2f53eae-d5b0-4acb-b716-d6fed0fb4e89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:36.832873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2f53eae-d5b0-4acb-b716-d6fed0fb4e89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:36.833594 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2f53eae-d5b0-4acb-b716-d6fed0fb4e89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:36.834051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2f53eae-d5b0-4acb-b716-d6fed0fb4e89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:36.834480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2f53eae-d5b0-4acb-b716-d6fed0fb4e89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:36.838348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:53:36.863200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f2f53eae-d5b0-4acb-b716-d6fed0fb4e89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Aug 08 08:53:36.863742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 609/1186] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:37.491736 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c212ce29-17ae-424b-91b6-aa81ff44259a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:37.492338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c212ce29-17ae-424b-91b6-aa81ff44259a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:37.499675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c212ce29-17ae-424b-91b6-aa81ff44259a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:37.500178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c212ce29-17ae-424b-91b6-aa81ff44259a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:37.500585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c212ce29-17ae-424b-91b6-aa81ff44259a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:37.501299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c212ce29-17ae-424b-91b6-aa81ff44259a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:37.501750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c212ce29-17ae-424b-91b6-aa81ff44259a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:37.502170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c212ce29-17ae-424b-91b6-aa81ff44259a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:37.562596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c212ce29-17ae-424b-91b6-aa81ff44259a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:37.569952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c212ce29-17ae-424b-91b6-aa81ff44259a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082066 Aug 08 08:53:37.570497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 578/1187] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:37 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:37.875392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4cfb8b54-14fc-4508-ac4a-8aeec9a01b87 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:37.877585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4cfb8b54-14fc-4508-ac4a-8aeec9a01b87 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:37.884606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfb8b54-14fc-4508-ac4a-8aeec9a01b87 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:37.885096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfb8b54-14fc-4508-ac4a-8aeec9a01b87 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:37.885569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfb8b54-14fc-4508-ac4a-8aeec9a01b87 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:37.886267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfb8b54-14fc-4508-ac4a-8aeec9a01b87 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:37.886730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfb8b54-14fc-4508-ac4a-8aeec9a01b87 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:37.887162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfb8b54-14fc-4508-ac4a-8aeec9a01b87 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:37.916012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4cfb8b54-14fc-4508-ac4a-8aeec9a01b87 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043953 Aug 08 08:53:37.916584 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 610/1188] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:37 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:38.591053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a5eeba62-83cf-4917-870e-4a7398701bf7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:38.591657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a5eeba62-83cf-4917-870e-4a7398701bf7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:38.597904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5eeba62-83cf-4917-870e-4a7398701bf7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:38.598380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5eeba62-83cf-4917-870e-4a7398701bf7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:38.598839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5eeba62-83cf-4917-870e-4a7398701bf7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:38.599514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5eeba62-83cf-4917-870e-4a7398701bf7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:38.599969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5eeba62-83cf-4917-870e-4a7398701bf7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:38.600391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5eeba62-83cf-4917-870e-4a7398701bf7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:38.661001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a5eeba62-83cf-4917-870e-4a7398701bf7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:38.669073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a5eeba62-83cf-4917-870e-4a7398701bf7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082305 Aug 08 08:53:38.669587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 579/1189] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:38 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:38.928236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-daf7dac6-fca5-4226-931f-2c59a9e00158 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:38.930334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-daf7dac6-fca5-4226-931f-2c59a9e00158 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:38.937381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-daf7dac6-fca5-4226-931f-2c59a9e00158 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:38.937870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-daf7dac6-fca5-4226-931f-2c59a9e00158 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:38.938309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-daf7dac6-fca5-4226-931f-2c59a9e00158 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:38.939001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-daf7dac6-fca5-4226-931f-2c59a9e00158 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:38.939512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-daf7dac6-fca5-4226-931f-2c59a9e00158 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:38.939942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-daf7dac6-fca5-4226-931f-2c59a9e00158 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:38.967992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-daf7dac6-fca5-4226-931f-2c59a9e00158 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Aug 08 08:53:38.968541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 611/1190] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:38 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:39.689368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-252a6346-631c-47ec-b920-755468c668b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:39.689985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-252a6346-631c-47ec-b920-755468c668b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:39.696925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-252a6346-631c-47ec-b920-755468c668b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:39.697608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-252a6346-631c-47ec-b920-755468c668b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:39.698053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-252a6346-631c-47ec-b920-755468c668b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:39.698751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-252a6346-631c-47ec-b920-755468c668b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:39.699207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-252a6346-631c-47ec-b920-755468c668b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:39.699634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-252a6346-631c-47ec-b920-755468c668b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:39.762550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-252a6346-631c-47ec-b920-755468c668b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:39.770044 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-252a6346-631c-47ec-b920-755468c668b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084597 Aug 08 08:53:39.773765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 580/1191] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:39 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:39.980225 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-97e4727f-f57c-4f25-b10a-036d7f8598fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:39.982672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-97e4727f-f57c-4f25-b10a-036d7f8598fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:39.989047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97e4727f-f57c-4f25-b10a-036d7f8598fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:39.989566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97e4727f-f57c-4f25-b10a-036d7f8598fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:39.990005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97e4727f-f57c-4f25-b10a-036d7f8598fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:39.990697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97e4727f-f57c-4f25-b10a-036d7f8598fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:39.991158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97e4727f-f57c-4f25-b10a-036d7f8598fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:39.991593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97e4727f-f57c-4f25-b10a-036d7f8598fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:40.020809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-97e4727f-f57c-4f25-b10a-036d7f8598fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044695 Aug 08 08:53:40.021381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 612/1192] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:39 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:40.792106 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9e177a02-2ad8-4ec2-b3b5-74962b3e024c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:40.792737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9e177a02-2ad8-4ec2-b3b5-74962b3e024c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:40.799050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e177a02-2ad8-4ec2-b3b5-74962b3e024c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:40.799532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e177a02-2ad8-4ec2-b3b5-74962b3e024c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:40.799967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e177a02-2ad8-4ec2-b3b5-74962b3e024c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:40.800647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e177a02-2ad8-4ec2-b3b5-74962b3e024c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:40.801099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e177a02-2ad8-4ec2-b3b5-74962b3e024c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:40.801544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9e177a02-2ad8-4ec2-b3b5-74962b3e024c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:40.864464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9e177a02-2ad8-4ec2-b3b5-74962b3e024c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:40.871908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9e177a02-2ad8-4ec2-b3b5-74962b3e024c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084257 Aug 08 08:53:40.872465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 581/1193] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:40 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:41.032927 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c347a8b8-546a-4d2f-8fde-b1db3b3b4237 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:41.035139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c347a8b8-546a-4d2f-8fde-b1db3b3b4237 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:41.041614 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c347a8b8-546a-4d2f-8fde-b1db3b3b4237 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:41.042179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c347a8b8-546a-4d2f-8fde-b1db3b3b4237 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:41.042544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c347a8b8-546a-4d2f-8fde-b1db3b3b4237 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:41.043239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c347a8b8-546a-4d2f-8fde-b1db3b3b4237 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:41.043698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c347a8b8-546a-4d2f-8fde-b1db3b3b4237 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:41.044128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c347a8b8-546a-4d2f-8fde-b1db3b3b4237 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:41.073514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c347a8b8-546a-4d2f-8fde-b1db3b3b4237 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044548 Aug 08 08:53:41.074079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 613/1194] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:41 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:41.892013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-72f98027-ca47-4d06-9eaa-f2374b4970d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:41.892625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-72f98027-ca47-4d06-9eaa-f2374b4970d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:41.898994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72f98027-ca47-4d06-9eaa-f2374b4970d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:41.899559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72f98027-ca47-4d06-9eaa-f2374b4970d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:41.900018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72f98027-ca47-4d06-9eaa-f2374b4970d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:41.900730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72f98027-ca47-4d06-9eaa-f2374b4970d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:41.901204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72f98027-ca47-4d06-9eaa-f2374b4970d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:41.901634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72f98027-ca47-4d06-9eaa-f2374b4970d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:41.962904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-72f98027-ca47-4d06-9eaa-f2374b4970d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:41.970239 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-72f98027-ca47-4d06-9eaa-f2374b4970d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082090 Aug 08 08:53:41.970789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 582/1195] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:41 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:53:42.084744 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-36bf5a9f-8420-4f4c-bb77-381283e01382 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:42.087461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-36bf5a9f-8420-4f4c-bb77-381283e01382 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:42.093868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36bf5a9f-8420-4f4c-bb77-381283e01382 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:42.094354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36bf5a9f-8420-4f4c-bb77-381283e01382 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:42.094793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36bf5a9f-8420-4f4c-bb77-381283e01382 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:42.095485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36bf5a9f-8420-4f4c-bb77-381283e01382 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:42.095944 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36bf5a9f-8420-4f4c-bb77-381283e01382 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:42.096371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36bf5a9f-8420-4f4c-bb77-381283e01382 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:42.125528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-36bf5a9f-8420-4f4c-bb77-381283e01382 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Aug 08 08:53:42.126078 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 614/1196] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:42 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:42.991832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-86067f93-f58e-4728-8124-71f0b7db5c9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:42.992473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-86067f93-f58e-4728-8124-71f0b7db5c9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:42.999605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86067f93-f58e-4728-8124-71f0b7db5c9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:43.000082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86067f93-f58e-4728-8124-71f0b7db5c9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:43.000514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86067f93-f58e-4728-8124-71f0b7db5c9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:43.001217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86067f93-f58e-4728-8124-71f0b7db5c9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:43.001666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86067f93-f58e-4728-8124-71f0b7db5c9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:43.002089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86067f93-f58e-4728-8124-71f0b7db5c9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:43.019095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:53:43.064579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-86067f93-f58e-4728-8124-71f0b7db5c9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:43.072460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-86067f93-f58e-4728-8124-71f0b7db5c9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084476 Aug 08 08:53:43.073011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 583/1197] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:42 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:43.137504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5eca57a8-9483-4155-a010-baff92964cfd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:43.139730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5eca57a8-9483-4155-a010-baff92964cfd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:43.146121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5eca57a8-9483-4155-a010-baff92964cfd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:43.146609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5eca57a8-9483-4155-a010-baff92964cfd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:43.147053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5eca57a8-9483-4155-a010-baff92964cfd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:43.147751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5eca57a8-9483-4155-a010-baff92964cfd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:43.148210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5eca57a8-9483-4155-a010-baff92964cfd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:43.148641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5eca57a8-9483-4155-a010-baff92964cfd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:43.176922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5eca57a8-9483-4155-a010-baff92964cfd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043852 Aug 08 08:53:43.177503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 615/1198] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:44.093417 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a5c494dd-6662-4f96-a974-883eec682c2d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:44.093956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a5c494dd-6662-4f96-a974-883eec682c2d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:44.100265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c494dd-6662-4f96-a974-883eec682c2d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:44.100744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c494dd-6662-4f96-a974-883eec682c2d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:44.101197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c494dd-6662-4f96-a974-883eec682c2d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:44.101885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c494dd-6662-4f96-a974-883eec682c2d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:44.102341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c494dd-6662-4f96-a974-883eec682c2d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:44.103255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c494dd-6662-4f96-a974-883eec682c2d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:44.164421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a5c494dd-6662-4f96-a974-883eec682c2d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:44.172474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a5c494dd-6662-4f96-a974-883eec682c2d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083129 Aug 08 08:53:44.173028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 584/1199] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:44 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:44.188788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ff5807fe-c92f-4d9b-8669-7e2c96c61a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:44.191006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ff5807fe-c92f-4d9b-8669-7e2c96c61a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:44.197552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff5807fe-c92f-4d9b-8669-7e2c96c61a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:44.198035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff5807fe-c92f-4d9b-8669-7e2c96c61a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:44.198468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff5807fe-c92f-4d9b-8669-7e2c96c61a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:44.199158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff5807fe-c92f-4d9b-8669-7e2c96c61a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:44.199611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff5807fe-c92f-4d9b-8669-7e2c96c61a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:44.200032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff5807fe-c92f-4d9b-8669-7e2c96c61a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:44.228539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ff5807fe-c92f-4d9b-8669-7e2c96c61a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043560 Aug 08 08:53:44.229103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 616/1200] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:45.193579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1c76137e-508c-42d0-a520-75a296e94ec3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:45.194194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1c76137e-508c-42d0-a520-75a296e94ec3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:45.201280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c76137e-508c-42d0-a520-75a296e94ec3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:45.201766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c76137e-508c-42d0-a520-75a296e94ec3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:45.202207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c76137e-508c-42d0-a520-75a296e94ec3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:45.202905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c76137e-508c-42d0-a520-75a296e94ec3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:45.203398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c76137e-508c-42d0-a520-75a296e94ec3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:45.203820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1c76137e-508c-42d0-a520-75a296e94ec3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:45.240853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-64b0550f-f72f-48d6-9dee-f0c8fcec3d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:45.243654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-64b0550f-f72f-48d6-9dee-f0c8fcec3d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:45.250264 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64b0550f-f72f-48d6-9dee-f0c8fcec3d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:45.250755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64b0550f-f72f-48d6-9dee-f0c8fcec3d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:45.251190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64b0550f-f72f-48d6-9dee-f0c8fcec3d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:45.251890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64b0550f-f72f-48d6-9dee-f0c8fcec3d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:45.252350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64b0550f-f72f-48d6-9dee-f0c8fcec3d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:45.252781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64b0550f-f72f-48d6-9dee-f0c8fcec3d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:45.268166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1c76137e-508c-42d0-a520-75a296e94ec3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:45.275967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1c76137e-508c-42d0-a520-75a296e94ec3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086183 Aug 08 08:53:45.276541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 585/1201] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:45 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:45.282940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-64b0550f-f72f-48d6-9dee-f0c8fcec3d0a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 Aug 08 08:53:45.283488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 617/1202] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:53:46.294909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-13de1e98-e94a-4c47-9a60-b1cee5b8ec2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:46.295581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4ed0fabf-8265-4a5f-8fd2-d229fe2b13a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:46.296198 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4ed0fabf-8265-4a5f-8fd2-d229fe2b13a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:46.297133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-13de1e98-e94a-4c47-9a60-b1cee5b8ec2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:46.302728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ed0fabf-8265-4a5f-8fd2-d229fe2b13a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:46.303220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ed0fabf-8265-4a5f-8fd2-d229fe2b13a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:46.303660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ed0fabf-8265-4a5f-8fd2-d229fe2b13a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:46.303848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13de1e98-e94a-4c47-9a60-b1cee5b8ec2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:46.304306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13de1e98-e94a-4c47-9a60-b1cee5b8ec2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:46.304440 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ed0fabf-8265-4a5f-8fd2-d229fe2b13a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:46.304745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13de1e98-e94a-4c47-9a60-b1cee5b8ec2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:46.304864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ed0fabf-8265-4a5f-8fd2-d229fe2b13a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:46.305257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4ed0fabf-8265-4a5f-8fd2-d229fe2b13a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:46.305476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13de1e98-e94a-4c47-9a60-b1cee5b8ec2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:46.305967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13de1e98-e94a-4c47-9a60-b1cee5b8ec2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:46.306568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13de1e98-e94a-4c47-9a60-b1cee5b8ec2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:46.336244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-13de1e98-e94a-4c47-9a60-b1cee5b8ec2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Aug 08 08:53:46.337550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 586/1203] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:46 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:46.368821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4ed0fabf-8265-4a5f-8fd2-d229fe2b13a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:46.376425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4ed0fabf-8265-4a5f-8fd2-d229fe2b13a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084632 Aug 08 08:53:46.376984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 618/1204] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:46 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:53:47.348756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-49e15c65-de34-4922-82fe-c50b24fa52a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:47.350908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-49e15c65-de34-4922-82fe-c50b24fa52a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:47.358820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49e15c65-de34-4922-82fe-c50b24fa52a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:47.363119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49e15c65-de34-4922-82fe-c50b24fa52a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:47.363119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49e15c65-de34-4922-82fe-c50b24fa52a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:47.363119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49e15c65-de34-4922-82fe-c50b24fa52a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:47.363119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49e15c65-de34-4922-82fe-c50b24fa52a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:47.363489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49e15c65-de34-4922-82fe-c50b24fa52a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:47.388643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-49e15c65-de34-4922-82fe-c50b24fa52a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Aug 08 08:53:47.389201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 587/1205] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:47.396580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-eacec72a-268a-45c0-b370-4250e721a90b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:47.397256 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-eacec72a-268a-45c0-b370-4250e721a90b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:47.404273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eacec72a-268a-45c0-b370-4250e721a90b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:47.404757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eacec72a-268a-45c0-b370-4250e721a90b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:47.405224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eacec72a-268a-45c0-b370-4250e721a90b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:47.405923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eacec72a-268a-45c0-b370-4250e721a90b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:47.406386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eacec72a-268a-45c0-b370-4250e721a90b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:47.406814 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eacec72a-268a-45c0-b370-4250e721a90b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:47.470378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-eacec72a-268a-45c0-b370-4250e721a90b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:47.478671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-eacec72a-268a-45c0-b370-4250e721a90b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085991 Aug 08 08:53:47.479231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 619/1206] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:47 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:48.401416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8f1a912d-d750-4648-9965-fdcbd596610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:48.403722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8f1a912d-d750-4648-9965-fdcbd596610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:48.410223 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f1a912d-d750-4648-9965-fdcbd596610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:48.410709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f1a912d-d750-4648-9965-fdcbd596610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:48.411184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f1a912d-d750-4648-9965-fdcbd596610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:48.411887 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f1a912d-d750-4648-9965-fdcbd596610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:48.412352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f1a912d-d750-4648-9965-fdcbd596610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:48.412774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f1a912d-d750-4648-9965-fdcbd596610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:48.442440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8f1a912d-d750-4648-9965-fdcbd596610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045487 Aug 08 08:53:48.442991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 588/1207] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:48.498964 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b91d75bb-7921-4b3a-931e-03ceea2b7a9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:48.499571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b91d75bb-7921-4b3a-931e-03ceea2b7a9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:48.505923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b91d75bb-7921-4b3a-931e-03ceea2b7a9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:48.506405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b91d75bb-7921-4b3a-931e-03ceea2b7a9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:48.506837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b91d75bb-7921-4b3a-931e-03ceea2b7a9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:48.507554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b91d75bb-7921-4b3a-931e-03ceea2b7a9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:48.508004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b91d75bb-7921-4b3a-931e-03ceea2b7a9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:48.508467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b91d75bb-7921-4b3a-931e-03ceea2b7a9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:48.568630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b91d75bb-7921-4b3a-931e-03ceea2b7a9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:48.576478 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b91d75bb-7921-4b3a-931e-03ceea2b7a9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081326 Aug 08 08:53:48.577037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 620/1208] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:48 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:49.455176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d218e9c9-5fcd-4258-b2ee-c07efe9532f5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:49.457355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d218e9c9-5fcd-4258-b2ee-c07efe9532f5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:49.464513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d218e9c9-5fcd-4258-b2ee-c07efe9532f5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:49.464988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d218e9c9-5fcd-4258-b2ee-c07efe9532f5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:49.465449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d218e9c9-5fcd-4258-b2ee-c07efe9532f5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:49.466130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d218e9c9-5fcd-4258-b2ee-c07efe9532f5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:49.466577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d218e9c9-5fcd-4258-b2ee-c07efe9532f5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:49.466997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d218e9c9-5fcd-4258-b2ee-c07efe9532f5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:49.494990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d218e9c9-5fcd-4258-b2ee-c07efe9532f5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043750 Aug 08 08:53:49.495525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 589/1209] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:49.596862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-96af040a-03f7-4f24-9b70-ad1527b986a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:49.597505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-96af040a-03f7-4f24-9b70-ad1527b986a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:49.604116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96af040a-03f7-4f24-9b70-ad1527b986a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:49.604665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96af040a-03f7-4f24-9b70-ad1527b986a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:49.605107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96af040a-03f7-4f24-9b70-ad1527b986a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:49.605832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96af040a-03f7-4f24-9b70-ad1527b986a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:49.606289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96af040a-03f7-4f24-9b70-ad1527b986a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:49.606982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-96af040a-03f7-4f24-9b70-ad1527b986a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:49.674364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-96af040a-03f7-4f24-9b70-ad1527b986a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:49.682976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-96af040a-03f7-4f24-9b70-ad1527b986a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.089913 Aug 08 08:53:49.683546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 621/1210] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:49 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:50.506917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b287da9f-7452-4076-a89d-1399eccce6fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:50.509233 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b287da9f-7452-4076-a89d-1399eccce6fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:50.515486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b287da9f-7452-4076-a89d-1399eccce6fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:50.515958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b287da9f-7452-4076-a89d-1399eccce6fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:50.516388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b287da9f-7452-4076-a89d-1399eccce6fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:50.517063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b287da9f-7452-4076-a89d-1399eccce6fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:50.517535 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b287da9f-7452-4076-a89d-1399eccce6fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:50.517956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b287da9f-7452-4076-a89d-1399eccce6fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:50.546259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b287da9f-7452-4076-a89d-1399eccce6fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Aug 08 08:53:50.546790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 590/1211] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:50 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:50.703212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1117ffe4-9d67-461b-aaf0-28fdaef63e0a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:50.703832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1117ffe4-9d67-461b-aaf0-28fdaef63e0a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:50.710416 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1117ffe4-9d67-461b-aaf0-28fdaef63e0a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:50.710935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1117ffe4-9d67-461b-aaf0-28fdaef63e0a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:50.711374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1117ffe4-9d67-461b-aaf0-28fdaef63e0a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:50.712775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1117ffe4-9d67-461b-aaf0-28fdaef63e0a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:50.713279 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1117ffe4-9d67-461b-aaf0-28fdaef63e0a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:50.713763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1117ffe4-9d67-461b-aaf0-28fdaef63e0a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:50.773083 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1117ffe4-9d67-461b-aaf0-28fdaef63e0a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:50.781270 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1117ffe4-9d67-461b-aaf0-28fdaef63e0a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081922 Aug 08 08:53:50.781839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 622/1212] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:50 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:51.559227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e7dbc17e-82e5-470e-969c-0a5fbdd35ba3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:51.561363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e7dbc17e-82e5-470e-969c-0a5fbdd35ba3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:51.567659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7dbc17e-82e5-470e-969c-0a5fbdd35ba3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:51.568137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7dbc17e-82e5-470e-969c-0a5fbdd35ba3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:51.568567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7dbc17e-82e5-470e-969c-0a5fbdd35ba3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:51.569273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7dbc17e-82e5-470e-969c-0a5fbdd35ba3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:51.569721 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7dbc17e-82e5-470e-969c-0a5fbdd35ba3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:51.570141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7dbc17e-82e5-470e-969c-0a5fbdd35ba3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:51.598190 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e7dbc17e-82e5-470e-969c-0a5fbdd35ba3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043683 Aug 08 08:53:51.598730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 591/1213] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:51 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:51.801438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a87c868e-bf5c-4d59-9f7e-537521e59efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:51.802052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a87c868e-bf5c-4d59-9f7e-537521e59efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:51.808777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87c868e-bf5c-4d59-9f7e-537521e59efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:51.809332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87c868e-bf5c-4d59-9f7e-537521e59efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:51.809719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87c868e-bf5c-4d59-9f7e-537521e59efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:51.810407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87c868e-bf5c-4d59-9f7e-537521e59efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:51.810868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87c868e-bf5c-4d59-9f7e-537521e59efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:51.811295 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87c868e-bf5c-4d59-9f7e-537521e59efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:51.873288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a87c868e-bf5c-4d59-9f7e-537521e59efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:51.879238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a87c868e-bf5c-4d59-9f7e-537521e59efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081729 Aug 08 08:53:51.879809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 623/1214] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:51 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:52.611147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-88d1ba94-1ad6-4bfb-acd4-55e25e94b39f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:52.613267 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-88d1ba94-1ad6-4bfb-acd4-55e25e94b39f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:52.620235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88d1ba94-1ad6-4bfb-acd4-55e25e94b39f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:52.620719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88d1ba94-1ad6-4bfb-acd4-55e25e94b39f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:52.621186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88d1ba94-1ad6-4bfb-acd4-55e25e94b39f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:52.621876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88d1ba94-1ad6-4bfb-acd4-55e25e94b39f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:52.622336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88d1ba94-1ad6-4bfb-acd4-55e25e94b39f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:52.622763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88d1ba94-1ad6-4bfb-acd4-55e25e94b39f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:52.653011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-88d1ba94-1ad6-4bfb-acd4-55e25e94b39f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046118 Aug 08 08:53:52.653591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 592/1215] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:52 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:52.899126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-53d73065-2b93-4654-a92b-5fad47677c04 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:52.900242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-53d73065-2b93-4654-a92b-5fad47677c04 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:52.906682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53d73065-2b93-4654-a92b-5fad47677c04 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:52.907163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53d73065-2b93-4654-a92b-5fad47677c04 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:52.907594 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53d73065-2b93-4654-a92b-5fad47677c04 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:52.908277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53d73065-2b93-4654-a92b-5fad47677c04 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:52.908728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53d73065-2b93-4654-a92b-5fad47677c04 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:52.909173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53d73065-2b93-4654-a92b-5fad47677c04 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:52.972469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-53d73065-2b93-4654-a92b-5fad47677c04 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:52.980452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-53d73065-2b93-4654-a92b-5fad47677c04 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085290 Aug 08 08:53:52.981002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 624/1216] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:52 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:53.665355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e7543369-ca64-4356-b0fd-c56bc17665b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:53.667581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e7543369-ca64-4356-b0fd-c56bc17665b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:53.673939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7543369-ca64-4356-b0fd-c56bc17665b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:53.674416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7543369-ca64-4356-b0fd-c56bc17665b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:53.674898 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7543369-ca64-4356-b0fd-c56bc17665b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:53.675602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7543369-ca64-4356-b0fd-c56bc17665b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:53.676055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7543369-ca64-4356-b0fd-c56bc17665b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:53.676825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7543369-ca64-4356-b0fd-c56bc17665b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:53.706171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e7543369-ca64-4356-b0fd-c56bc17665b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Aug 08 08:53:53.706722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 593/1217] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:53 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:54.002038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-eb4cc7bb-f9ea-4682-9e1a-980710796de1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:54.002565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-eb4cc7bb-f9ea-4682-9e1a-980710796de1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:54.009702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb4cc7bb-f9ea-4682-9e1a-980710796de1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:54.010198 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb4cc7bb-f9ea-4682-9e1a-980710796de1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:54.010643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb4cc7bb-f9ea-4682-9e1a-980710796de1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:54.011338 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb4cc7bb-f9ea-4682-9e1a-980710796de1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:54.011800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb4cc7bb-f9ea-4682-9e1a-980710796de1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:54.012231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb4cc7bb-f9ea-4682-9e1a-980710796de1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:54.073767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-eb4cc7bb-f9ea-4682-9e1a-980710796de1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:54.078085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:53:54.083057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-eb4cc7bb-f9ea-4682-9e1a-980710796de1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084982 Aug 08 08:53:54.083623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 625/1218] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:53 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:54.718576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fa84468a-87fa-4c87-8273-d3048f030a9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:54.720630 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fa84468a-87fa-4c87-8273-d3048f030a9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:54.727610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa84468a-87fa-4c87-8273-d3048f030a9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:54.728107 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa84468a-87fa-4c87-8273-d3048f030a9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:54.728611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa84468a-87fa-4c87-8273-d3048f030a9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:54.729331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa84468a-87fa-4c87-8273-d3048f030a9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:54.729785 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa84468a-87fa-4c87-8273-d3048f030a9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:54.730209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa84468a-87fa-4c87-8273-d3048f030a9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:54.759288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fa84468a-87fa-4c87-8273-d3048f030a9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Aug 08 08:53:54.759819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 594/1219] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:54 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:55.104499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-938b87ae-1c59-404c-be58-4421e728e469 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:55.105042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-938b87ae-1c59-404c-be58-4421e728e469 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:55.111730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-938b87ae-1c59-404c-be58-4421e728e469 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:55.112217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-938b87ae-1c59-404c-be58-4421e728e469 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:55.112657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-938b87ae-1c59-404c-be58-4421e728e469 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:55.113381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-938b87ae-1c59-404c-be58-4421e728e469 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:55.113842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-938b87ae-1c59-404c-be58-4421e728e469 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:55.114269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-938b87ae-1c59-404c-be58-4421e728e469 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:55.174694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-938b87ae-1c59-404c-be58-4421e728e469 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:55.182779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-938b87ae-1c59-404c-be58-4421e728e469 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082826 Aug 08 08:53:55.183396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 626/1220] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:55 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:55.771446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bb84d101-2c5c-42a9-bb26-f565cbdc68c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:55.773604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bb84d101-2c5c-42a9-bb26-f565cbdc68c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:55.780475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb84d101-2c5c-42a9-bb26-f565cbdc68c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:55.780984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb84d101-2c5c-42a9-bb26-f565cbdc68c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:55.781461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb84d101-2c5c-42a9-bb26-f565cbdc68c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:55.782148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb84d101-2c5c-42a9-bb26-f565cbdc68c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:55.782603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb84d101-2c5c-42a9-bb26-f565cbdc68c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:55.783031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb84d101-2c5c-42a9-bb26-f565cbdc68c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:55.811279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bb84d101-2c5c-42a9-bb26-f565cbdc68c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Aug 08 08:53:55.811815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 595/1221] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:56.203303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6d0884d9-56c4-4c82-bb29-31cdc81c4038 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:56.203917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6d0884d9-56c4-4c82-bb29-31cdc81c4038 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:56.210312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d0884d9-56c4-4c82-bb29-31cdc81c4038 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:56.210797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d0884d9-56c4-4c82-bb29-31cdc81c4038 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:56.211240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d0884d9-56c4-4c82-bb29-31cdc81c4038 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:56.212571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d0884d9-56c4-4c82-bb29-31cdc81c4038 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:56.213031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d0884d9-56c4-4c82-bb29-31cdc81c4038 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:56.213484 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d0884d9-56c4-4c82-bb29-31cdc81c4038 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:56.273602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6d0884d9-56c4-4c82-bb29-31cdc81c4038 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:56.281579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6d0884d9-56c4-4c82-bb29-31cdc81c4038 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082164 Aug 08 08:53:56.282145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 627/1222] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:56 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:56.824006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8e34e455-110d-4564-8ca0-5146d27a7943 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:56.826200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8e34e455-110d-4564-8ca0-5146d27a7943 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:56.832235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e34e455-110d-4564-8ca0-5146d27a7943 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:56.832722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e34e455-110d-4564-8ca0-5146d27a7943 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:56.833172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e34e455-110d-4564-8ca0-5146d27a7943 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:56.833858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e34e455-110d-4564-8ca0-5146d27a7943 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:56.834306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e34e455-110d-4564-8ca0-5146d27a7943 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:56.834727 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e34e455-110d-4564-8ca0-5146d27a7943 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:56.862962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8e34e455-110d-4564-8ca0-5146d27a7943 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043512 Aug 08 08:53:56.863502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 596/1223] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:57.302462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6b717206-12ff-49e1-b10c-6182228b3dbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:57.303072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6b717206-12ff-49e1-b10c-6182228b3dbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:57.310212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b717206-12ff-49e1-b10c-6182228b3dbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:57.310698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b717206-12ff-49e1-b10c-6182228b3dbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:57.311139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b717206-12ff-49e1-b10c-6182228b3dbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:57.311829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b717206-12ff-49e1-b10c-6182228b3dbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:57.312286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b717206-12ff-49e1-b10c-6182228b3dbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:57.312712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b717206-12ff-49e1-b10c-6182228b3dbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:57.379321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6b717206-12ff-49e1-b10c-6182228b3dbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:57.387769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6b717206-12ff-49e1-b10c-6182228b3dbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.089233 Aug 08 08:53:57.388330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 628/1224] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:57 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:57.874820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-65170ff1-9421-42aa-80f2-257ebbf9c1ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:57.876945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-65170ff1-9421-42aa-80f2-257ebbf9c1ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:57.883449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65170ff1-9421-42aa-80f2-257ebbf9c1ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:57.883926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65170ff1-9421-42aa-80f2-257ebbf9c1ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:57.884354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65170ff1-9421-42aa-80f2-257ebbf9c1ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:57.885032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65170ff1-9421-42aa-80f2-257ebbf9c1ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:57.885503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65170ff1-9421-42aa-80f2-257ebbf9c1ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:57.885929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65170ff1-9421-42aa-80f2-257ebbf9c1ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:57.913596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-65170ff1-9421-42aa-80f2-257ebbf9c1ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042683 Aug 08 08:53:57.914132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 597/1225] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:57 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:58.408307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d9ce78a1-908c-4493-95ba-0b58cb096ddc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:58.408925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d9ce78a1-908c-4493-95ba-0b58cb096ddc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:58.415576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9ce78a1-908c-4493-95ba-0b58cb096ddc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:58.416063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9ce78a1-908c-4493-95ba-0b58cb096ddc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:58.416558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9ce78a1-908c-4493-95ba-0b58cb096ddc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:58.417353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9ce78a1-908c-4493-95ba-0b58cb096ddc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:58.418336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9ce78a1-908c-4493-95ba-0b58cb096ddc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:58.418336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9ce78a1-908c-4493-95ba-0b58cb096ddc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:58.479147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d9ce78a1-908c-4493-95ba-0b58cb096ddc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:58.486905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d9ce78a1-908c-4493-95ba-0b58cb096ddc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082515 Aug 08 08:53:58.487981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 629/1226] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:58 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:58.926466 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9ea6408c-3b08-4b85-813a-e5087bf5e2b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:58.928681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9ea6408c-3b08-4b85-813a-e5087bf5e2b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:58.935094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea6408c-3b08-4b85-813a-e5087bf5e2b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:58.935578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea6408c-3b08-4b85-813a-e5087bf5e2b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:58.936014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea6408c-3b08-4b85-813a-e5087bf5e2b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:58.936698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea6408c-3b08-4b85-813a-e5087bf5e2b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:58.937175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea6408c-3b08-4b85-813a-e5087bf5e2b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:58.937616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea6408c-3b08-4b85-813a-e5087bf5e2b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:58.966274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9ea6408c-3b08-4b85-813a-e5087bf5e2b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Aug 08 08:53:58.966819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 598/1227] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:53:59.507619 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d2ccb0cc-3b01-48b9-b81d-f2140a7934c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:59.508282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d2ccb0cc-3b01-48b9-b81d-f2140a7934c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:59.514794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ccb0cc-3b01-48b9-b81d-f2140a7934c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:59.515282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ccb0cc-3b01-48b9-b81d-f2140a7934c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:59.515722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ccb0cc-3b01-48b9-b81d-f2140a7934c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:59.516419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ccb0cc-3b01-48b9-b81d-f2140a7934c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:59.516877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ccb0cc-3b01-48b9-b81d-f2140a7934c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:59.517367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d2ccb0cc-3b01-48b9-b81d-f2140a7934c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:59.580741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d2ccb0cc-3b01-48b9-b81d-f2140a7934c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:53:59.588853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d2ccb0cc-3b01-48b9-b81d-f2140a7934c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085074 Aug 08 08:53:59.589447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 630/1228] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:53:59 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:53:59.978587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b44a95f8-824b-4b41-8851-f376136c76d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:53:59.980665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b44a95f8-824b-4b41-8851-f376136c76d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:53:59.987332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b44a95f8-824b-4b41-8851-f376136c76d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:59.987811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b44a95f8-824b-4b41-8851-f376136c76d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:59.988243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b44a95f8-824b-4b41-8851-f376136c76d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:53:59.988926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b44a95f8-824b-4b41-8851-f376136c76d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:53:59.989408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b44a95f8-824b-4b41-8851-f376136c76d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:53:59.989830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b44a95f8-824b-4b41-8851-f376136c76d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:00.018291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b44a95f8-824b-4b41-8851-f376136c76d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044384 Aug 08 08:54:00.018833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 599/1229] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:53:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:00.610208 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ecbde594-f1d9-495d-933e-17be733dbc35 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:00.610812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ecbde594-f1d9-495d-933e-17be733dbc35 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:00.617130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecbde594-f1d9-495d-933e-17be733dbc35 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:00.617890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecbde594-f1d9-495d-933e-17be733dbc35 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:00.618316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecbde594-f1d9-495d-933e-17be733dbc35 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:00.619176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecbde594-f1d9-495d-933e-17be733dbc35 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:00.619634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecbde594-f1d9-495d-933e-17be733dbc35 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:00.620059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecbde594-f1d9-495d-933e-17be733dbc35 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:00.683189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ecbde594-f1d9-495d-933e-17be733dbc35 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:00.690616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ecbde594-f1d9-495d-933e-17be733dbc35 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084617 Aug 08 08:54:00.691177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 631/1230] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:00 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:01.030698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8513068c-0a2a-40ef-89bb-fb4ed893d3d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:01.032755 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8513068c-0a2a-40ef-89bb-fb4ed893d3d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:01.039093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8513068c-0a2a-40ef-89bb-fb4ed893d3d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:01.039636 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8513068c-0a2a-40ef-89bb-fb4ed893d3d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:01.040076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8513068c-0a2a-40ef-89bb-fb4ed893d3d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:01.040760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8513068c-0a2a-40ef-89bb-fb4ed893d3d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:01.041316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8513068c-0a2a-40ef-89bb-fb4ed893d3d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:01.041763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8513068c-0a2a-40ef-89bb-fb4ed893d3d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:01.044041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:54:01.070575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8513068c-0a2a-40ef-89bb-fb4ed893d3d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043917 Aug 08 08:54:01.071711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 600/1231] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:01 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:01.712083 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b3932a8c-2498-4ccf-a829-b2dec57cedd3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:01.712699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b3932a8c-2498-4ccf-a829-b2dec57cedd3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:01.719304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3932a8c-2498-4ccf-a829-b2dec57cedd3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:01.720270 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3932a8c-2498-4ccf-a829-b2dec57cedd3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:01.720706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3932a8c-2498-4ccf-a829-b2dec57cedd3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:01.721427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3932a8c-2498-4ccf-a829-b2dec57cedd3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:01.721886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3932a8c-2498-4ccf-a829-b2dec57cedd3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:01.722308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3932a8c-2498-4ccf-a829-b2dec57cedd3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:01.786239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b3932a8c-2498-4ccf-a829-b2dec57cedd3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:01.794370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b3932a8c-2498-4ccf-a829-b2dec57cedd3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086702 Aug 08 08:54:01.794924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 632/1232] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:01 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:02.083704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-94a712f1-cf41-4e2a-9e4c-652ff24a1885 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:02.085760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-94a712f1-cf41-4e2a-9e4c-652ff24a1885 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:02.088727 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=56 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:54:02.093503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94a712f1-cf41-4e2a-9e4c-652ff24a1885 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:02.093977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94a712f1-cf41-4e2a-9e4c-652ff24a1885 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:02.094408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94a712f1-cf41-4e2a-9e4c-652ff24a1885 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:02.095082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94a712f1-cf41-4e2a-9e4c-652ff24a1885 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:02.095536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94a712f1-cf41-4e2a-9e4c-652ff24a1885 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:02.095956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94a712f1-cf41-4e2a-9e4c-652ff24a1885 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:02.124264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-94a712f1-cf41-4e2a-9e4c-652ff24a1885 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Aug 08 08:54:02.124806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 601/1233] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:02 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:02.814980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5da8a44d-17c8-4ff3-abeb-de6f10e6f3d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:02.815509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5da8a44d-17c8-4ff3-abeb-de6f10e6f3d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:02.821840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5da8a44d-17c8-4ff3-abeb-de6f10e6f3d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:02.822316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5da8a44d-17c8-4ff3-abeb-de6f10e6f3d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:02.822746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5da8a44d-17c8-4ff3-abeb-de6f10e6f3d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:02.823429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5da8a44d-17c8-4ff3-abeb-de6f10e6f3d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:02.823884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5da8a44d-17c8-4ff3-abeb-de6f10e6f3d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:02.824304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5da8a44d-17c8-4ff3-abeb-de6f10e6f3d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:02.884339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5da8a44d-17c8-4ff3-abeb-de6f10e6f3d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:02.891747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5da8a44d-17c8-4ff3-abeb-de6f10e6f3d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.080736 Aug 08 08:54:02.892294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 633/1234] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:02 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:03.136869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4f6cc231-9a15-4dcb-8fd4-c9e2a372a5a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:03.139037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4f6cc231-9a15-4dcb-8fd4-c9e2a372a5a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:03.145328 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f6cc231-9a15-4dcb-8fd4-c9e2a372a5a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:03.145811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f6cc231-9a15-4dcb-8fd4-c9e2a372a5a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:03.146250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f6cc231-9a15-4dcb-8fd4-c9e2a372a5a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:03.146934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f6cc231-9a15-4dcb-8fd4-c9e2a372a5a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:03.147390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f6cc231-9a15-4dcb-8fd4-c9e2a372a5a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:03.147816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f6cc231-9a15-4dcb-8fd4-c9e2a372a5a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:03.176659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4f6cc231-9a15-4dcb-8fd4-c9e2a372a5a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Aug 08 08:54:03.177219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 602/1235] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:03.912147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6653ac59-daf8-4092-a522-f4e1dbdf6e12 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:03.914731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6653ac59-daf8-4092-a522-f4e1dbdf6e12 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:03.915231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=58 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:54:03.920121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6653ac59-daf8-4092-a522-f4e1dbdf6e12 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:03.920645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6653ac59-daf8-4092-a522-f4e1dbdf6e12 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:03.921082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6653ac59-daf8-4092-a522-f4e1dbdf6e12 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:03.921806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6653ac59-daf8-4092-a522-f4e1dbdf6e12 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:03.922257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6653ac59-daf8-4092-a522-f4e1dbdf6e12 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:03.922679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6653ac59-daf8-4092-a522-f4e1dbdf6e12 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:03.984401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6653ac59-daf8-4092-a522-f4e1dbdf6e12 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:03.991869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6653ac59-daf8-4092-a522-f4e1dbdf6e12 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083906 Aug 08 08:54:03.992929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 634/1236] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:03 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:04.187856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f65ddb04-8bc4-42f2-a686-a17c53013b61 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:04.190063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f65ddb04-8bc4-42f2-a686-a17c53013b61 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:04.197100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f65ddb04-8bc4-42f2-a686-a17c53013b61 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:04.197627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f65ddb04-8bc4-42f2-a686-a17c53013b61 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:04.198041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f65ddb04-8bc4-42f2-a686-a17c53013b61 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:04.198720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f65ddb04-8bc4-42f2-a686-a17c53013b61 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:04.199169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f65ddb04-8bc4-42f2-a686-a17c53013b61 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:04.199596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f65ddb04-8bc4-42f2-a686-a17c53013b61 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:04.230948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f65ddb04-8bc4-42f2-a686-a17c53013b61 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046955 Aug 08 08:54:04.231490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 603/1237] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:05.012965 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-20e45513-3f33-484a-8493-613acbce1336 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:05.019150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-20e45513-3f33-484a-8493-613acbce1336 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:05.020373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20e45513-3f33-484a-8493-613acbce1336 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:05.020859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20e45513-3f33-484a-8493-613acbce1336 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:05.021334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20e45513-3f33-484a-8493-613acbce1336 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:05.022023 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20e45513-3f33-484a-8493-613acbce1336 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:05.022508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20e45513-3f33-484a-8493-613acbce1336 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:05.022931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20e45513-3f33-484a-8493-613acbce1336 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:05.086151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-20e45513-3f33-484a-8493-613acbce1336 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:05.093778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-20e45513-3f33-484a-8493-613acbce1336 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084609 Aug 08 08:54:05.094332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 635/1238] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:05 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:05.249327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b4cd47dd-b438-43d3-a985-89fd6a89549b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:05.251579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b4cd47dd-b438-43d3-a985-89fd6a89549b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:05.257903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4cd47dd-b438-43d3-a985-89fd6a89549b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:05.258399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4cd47dd-b438-43d3-a985-89fd6a89549b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:05.258833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4cd47dd-b438-43d3-a985-89fd6a89549b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:05.259512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4cd47dd-b438-43d3-a985-89fd6a89549b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:05.259962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4cd47dd-b438-43d3-a985-89fd6a89549b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:05.260384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4cd47dd-b438-43d3-a985-89fd6a89549b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:05.288767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b4cd47dd-b438-43d3-a985-89fd6a89549b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Aug 08 08:54:05.289739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 604/1239] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:05 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:06.115193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4d978329-60a9-4806-9b0b-9816187a8fb3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:06.115823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4d978329-60a9-4806-9b0b-9816187a8fb3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:06.122380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d978329-60a9-4806-9b0b-9816187a8fb3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:06.122866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d978329-60a9-4806-9b0b-9816187a8fb3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:06.123302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d978329-60a9-4806-9b0b-9816187a8fb3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:06.123998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d978329-60a9-4806-9b0b-9816187a8fb3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:06.124457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d978329-60a9-4806-9b0b-9816187a8fb3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:06.124881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4d978329-60a9-4806-9b0b-9816187a8fb3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:06.187875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4d978329-60a9-4806-9b0b-9816187a8fb3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:06.195299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4d978329-60a9-4806-9b0b-9816187a8fb3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084005 Aug 08 08:54:06.196039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 636/1240] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:06 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:06.301447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0b516af3-2058-4d1b-a7f2-cac41a05977e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:06.303578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0b516af3-2058-4d1b-a7f2-cac41a05977e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:06.311515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b516af3-2058-4d1b-a7f2-cac41a05977e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:06.312003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b516af3-2058-4d1b-a7f2-cac41a05977e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:06.312441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b516af3-2058-4d1b-a7f2-cac41a05977e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:06.313128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b516af3-2058-4d1b-a7f2-cac41a05977e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:06.313607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b516af3-2058-4d1b-a7f2-cac41a05977e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:06.314031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b516af3-2058-4d1b-a7f2-cac41a05977e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:06.342253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0b516af3-2058-4d1b-a7f2-cac41a05977e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044793 Aug 08 08:54:06.342799 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 605/1241] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:06 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:07.216657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2a4283cc-a1be-47a5-bfd2-5c1a30ec5459 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:07.217371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2a4283cc-a1be-47a5-bfd2-5c1a30ec5459 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:07.223752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4283cc-a1be-47a5-bfd2-5c1a30ec5459 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:07.224234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4283cc-a1be-47a5-bfd2-5c1a30ec5459 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:07.224670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4283cc-a1be-47a5-bfd2-5c1a30ec5459 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:07.225394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4283cc-a1be-47a5-bfd2-5c1a30ec5459 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:07.225857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4283cc-a1be-47a5-bfd2-5c1a30ec5459 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:07.226287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4283cc-a1be-47a5-bfd2-5c1a30ec5459 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:07.287654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2a4283cc-a1be-47a5-bfd2-5c1a30ec5459 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:07.295601 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2a4283cc-a1be-47a5-bfd2-5c1a30ec5459 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082796 Aug 08 08:54:07.296183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 637/1242] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:07 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:07.355860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fd0b0aeb-2851-40cb-b611-829ed8212c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:07.358332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fd0b0aeb-2851-40cb-b611-829ed8212c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:07.364549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd0b0aeb-2851-40cb-b611-829ed8212c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:07.365025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd0b0aeb-2851-40cb-b611-829ed8212c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:07.365514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd0b0aeb-2851-40cb-b611-829ed8212c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:07.366195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd0b0aeb-2851-40cb-b611-829ed8212c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:07.366641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd0b0aeb-2851-40cb-b611-829ed8212c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:07.367061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd0b0aeb-2851-40cb-b611-829ed8212c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:07.395874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fd0b0aeb-2851-40cb-b611-829ed8212c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Aug 08 08:54:07.396427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 606/1243] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:07 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:08.318370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-14dc1490-d12d-452a-b182-3463f7f0b423 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:08.318987 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-14dc1490-d12d-452a-b182-3463f7f0b423 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:08.328261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14dc1490-d12d-452a-b182-3463f7f0b423 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:08.328751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14dc1490-d12d-452a-b182-3463f7f0b423 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:08.329218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14dc1490-d12d-452a-b182-3463f7f0b423 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:08.329922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14dc1490-d12d-452a-b182-3463f7f0b423 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:08.330383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14dc1490-d12d-452a-b182-3463f7f0b423 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:08.330997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14dc1490-d12d-452a-b182-3463f7f0b423 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:08.408212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-14dc1490-d12d-452a-b182-3463f7f0b423 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:08.409628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7852745f-2635-43c0-85fb-3a967fbd6d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:08.412365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7852745f-2635-43c0-85fb-3a967fbd6d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:08.417206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-14dc1490-d12d-452a-b182-3463f7f0b423 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.103221 Aug 08 08:54:08.418246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 638/1244] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:08 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:08.426528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7852745f-2635-43c0-85fb-3a967fbd6d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:08.427025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7852745f-2635-43c0-85fb-3a967fbd6d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:08.427468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7852745f-2635-43c0-85fb-3a967fbd6d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:08.428214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7852745f-2635-43c0-85fb-3a967fbd6d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:08.428703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7852745f-2635-43c0-85fb-3a967fbd6d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:08.429169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7852745f-2635-43c0-85fb-3a967fbd6d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:08.465074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7852745f-2635-43c0-85fb-3a967fbd6d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060895 Aug 08 08:54:08.465783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 607/1245] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:08 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:54:09.444522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6c3128f9-fb40-4b5c-83d5-a16d56cd0f8b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:09.445199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6c3128f9-fb40-4b5c-83d5-a16d56cd0f8b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:09.452399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c3128f9-fb40-4b5c-83d5-a16d56cd0f8b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:09.452885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c3128f9-fb40-4b5c-83d5-a16d56cd0f8b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:09.453358 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c3128f9-fb40-4b5c-83d5-a16d56cd0f8b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:09.454057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c3128f9-fb40-4b5c-83d5-a16d56cd0f8b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:09.454517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c3128f9-fb40-4b5c-83d5-a16d56cd0f8b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:09.454948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c3128f9-fb40-4b5c-83d5-a16d56cd0f8b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:09.479271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-97b833e4-66ad-4776-bbbf-6466e3f5a53b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:09.481438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-97b833e4-66ad-4776-bbbf-6466e3f5a53b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:09.488174 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b833e4-66ad-4776-bbbf-6466e3f5a53b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:09.488659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b833e4-66ad-4776-bbbf-6466e3f5a53b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:09.489094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b833e4-66ad-4776-bbbf-6466e3f5a53b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:09.489814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b833e4-66ad-4776-bbbf-6466e3f5a53b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:09.490271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b833e4-66ad-4776-bbbf-6466e3f5a53b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:09.490696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b833e4-66ad-4776-bbbf-6466e3f5a53b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:09.516533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6c3128f9-fb40-4b5c-83d5-a16d56cd0f8b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:09.519881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-97b833e4-66ad-4776-bbbf-6466e3f5a53b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Aug 08 08:54:09.520439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 608/1246] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:54:09.524737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6c3128f9-fb40-4b5c-83d5-a16d56cd0f8b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084172 Aug 08 08:54:09.525513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 639/1247] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:09 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:10.532744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1b77140f-da7d-4ed0-93dd-2314088157dc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:10.534976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1b77140f-da7d-4ed0-93dd-2314088157dc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:10.541860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b77140f-da7d-4ed0-93dd-2314088157dc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:10.542345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b77140f-da7d-4ed0-93dd-2314088157dc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:10.542785 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b77140f-da7d-4ed0-93dd-2314088157dc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:10.543474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b77140f-da7d-4ed0-93dd-2314088157dc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:10.543928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b77140f-da7d-4ed0-93dd-2314088157dc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:10.544359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b77140f-da7d-4ed0-93dd-2314088157dc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:10.544489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7fcb1c42-132f-4397-ab30-632e76c7304d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:10.545082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7fcb1c42-132f-4397-ab30-632e76c7304d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:10.551390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fcb1c42-132f-4397-ab30-632e76c7304d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:10.551881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fcb1c42-132f-4397-ab30-632e76c7304d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:10.552319 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fcb1c42-132f-4397-ab30-632e76c7304d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:10.553010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fcb1c42-132f-4397-ab30-632e76c7304d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:10.553493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fcb1c42-132f-4397-ab30-632e76c7304d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:10.553920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7fcb1c42-132f-4397-ab30-632e76c7304d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:10.573906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1b77140f-da7d-4ed0-93dd-2314088157dc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 Aug 08 08:54:10.574385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 609/1248] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:10 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:10.617847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7fcb1c42-132f-4397-ab30-632e76c7304d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:10.625216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7fcb1c42-132f-4397-ab30-632e76c7304d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084615 Aug 08 08:54:10.625775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 640/1249] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:10 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:54:11.586944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e41410ff-176a-4d30-a724-90cc53970b90 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:11.589027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e41410ff-176a-4d30-a724-90cc53970b90 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:11.595341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e41410ff-176a-4d30-a724-90cc53970b90 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:11.595842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e41410ff-176a-4d30-a724-90cc53970b90 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:11.596275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e41410ff-176a-4d30-a724-90cc53970b90 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:11.596983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e41410ff-176a-4d30-a724-90cc53970b90 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:11.597456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e41410ff-176a-4d30-a724-90cc53970b90 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:11.597876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e41410ff-176a-4d30-a724-90cc53970b90 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:11.626030 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e41410ff-176a-4d30-a724-90cc53970b90 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Aug 08 08:54:11.626565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 610/1250] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:11 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:11.645855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-47314e51-5c7b-4a87-98f1-fecd62146c40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:11.646501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-47314e51-5c7b-4a87-98f1-fecd62146c40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:11.653803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47314e51-5c7b-4a87-98f1-fecd62146c40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:11.654289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47314e51-5c7b-4a87-98f1-fecd62146c40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:11.654726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47314e51-5c7b-4a87-98f1-fecd62146c40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:11.655415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47314e51-5c7b-4a87-98f1-fecd62146c40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:11.655874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47314e51-5c7b-4a87-98f1-fecd62146c40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:11.656302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47314e51-5c7b-4a87-98f1-fecd62146c40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:11.719616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-47314e51-5c7b-4a87-98f1-fecd62146c40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:11.727165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-47314e51-5c7b-4a87-98f1-fecd62146c40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085103 Aug 08 08:54:11.727724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 641/1251] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:11 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:12.637353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8ba48d87-5004-425d-852e-96ff3b6fffc5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:12.639528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8ba48d87-5004-425d-852e-96ff3b6fffc5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:12.645918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ba48d87-5004-425d-852e-96ff3b6fffc5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:12.646398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ba48d87-5004-425d-852e-96ff3b6fffc5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:12.646829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ba48d87-5004-425d-852e-96ff3b6fffc5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:12.647539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ba48d87-5004-425d-852e-96ff3b6fffc5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:12.647987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ba48d87-5004-425d-852e-96ff3b6fffc5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:12.648420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ba48d87-5004-425d-852e-96ff3b6fffc5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:12.676485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8ba48d87-5004-425d-852e-96ff3b6fffc5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043077 Aug 08 08:54:12.676952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 611/1252] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:12 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:54:12.748201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a46cb195-16ec-466f-8b91-7fe5f097a0b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:12.748835 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a46cb195-16ec-466f-8b91-7fe5f097a0b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:12.755177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a46cb195-16ec-466f-8b91-7fe5f097a0b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:12.755665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a46cb195-16ec-466f-8b91-7fe5f097a0b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:12.756095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a46cb195-16ec-466f-8b91-7fe5f097a0b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:12.756783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a46cb195-16ec-466f-8b91-7fe5f097a0b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:12.757261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a46cb195-16ec-466f-8b91-7fe5f097a0b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:12.757686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a46cb195-16ec-466f-8b91-7fe5f097a0b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:12.775223 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:54:12.818506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a46cb195-16ec-466f-8b91-7fe5f097a0b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:12.825952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a46cb195-16ec-466f-8b91-7fe5f097a0b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081525 Aug 08 08:54:12.826512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 642/1253] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:12 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:13.688816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7b7c8eed-74ed-41dc-b069-a97c56ff4421 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:13.690912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7b7c8eed-74ed-41dc-b069-a97c56ff4421 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:13.697989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b7c8eed-74ed-41dc-b069-a97c56ff4421 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:13.698480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b7c8eed-74ed-41dc-b069-a97c56ff4421 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:13.698918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b7c8eed-74ed-41dc-b069-a97c56ff4421 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:13.699607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b7c8eed-74ed-41dc-b069-a97c56ff4421 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:13.700063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b7c8eed-74ed-41dc-b069-a97c56ff4421 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:13.700490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b7c8eed-74ed-41dc-b069-a97c56ff4421 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:13.728036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7b7c8eed-74ed-41dc-b069-a97c56ff4421 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043223 Aug 08 08:54:13.728582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 612/1254] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:13.846806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8042eeea-e66c-4bdd-8c35-6be1cba77b36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:13.847420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8042eeea-e66c-4bdd-8c35-6be1cba77b36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:13.853814 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8042eeea-e66c-4bdd-8c35-6be1cba77b36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:13.854300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8042eeea-e66c-4bdd-8c35-6be1cba77b36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:13.854733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8042eeea-e66c-4bdd-8c35-6be1cba77b36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:13.855417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8042eeea-e66c-4bdd-8c35-6be1cba77b36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:13.855975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8042eeea-e66c-4bdd-8c35-6be1cba77b36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:13.856399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8042eeea-e66c-4bdd-8c35-6be1cba77b36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:13.917336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8042eeea-e66c-4bdd-8c35-6be1cba77b36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:13.924719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8042eeea-e66c-4bdd-8c35-6be1cba77b36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081725 Aug 08 08:54:13.925303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 643/1255] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:13 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:14.740096 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-53f9d5cd-4d15-43e5-93a5-59776de4605e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:14.742222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-53f9d5cd-4d15-43e5-93a5-59776de4605e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:14.748512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f9d5cd-4d15-43e5-93a5-59776de4605e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:14.748986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f9d5cd-4d15-43e5-93a5-59776de4605e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:14.749462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f9d5cd-4d15-43e5-93a5-59776de4605e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:14.750144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f9d5cd-4d15-43e5-93a5-59776de4605e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:14.750592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f9d5cd-4d15-43e5-93a5-59776de4605e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:14.751020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f9d5cd-4d15-43e5-93a5-59776de4605e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:14.779454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-53f9d5cd-4d15-43e5-93a5-59776de4605e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Aug 08 08:54:14.779997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 613/1256] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:14.946252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5abeec21-ee3d-4791-b867-85f7a411d4fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:14.946872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5abeec21-ee3d-4791-b867-85f7a411d4fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:14.953567 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5abeec21-ee3d-4791-b867-85f7a411d4fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:14.954060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5abeec21-ee3d-4791-b867-85f7a411d4fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:14.954505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5abeec21-ee3d-4791-b867-85f7a411d4fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:14.955204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5abeec21-ee3d-4791-b867-85f7a411d4fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:14.955671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5abeec21-ee3d-4791-b867-85f7a411d4fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:14.956105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5abeec21-ee3d-4791-b867-85f7a411d4fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:15.019637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5abeec21-ee3d-4791-b867-85f7a411d4fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:15.027771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5abeec21-ee3d-4791-b867-85f7a411d4fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085932 Aug 08 08:54:15.028336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 644/1257] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:14 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:15.791999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9486a23c-ce4d-436d-b651-41abd485b1f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:15.794215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9486a23c-ce4d-436d-b651-41abd485b1f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:15.800534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9486a23c-ce4d-436d-b651-41abd485b1f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:15.801014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9486a23c-ce4d-436d-b651-41abd485b1f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:15.801495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9486a23c-ce4d-436d-b651-41abd485b1f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:15.802219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9486a23c-ce4d-436d-b651-41abd485b1f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:15.802676 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9486a23c-ce4d-436d-b651-41abd485b1f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:15.803105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9486a23c-ce4d-436d-b651-41abd485b1f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:15.831444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9486a23c-ce4d-436d-b651-41abd485b1f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043874 Aug 08 08:54:15.831990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 614/1258] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:15 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:16.048565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-98afee8d-0b73-4435-bcc9-7a574865b7a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:16.049106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-98afee8d-0b73-4435-bcc9-7a574865b7a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:16.055638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98afee8d-0b73-4435-bcc9-7a574865b7a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:16.056156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98afee8d-0b73-4435-bcc9-7a574865b7a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:16.056594 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98afee8d-0b73-4435-bcc9-7a574865b7a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:16.057324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98afee8d-0b73-4435-bcc9-7a574865b7a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:16.057785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98afee8d-0b73-4435-bcc9-7a574865b7a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:16.058220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98afee8d-0b73-4435-bcc9-7a574865b7a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:16.127109 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-98afee8d-0b73-4435-bcc9-7a574865b7a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:16.128786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-98afee8d-0b73-4435-bcc9-7a574865b7a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084090 Aug 08 08:54:16.129597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 645/1259] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:16 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:16.844200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-36b57f9b-e2ff-4a21-989a-14f67f4cfd86 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:16.846345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-36b57f9b-e2ff-4a21-989a-14f67f4cfd86 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:16.852720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36b57f9b-e2ff-4a21-989a-14f67f4cfd86 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:16.853235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36b57f9b-e2ff-4a21-989a-14f67f4cfd86 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:16.853676 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36b57f9b-e2ff-4a21-989a-14f67f4cfd86 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:16.854376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36b57f9b-e2ff-4a21-989a-14f67f4cfd86 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:16.854834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36b57f9b-e2ff-4a21-989a-14f67f4cfd86 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:16.855261 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-36b57f9b-e2ff-4a21-989a-14f67f4cfd86 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:16.884211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-36b57f9b-e2ff-4a21-989a-14f67f4cfd86 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Aug 08 08:54:16.884744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 615/1260] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:17.151814 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ae71d20b-e3ca-4bd2-806c-f1e4283be375 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:17.152434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ae71d20b-e3ca-4bd2-806c-f1e4283be375 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:17.158762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae71d20b-e3ca-4bd2-806c-f1e4283be375 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:17.159248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae71d20b-e3ca-4bd2-806c-f1e4283be375 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:17.159689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae71d20b-e3ca-4bd2-806c-f1e4283be375 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:17.160380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae71d20b-e3ca-4bd2-806c-f1e4283be375 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:17.160840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae71d20b-e3ca-4bd2-806c-f1e4283be375 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:17.161298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae71d20b-e3ca-4bd2-806c-f1e4283be375 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:17.221578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ae71d20b-e3ca-4bd2-806c-f1e4283be375 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:17.229601 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ae71d20b-e3ca-4bd2-806c-f1e4283be375 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081617 Aug 08 08:54:17.230166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 646/1261] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:17 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:17.896246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5ce4b631-d31b-4b2c-bfd7-ef9a15c058d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:17.898980 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5ce4b631-d31b-4b2c-bfd7-ef9a15c058d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:17.905328 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ce4b631-d31b-4b2c-bfd7-ef9a15c058d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:17.905806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ce4b631-d31b-4b2c-bfd7-ef9a15c058d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:17.906266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ce4b631-d31b-4b2c-bfd7-ef9a15c058d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:17.906945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ce4b631-d31b-4b2c-bfd7-ef9a15c058d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:17.907397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ce4b631-d31b-4b2c-bfd7-ef9a15c058d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:17.907818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ce4b631-d31b-4b2c-bfd7-ef9a15c058d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:17.931909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:54:17.936256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5ce4b631-d31b-4b2c-bfd7-ef9a15c058d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Aug 08 08:54:17.936808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 616/1262] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:17 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:18.250898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b3b35dd7-7371-44fa-bb67-0801c69b7139 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:18.251534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b3b35dd7-7371-44fa-bb67-0801c69b7139 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:18.258486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3b35dd7-7371-44fa-bb67-0801c69b7139 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:18.258986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3b35dd7-7371-44fa-bb67-0801c69b7139 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:18.259422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3b35dd7-7371-44fa-bb67-0801c69b7139 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:18.260105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3b35dd7-7371-44fa-bb67-0801c69b7139 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:18.260560 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3b35dd7-7371-44fa-bb67-0801c69b7139 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:18.260983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3b35dd7-7371-44fa-bb67-0801c69b7139 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:18.321381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b3b35dd7-7371-44fa-bb67-0801c69b7139 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:18.328851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b3b35dd7-7371-44fa-bb67-0801c69b7139 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081883 Aug 08 08:54:18.329444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 647/1263] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:18 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:18.948656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-04f6a1f2-ee72-48c8-9f20-d3968683664b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:18.950881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-04f6a1f2-ee72-48c8-9f20-d3968683664b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:18.957794 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-04f6a1f2-ee72-48c8-9f20-d3968683664b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:18.958275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-04f6a1f2-ee72-48c8-9f20-d3968683664b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:18.958713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-04f6a1f2-ee72-48c8-9f20-d3968683664b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:18.959404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-04f6a1f2-ee72-48c8-9f20-d3968683664b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:18.959853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-04f6a1f2-ee72-48c8-9f20-d3968683664b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:18.960274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-04f6a1f2-ee72-48c8-9f20-d3968683664b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:18.989181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-04f6a1f2-ee72-48c8-9f20-d3968683664b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Aug 08 08:54:18.989648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 617/1264] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:18 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:19.349225 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-020e04df-acde-458f-99ce-3173e87d0d94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:19.349785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-020e04df-acde-458f-99ce-3173e87d0d94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:19.357432 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-020e04df-acde-458f-99ce-3173e87d0d94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:19.357928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-020e04df-acde-458f-99ce-3173e87d0d94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:19.358370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-020e04df-acde-458f-99ce-3173e87d0d94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:19.359069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-020e04df-acde-458f-99ce-3173e87d0d94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:19.359533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-020e04df-acde-458f-99ce-3173e87d0d94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:19.359997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-020e04df-acde-458f-99ce-3173e87d0d94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:19.425322 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-020e04df-acde-458f-99ce-3173e87d0d94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:19.433972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-020e04df-acde-458f-99ce-3173e87d0d94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.088677 Aug 08 08:54:19.434545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 648/1265] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:19 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:20.001666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4bc44a35-b5dc-4ace-8ebb-8591459a2324 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:20.003725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4bc44a35-b5dc-4ace-8ebb-8591459a2324 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:20.010680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4bc44a35-b5dc-4ace-8ebb-8591459a2324 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:20.011157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4bc44a35-b5dc-4ace-8ebb-8591459a2324 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:20.011587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4bc44a35-b5dc-4ace-8ebb-8591459a2324 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:20.012272 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4bc44a35-b5dc-4ace-8ebb-8591459a2324 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:20.012721 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4bc44a35-b5dc-4ace-8ebb-8591459a2324 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:20.013158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4bc44a35-b5dc-4ace-8ebb-8591459a2324 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:20.042285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4bc44a35-b5dc-4ace-8ebb-8591459a2324 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044672 Aug 08 08:54:20.042841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 618/1266] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:54:20.454527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-34b8cfc7-14b3-497c-b0f1-d104d4e1c90c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:20.455140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-34b8cfc7-14b3-497c-b0f1-d104d4e1c90c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:20.461762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34b8cfc7-14b3-497c-b0f1-d104d4e1c90c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:20.462249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34b8cfc7-14b3-497c-b0f1-d104d4e1c90c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:20.462714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34b8cfc7-14b3-497c-b0f1-d104d4e1c90c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:20.463435 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34b8cfc7-14b3-497c-b0f1-d104d4e1c90c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:20.463893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34b8cfc7-14b3-497c-b0f1-d104d4e1c90c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:20.464321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34b8cfc7-14b3-497c-b0f1-d104d4e1c90c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:20.526166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-34b8cfc7-14b3-497c-b0f1-d104d4e1c90c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:20.533600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-34b8cfc7-14b3-497c-b0f1-d104d4e1c90c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082922 Aug 08 08:54:20.534161 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 649/1267] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:20 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:21.055090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e2b43da4-bd40-4833-ab5d-68e23eb2e4ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:21.057279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e2b43da4-bd40-4833-ab5d-68e23eb2e4ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:21.063701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2b43da4-bd40-4833-ab5d-68e23eb2e4ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:21.064189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2b43da4-bd40-4833-ab5d-68e23eb2e4ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:21.064632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2b43da4-bd40-4833-ab5d-68e23eb2e4ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:21.065366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2b43da4-bd40-4833-ab5d-68e23eb2e4ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:21.065828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2b43da4-bd40-4833-ab5d-68e23eb2e4ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:21.066260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2b43da4-bd40-4833-ab5d-68e23eb2e4ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:21.095127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e2b43da4-bd40-4833-ab5d-68e23eb2e4ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Aug 08 08:54:21.095685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 619/1268] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:21 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:21.554255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cd7c07c2-c380-4ce9-9168-06db9ea19be2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:21.555591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cd7c07c2-c380-4ce9-9168-06db9ea19be2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:21.561601 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd7c07c2-c380-4ce9-9168-06db9ea19be2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:21.562088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd7c07c2-c380-4ce9-9168-06db9ea19be2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:21.562533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd7c07c2-c380-4ce9-9168-06db9ea19be2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:21.563222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd7c07c2-c380-4ce9-9168-06db9ea19be2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:21.563683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd7c07c2-c380-4ce9-9168-06db9ea19be2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:21.564112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd7c07c2-c380-4ce9-9168-06db9ea19be2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:21.624561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cd7c07c2-c380-4ce9-9168-06db9ea19be2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:21.632004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cd7c07c2-c380-4ce9-9168-06db9ea19be2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081784 Aug 08 08:54:21.632607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 650/1269] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:21 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:22.108430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e6adfdd9-db5e-479e-a36e-23b6dd8be70b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:22.110544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e6adfdd9-db5e-479e-a36e-23b6dd8be70b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:22.116880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6adfdd9-db5e-479e-a36e-23b6dd8be70b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:22.117436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6adfdd9-db5e-479e-a36e-23b6dd8be70b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:22.117950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6adfdd9-db5e-479e-a36e-23b6dd8be70b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:22.118643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6adfdd9-db5e-479e-a36e-23b6dd8be70b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:22.119103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6adfdd9-db5e-479e-a36e-23b6dd8be70b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:22.119534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6adfdd9-db5e-479e-a36e-23b6dd8be70b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:22.147410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e6adfdd9-db5e-479e-a36e-23b6dd8be70b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043278 Aug 08 08:54:22.147951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 620/1270] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:22.652081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ffc44896-9838-4ecd-b062-fe955fc18b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:22.652690 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ffc44896-9838-4ecd-b062-fe955fc18b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:22.659340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffc44896-9838-4ecd-b062-fe955fc18b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:22.659826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffc44896-9838-4ecd-b062-fe955fc18b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:22.660260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffc44896-9838-4ecd-b062-fe955fc18b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:22.660940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffc44896-9838-4ecd-b062-fe955fc18b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:22.661418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffc44896-9838-4ecd-b062-fe955fc18b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:22.661842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ffc44896-9838-4ecd-b062-fe955fc18b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:22.723583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ffc44896-9838-4ecd-b062-fe955fc18b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:22.731386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ffc44896-9838-4ecd-b062-fe955fc18b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083080 Aug 08 08:54:22.731953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 651/1271] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:22 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:23.160175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c5b91a3c-bc30-458a-9c56-7d9cea7c527d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:23.162349 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c5b91a3c-bc30-458a-9c56-7d9cea7c527d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:23.169328 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c5b91a3c-bc30-458a-9c56-7d9cea7c527d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:23.169816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c5b91a3c-bc30-458a-9c56-7d9cea7c527d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:23.170259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c5b91a3c-bc30-458a-9c56-7d9cea7c527d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:23.170949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c5b91a3c-bc30-458a-9c56-7d9cea7c527d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:23.171409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c5b91a3c-bc30-458a-9c56-7d9cea7c527d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:23.171836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c5b91a3c-bc30-458a-9c56-7d9cea7c527d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:23.200591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c5b91a3c-bc30-458a-9c56-7d9cea7c527d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Aug 08 08:54:23.201138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 621/1272] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:23.751704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c5594a62-aa1b-4e8a-9290-b0686ac85330 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:23.752345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c5594a62-aa1b-4e8a-9290-b0686ac85330 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:23.759468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5594a62-aa1b-4e8a-9290-b0686ac85330 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:23.759949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5594a62-aa1b-4e8a-9290-b0686ac85330 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:23.760387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5594a62-aa1b-4e8a-9290-b0686ac85330 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:23.761076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5594a62-aa1b-4e8a-9290-b0686ac85330 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:23.761563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5594a62-aa1b-4e8a-9290-b0686ac85330 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:23.761992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5594a62-aa1b-4e8a-9290-b0686ac85330 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:23.825640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c5594a62-aa1b-4e8a-9290-b0686ac85330 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:23.833265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c5594a62-aa1b-4e8a-9290-b0686ac85330 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085361 Aug 08 08:54:23.833814 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 652/1273] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:23 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:24.213137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b4bd157c-7aba-418f-b565-149b01927a40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:24.215417 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b4bd157c-7aba-418f-b565-149b01927a40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:24.221920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4bd157c-7aba-418f-b565-149b01927a40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:24.222406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4bd157c-7aba-418f-b565-149b01927a40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:24.222849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4bd157c-7aba-418f-b565-149b01927a40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:24.223549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4bd157c-7aba-418f-b565-149b01927a40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:24.224009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4bd157c-7aba-418f-b565-149b01927a40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:24.224440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4bd157c-7aba-418f-b565-149b01927a40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:24.253163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b4bd157c-7aba-418f-b565-149b01927a40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Aug 08 08:54:24.253708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 622/1274] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:24 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:24.854019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-03cdb42d-9bdc-447b-911e-894a0adc6cba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:24.854659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-03cdb42d-9bdc-447b-911e-894a0adc6cba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:24.861256 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03cdb42d-9bdc-447b-911e-894a0adc6cba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:24.861738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03cdb42d-9bdc-447b-911e-894a0adc6cba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:24.862183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03cdb42d-9bdc-447b-911e-894a0adc6cba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:24.862894 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03cdb42d-9bdc-447b-911e-894a0adc6cba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:24.863345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03cdb42d-9bdc-447b-911e-894a0adc6cba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:24.863767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03cdb42d-9bdc-447b-911e-894a0adc6cba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:24.924334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-03cdb42d-9bdc-447b-911e-894a0adc6cba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:24.931876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-03cdb42d-9bdc-447b-911e-894a0adc6cba tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082459 Aug 08 08:54:24.932434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 653/1275] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:24 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:25.266160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7d926eec-20f1-47ad-a64e-48bb9dab1b42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:25.268296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7d926eec-20f1-47ad-a64e-48bb9dab1b42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:25.274693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d926eec-20f1-47ad-a64e-48bb9dab1b42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:25.275164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d926eec-20f1-47ad-a64e-48bb9dab1b42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:25.275592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d926eec-20f1-47ad-a64e-48bb9dab1b42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:25.276266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d926eec-20f1-47ad-a64e-48bb9dab1b42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:25.276715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d926eec-20f1-47ad-a64e-48bb9dab1b42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:25.277134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d926eec-20f1-47ad-a64e-48bb9dab1b42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:25.305940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7d926eec-20f1-47ad-a64e-48bb9dab1b42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043707 Aug 08 08:54:25.306482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 623/1276] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:25.952796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8876d256-e2d6-4eab-a981-d4b04327655e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:25.953975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8876d256-e2d6-4eab-a981-d4b04327655e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:25.960308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8876d256-e2d6-4eab-a981-d4b04327655e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:25.961463 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8876d256-e2d6-4eab-a981-d4b04327655e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:25.961911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8876d256-e2d6-4eab-a981-d4b04327655e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:25.962600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8876d256-e2d6-4eab-a981-d4b04327655e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:25.963058 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8876d256-e2d6-4eab-a981-d4b04327655e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:25.963480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8876d256-e2d6-4eab-a981-d4b04327655e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:26.024677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8876d256-e2d6-4eab-a981-d4b04327655e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:26.032135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8876d256-e2d6-4eab-a981-d4b04327655e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083352 Aug 08 08:54:26.032694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 654/1277] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:25 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:26.318299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-540bc9d7-0f25-42d5-81ec-153f7470ea74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:26.320617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-540bc9d7-0f25-42d5-81ec-153f7470ea74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:26.326700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-540bc9d7-0f25-42d5-81ec-153f7470ea74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:26.327184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-540bc9d7-0f25-42d5-81ec-153f7470ea74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:26.327625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-540bc9d7-0f25-42d5-81ec-153f7470ea74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:26.328316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-540bc9d7-0f25-42d5-81ec-153f7470ea74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:26.328775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-540bc9d7-0f25-42d5-81ec-153f7470ea74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:26.329231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-540bc9d7-0f25-42d5-81ec-153f7470ea74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:26.358615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-540bc9d7-0f25-42d5-81ec-153f7470ea74 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 08 08:54:26.359165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 624/1278] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:27.053227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8af507c4-6663-45ac-9a7d-ec8dc6cac573 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:27.053844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8af507c4-6663-45ac-9a7d-ec8dc6cac573 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:27.061195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af507c4-6663-45ac-9a7d-ec8dc6cac573 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:27.061687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af507c4-6663-45ac-9a7d-ec8dc6cac573 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:27.062128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af507c4-6663-45ac-9a7d-ec8dc6cac573 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:27.062827 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af507c4-6663-45ac-9a7d-ec8dc6cac573 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:27.063292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af507c4-6663-45ac-9a7d-ec8dc6cac573 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:27.063717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8af507c4-6663-45ac-9a7d-ec8dc6cac573 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:27.127710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8af507c4-6663-45ac-9a7d-ec8dc6cac573 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:27.135514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8af507c4-6663-45ac-9a7d-ec8dc6cac573 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086162 Aug 08 08:54:27.136089 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 655/1279] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:27 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:27.372364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-39170659-649e-4aa1-a71d-19924ea3d20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:27.374571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-39170659-649e-4aa1-a71d-19924ea3d20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:27.380974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39170659-649e-4aa1-a71d-19924ea3d20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:27.381497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39170659-649e-4aa1-a71d-19924ea3d20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:27.381939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39170659-649e-4aa1-a71d-19924ea3d20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:27.382878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39170659-649e-4aa1-a71d-19924ea3d20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:27.383560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39170659-649e-4aa1-a71d-19924ea3d20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:27.383998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39170659-649e-4aa1-a71d-19924ea3d20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:27.412302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-39170659-649e-4aa1-a71d-19924ea3d20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Aug 08 08:54:27.413084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 625/1280] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:27 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:28.157164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b740e133-39b2-4ccb-adab-8a12d17c3887 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:28.157777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b740e133-39b2-4ccb-adab-8a12d17c3887 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:28.164703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b740e133-39b2-4ccb-adab-8a12d17c3887 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:28.165203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b740e133-39b2-4ccb-adab-8a12d17c3887 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:28.165642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b740e133-39b2-4ccb-adab-8a12d17c3887 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:28.166333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b740e133-39b2-4ccb-adab-8a12d17c3887 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:28.166792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b740e133-39b2-4ccb-adab-8a12d17c3887 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:28.167220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b740e133-39b2-4ccb-adab-8a12d17c3887 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:28.232526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b740e133-39b2-4ccb-adab-8a12d17c3887 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:28.240122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b740e133-39b2-4ccb-adab-8a12d17c3887 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086889 Aug 08 08:54:28.240684 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 656/1281] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:28 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:28.425518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-96e78bc4-52fb-4247-9077-f17c08867d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:28.427772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-96e78bc4-52fb-4247-9077-f17c08867d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:28.434573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96e78bc4-52fb-4247-9077-f17c08867d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:28.435059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96e78bc4-52fb-4247-9077-f17c08867d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:28.435500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96e78bc4-52fb-4247-9077-f17c08867d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:28.436188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96e78bc4-52fb-4247-9077-f17c08867d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:28.436641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96e78bc4-52fb-4247-9077-f17c08867d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:28.437069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96e78bc4-52fb-4247-9077-f17c08867d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:28.465525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-96e78bc4-52fb-4247-9077-f17c08867d91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044090 Aug 08 08:54:28.466076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 626/1282] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:28 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:29.261126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-782401fa-7ded-4a85-a874-a173bb0f7dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:29.261754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-782401fa-7ded-4a85-a874-a173bb0f7dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:29.268230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782401fa-7ded-4a85-a874-a173bb0f7dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:29.268710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782401fa-7ded-4a85-a874-a173bb0f7dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:29.269139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782401fa-7ded-4a85-a874-a173bb0f7dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:29.269836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782401fa-7ded-4a85-a874-a173bb0f7dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:29.270287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782401fa-7ded-4a85-a874-a173bb0f7dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:29.270706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-782401fa-7ded-4a85-a874-a173bb0f7dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:29.330826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-782401fa-7ded-4a85-a874-a173bb0f7dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:29.338495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-782401fa-7ded-4a85-a874-a173bb0f7dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081928 Aug 08 08:54:29.339057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 657/1283] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:29 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:29.478902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6c5a850e-13a5-4c97-8732-9012d767f2ad tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:29.481088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6c5a850e-13a5-4c97-8732-9012d767f2ad tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:29.487985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6c5a850e-13a5-4c97-8732-9012d767f2ad tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:29.488471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6c5a850e-13a5-4c97-8732-9012d767f2ad tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:29.488913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6c5a850e-13a5-4c97-8732-9012d767f2ad tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:29.489738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6c5a850e-13a5-4c97-8732-9012d767f2ad tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:29.490196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6c5a850e-13a5-4c97-8732-9012d767f2ad tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:29.490626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6c5a850e-13a5-4c97-8732-9012d767f2ad tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:29.519749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6c5a850e-13a5-4c97-8732-9012d767f2ad tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Aug 08 08:54:29.520231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 627/1284] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:29 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:30.359853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f1edd019-4375-474a-a289-f6c776300c29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:30.360450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f1edd019-4375-474a-a289-f6c776300c29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:30.366883 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1edd019-4375-474a-a289-f6c776300c29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:30.367363 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1edd019-4375-474a-a289-f6c776300c29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:30.367790 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1edd019-4375-474a-a289-f6c776300c29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:30.368470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1edd019-4375-474a-a289-f6c776300c29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:30.368915 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1edd019-4375-474a-a289-f6c776300c29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:30.369368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f1edd019-4375-474a-a289-f6c776300c29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:30.430968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f1edd019-4375-474a-a289-f6c776300c29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:30.438527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f1edd019-4375-474a-a289-f6c776300c29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082918 Aug 08 08:54:30.439080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 658/1285] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:30 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:30.531975 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f5ff3d1a-24ae-4d53-9c8a-8298a4227e6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:30.534185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f5ff3d1a-24ae-4d53-9c8a-8298a4227e6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:30.540541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5ff3d1a-24ae-4d53-9c8a-8298a4227e6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:30.541024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5ff3d1a-24ae-4d53-9c8a-8298a4227e6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:30.541495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5ff3d1a-24ae-4d53-9c8a-8298a4227e6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:30.542189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5ff3d1a-24ae-4d53-9c8a-8298a4227e6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:30.542646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5ff3d1a-24ae-4d53-9c8a-8298a4227e6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:30.543072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5ff3d1a-24ae-4d53-9c8a-8298a4227e6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:30.572545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f5ff3d1a-24ae-4d53-9c8a-8298a4227e6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044591 Aug 08 08:54:30.573088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 628/1286] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:30 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:31.584864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8a7cb0a8-a798-4a52-b4c2-ab99109add43 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:31.587262 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8a7cb0a8-a798-4a52-b4c2-ab99109add43 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:31.593732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a7cb0a8-a798-4a52-b4c2-ab99109add43 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:31.594293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a7cb0a8-a798-4a52-b4c2-ab99109add43 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:31.594489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e67c875c-4d2f-4247-ba21-1a45de1e13fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:31.594890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a7cb0a8-a798-4a52-b4c2-ab99109add43 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:31.595110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e67c875c-4d2f-4247-ba21-1a45de1e13fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:31.595523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a7cb0a8-a798-4a52-b4c2-ab99109add43 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:31.595984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a7cb0a8-a798-4a52-b4c2-ab99109add43 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:31.596415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a7cb0a8-a798-4a52-b4c2-ab99109add43 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:31.600861 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e67c875c-4d2f-4247-ba21-1a45de1e13fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:31.602086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e67c875c-4d2f-4247-ba21-1a45de1e13fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:31.602656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e67c875c-4d2f-4247-ba21-1a45de1e13fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:31.603381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e67c875c-4d2f-4247-ba21-1a45de1e13fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:31.603847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e67c875c-4d2f-4247-ba21-1a45de1e13fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:31.604274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e67c875c-4d2f-4247-ba21-1a45de1e13fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:31.608676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:54:31.627400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8a7cb0a8-a798-4a52-b4c2-ab99109add43 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046493 Aug 08 08:54:31.627959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 629/1287] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:31 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:54:31.666856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e67c875c-4d2f-4247-ba21-1a45de1e13fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:31.674270 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e67c875c-4d2f-4247-ba21-1a45de1e13fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.218582 Aug 08 08:54:31.674819 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 659/1288] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:31 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:32.639609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9f8b2b63-8fc0-4cb1-9cb4-966775f337b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:32.641800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9f8b2b63-8fc0-4cb1-9cb4-966775f337b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:32.648902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f8b2b63-8fc0-4cb1-9cb4-966775f337b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:32.649412 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f8b2b63-8fc0-4cb1-9cb4-966775f337b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:32.649853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f8b2b63-8fc0-4cb1-9cb4-966775f337b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:32.650542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f8b2b63-8fc0-4cb1-9cb4-966775f337b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:32.650996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f8b2b63-8fc0-4cb1-9cb4-966775f337b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:32.651422 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f8b2b63-8fc0-4cb1-9cb4-966775f337b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:32.678928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9f8b2b63-8fc0-4cb1-9cb4-966775f337b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043193 Aug 08 08:54:32.679401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 630/1289] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:32.697390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2257d6f4-9d67-4a4a-9e7f-a30ef2b2dd23 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:32.698025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2257d6f4-9d67-4a4a-9e7f-a30ef2b2dd23 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:32.704402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2257d6f4-9d67-4a4a-9e7f-a30ef2b2dd23 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:32.704886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2257d6f4-9d67-4a4a-9e7f-a30ef2b2dd23 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:32.705347 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2257d6f4-9d67-4a4a-9e7f-a30ef2b2dd23 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:32.706037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2257d6f4-9d67-4a4a-9e7f-a30ef2b2dd23 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:32.706496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2257d6f4-9d67-4a4a-9e7f-a30ef2b2dd23 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:32.706919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2257d6f4-9d67-4a4a-9e7f-a30ef2b2dd23 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:32.769924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2257d6f4-9d67-4a4a-9e7f-a30ef2b2dd23 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:32.777845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2257d6f4-9d67-4a4a-9e7f-a30ef2b2dd23 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085621 Aug 08 08:54:32.778397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 660/1290] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:32 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:33.691119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-94fe4006-c565-49eb-92cc-e166b80bd1ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:33.693250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-94fe4006-c565-49eb-92cc-e166b80bd1ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:33.696314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=60 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:54:33.700904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94fe4006-c565-49eb-92cc-e166b80bd1ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:33.701418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94fe4006-c565-49eb-92cc-e166b80bd1ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:33.701852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94fe4006-c565-49eb-92cc-e166b80bd1ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:33.702536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94fe4006-c565-49eb-92cc-e166b80bd1ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:33.702985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94fe4006-c565-49eb-92cc-e166b80bd1ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:33.703423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-94fe4006-c565-49eb-92cc-e166b80bd1ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:33.733640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-94fe4006-c565-49eb-92cc-e166b80bd1ee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046497 Aug 08 08:54:33.734411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 631/1291] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:33 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:33.798871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9331eb28-9639-43ff-b9fc-3ec9b60dabd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:33.799479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9331eb28-9639-43ff-b9fc-3ec9b60dabd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:33.806776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9331eb28-9639-43ff-b9fc-3ec9b60dabd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:33.807257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9331eb28-9639-43ff-b9fc-3ec9b60dabd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:33.807691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9331eb28-9639-43ff-b9fc-3ec9b60dabd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:33.808376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9331eb28-9639-43ff-b9fc-3ec9b60dabd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:33.808829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9331eb28-9639-43ff-b9fc-3ec9b60dabd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:33.809396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9331eb28-9639-43ff-b9fc-3ec9b60dabd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:33.873397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9331eb28-9639-43ff-b9fc-3ec9b60dabd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:33.880730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9331eb28-9639-43ff-b9fc-3ec9b60dabd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085678 Aug 08 08:54:33.881314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 661/1292] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:33 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:34.746302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-935d9bfc-ba6c-4f9e-901c-6571442bbcf6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:34.748374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-935d9bfc-ba6c-4f9e-901c-6571442bbcf6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:34.755864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-935d9bfc-ba6c-4f9e-901c-6571442bbcf6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:34.756354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-935d9bfc-ba6c-4f9e-901c-6571442bbcf6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:34.756793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-935d9bfc-ba6c-4f9e-901c-6571442bbcf6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:34.758257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-935d9bfc-ba6c-4f9e-901c-6571442bbcf6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:34.758723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-935d9bfc-ba6c-4f9e-901c-6571442bbcf6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:34.759157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-935d9bfc-ba6c-4f9e-901c-6571442bbcf6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:34.787931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-935d9bfc-ba6c-4f9e-901c-6571442bbcf6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045928 Aug 08 08:54:34.788484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 632/1293] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:34.901323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-23b573f4-5eea-485f-b54a-f6cc07c55583 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:34.901939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-23b573f4-5eea-485f-b54a-f6cc07c55583 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:34.908307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23b573f4-5eea-485f-b54a-f6cc07c55583 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:34.908815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23b573f4-5eea-485f-b54a-f6cc07c55583 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:34.909281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23b573f4-5eea-485f-b54a-f6cc07c55583 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:34.909972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23b573f4-5eea-485f-b54a-f6cc07c55583 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:34.910429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23b573f4-5eea-485f-b54a-f6cc07c55583 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:34.910856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23b573f4-5eea-485f-b54a-f6cc07c55583 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:34.971345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-23b573f4-5eea-485f-b54a-f6cc07c55583 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:34.978739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-23b573f4-5eea-485f-b54a-f6cc07c55583 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082042 Aug 08 08:54:34.979298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 662/1294] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:34 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:35.800363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-779be6e1-294d-4a55-a841-4d102713acf8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:35.802552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-779be6e1-294d-4a55-a841-4d102713acf8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:35.808832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-779be6e1-294d-4a55-a841-4d102713acf8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:35.809355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-779be6e1-294d-4a55-a841-4d102713acf8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:35.809788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-779be6e1-294d-4a55-a841-4d102713acf8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:35.810465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-779be6e1-294d-4a55-a841-4d102713acf8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:35.810912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-779be6e1-294d-4a55-a841-4d102713acf8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:35.811333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-779be6e1-294d-4a55-a841-4d102713acf8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:35.824607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:54:35.839543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-779be6e1-294d-4a55-a841-4d102713acf8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043123 Aug 08 08:54:35.846920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 633/1295] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:35 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:35.999653 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-43a30037-b2b2-4429-ace6-ba8170dd5957 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:36.000193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-43a30037-b2b2-4429-ace6-ba8170dd5957 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:36.002506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=58 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:54:36.007194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43a30037-b2b2-4429-ace6-ba8170dd5957 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:36.012788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43a30037-b2b2-4429-ace6-ba8170dd5957 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:36.012788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43a30037-b2b2-4429-ace6-ba8170dd5957 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:36.012788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43a30037-b2b2-4429-ace6-ba8170dd5957 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:36.012788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43a30037-b2b2-4429-ace6-ba8170dd5957 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:36.013217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43a30037-b2b2-4429-ace6-ba8170dd5957 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:36.071548 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-43a30037-b2b2-4429-ace6-ba8170dd5957 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:36.079101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-43a30037-b2b2-4429-ace6-ba8170dd5957 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083304 Aug 08 08:54:36.079657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 663/1296] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:35 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:36.952910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c2d86bd1-098c-479f-94af-b8309eab4579 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:36.955055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c2d86bd1-098c-479f-94af-b8309eab4579 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:36.961071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2d86bd1-098c-479f-94af-b8309eab4579 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:36.961589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2d86bd1-098c-479f-94af-b8309eab4579 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:36.962026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2d86bd1-098c-479f-94af-b8309eab4579 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:36.962711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2d86bd1-098c-479f-94af-b8309eab4579 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:36.963165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2d86bd1-098c-479f-94af-b8309eab4579 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:36.963588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2d86bd1-098c-479f-94af-b8309eab4579 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:36.991805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c2d86bd1-098c-479f-94af-b8309eab4579 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144035 Aug 08 08:54:36.992363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 634/1297] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:37.099746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8333c915-2ca8-4926-a6cc-f5048cece29b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:37.100364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8333c915-2ca8-4926-a6cc-f5048cece29b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:37.106951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8333c915-2ca8-4926-a6cc-f5048cece29b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:37.107380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8333c915-2ca8-4926-a6cc-f5048cece29b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:37.108071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8333c915-2ca8-4926-a6cc-f5048cece29b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:37.108766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8333c915-2ca8-4926-a6cc-f5048cece29b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:37.109258 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8333c915-2ca8-4926-a6cc-f5048cece29b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:37.109693 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8333c915-2ca8-4926-a6cc-f5048cece29b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:37.173055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8333c915-2ca8-4926-a6cc-f5048cece29b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:37.180610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8333c915-2ca8-4926-a6cc-f5048cece29b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084781 Aug 08 08:54:37.181186 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 664/1298] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:37 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:38.004052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d886ba54-905d-41c2-9641-8464ce7b5991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:38.006197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d886ba54-905d-41c2-9641-8464ce7b5991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:38.012813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d886ba54-905d-41c2-9641-8464ce7b5991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:38.013348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d886ba54-905d-41c2-9641-8464ce7b5991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:38.013818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d886ba54-905d-41c2-9641-8464ce7b5991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:38.014515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d886ba54-905d-41c2-9641-8464ce7b5991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:38.014977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d886ba54-905d-41c2-9641-8464ce7b5991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:38.015406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d886ba54-905d-41c2-9641-8464ce7b5991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:38.044621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d886ba54-905d-41c2-9641-8464ce7b5991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044600 Aug 08 08:54:38.045383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 635/1299] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:37 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:38.201317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e77d4065-fbe3-4105-9f41-0546641fd780 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:38.201933 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e77d4065-fbe3-4105-9f41-0546641fd780 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:38.208329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e77d4065-fbe3-4105-9f41-0546641fd780 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:38.209610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e77d4065-fbe3-4105-9f41-0546641fd780 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:38.209610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e77d4065-fbe3-4105-9f41-0546641fd780 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:38.210022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e77d4065-fbe3-4105-9f41-0546641fd780 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:38.211220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e77d4065-fbe3-4105-9f41-0546641fd780 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:38.211712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e77d4065-fbe3-4105-9f41-0546641fd780 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:38.271701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e77d4065-fbe3-4105-9f41-0546641fd780 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:38.279659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e77d4065-fbe3-4105-9f41-0546641fd780 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082305 Aug 08 08:54:38.280217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 665/1300] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:38 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:54:39.057432 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-110365aa-3d8d-4bb0-b3fb-4a1ef6072776 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:39.059558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-110365aa-3d8d-4bb0-b3fb-4a1ef6072776 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:39.065870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-110365aa-3d8d-4bb0-b3fb-4a1ef6072776 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:39.066353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-110365aa-3d8d-4bb0-b3fb-4a1ef6072776 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:39.066788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-110365aa-3d8d-4bb0-b3fb-4a1ef6072776 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:39.067465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-110365aa-3d8d-4bb0-b3fb-4a1ef6072776 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:39.067914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-110365aa-3d8d-4bb0-b3fb-4a1ef6072776 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:39.068336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-110365aa-3d8d-4bb0-b3fb-4a1ef6072776 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:39.096657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-110365aa-3d8d-4bb0-b3fb-4a1ef6072776 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Aug 08 08:54:39.097212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 636/1301] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:39 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:39.301404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2f5bbbd9-20c8-4119-ac62-7bf387efceee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:39.302095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2f5bbbd9-20c8-4119-ac62-7bf387efceee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:39.309177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5bbbd9-20c8-4119-ac62-7bf387efceee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:39.309607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5bbbd9-20c8-4119-ac62-7bf387efceee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:39.310053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5bbbd9-20c8-4119-ac62-7bf387efceee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:39.310748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5bbbd9-20c8-4119-ac62-7bf387efceee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:39.311209 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5bbbd9-20c8-4119-ac62-7bf387efceee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:39.311635 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f5bbbd9-20c8-4119-ac62-7bf387efceee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:39.372186 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2f5bbbd9-20c8-4119-ac62-7bf387efceee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:39.379743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2f5bbbd9-20c8-4119-ac62-7bf387efceee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082374 Aug 08 08:54:39.380298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 666/1302] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:39 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:40.109733 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a2cb50e3-eb47-4299-8209-524958aafc40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:40.111780 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a2cb50e3-eb47-4299-8209-524958aafc40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:40.118297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2cb50e3-eb47-4299-8209-524958aafc40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:40.118775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2cb50e3-eb47-4299-8209-524958aafc40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:40.119205 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2cb50e3-eb47-4299-8209-524958aafc40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:40.119883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2cb50e3-eb47-4299-8209-524958aafc40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:40.120338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2cb50e3-eb47-4299-8209-524958aafc40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:40.120754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2cb50e3-eb47-4299-8209-524958aafc40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:40.149605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a2cb50e3-eb47-4299-8209-524958aafc40 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044099 Aug 08 08:54:40.150147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 637/1303] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:40 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:40.400304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7dfeb1ef-fac8-4121-83ef-c5155d2fbe10 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:40.400920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7dfeb1ef-fac8-4121-83ef-c5155d2fbe10 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:40.407353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dfeb1ef-fac8-4121-83ef-c5155d2fbe10 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:40.407979 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dfeb1ef-fac8-4121-83ef-c5155d2fbe10 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:40.408267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dfeb1ef-fac8-4121-83ef-c5155d2fbe10 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:40.408962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dfeb1ef-fac8-4121-83ef-c5155d2fbe10 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:40.409448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dfeb1ef-fac8-4121-83ef-c5155d2fbe10 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:40.409922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dfeb1ef-fac8-4121-83ef-c5155d2fbe10 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:40.471569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7dfeb1ef-fac8-4121-83ef-c5155d2fbe10 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:40.479738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7dfeb1ef-fac8-4121-83ef-c5155d2fbe10 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083784 Aug 08 08:54:40.480301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 667/1304] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:40 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:41.161796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-88520e0a-9231-4d31-8d5b-483aa55ab556 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:41.163963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-88520e0a-9231-4d31-8d5b-483aa55ab556 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:41.170400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88520e0a-9231-4d31-8d5b-483aa55ab556 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:41.170885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88520e0a-9231-4d31-8d5b-483aa55ab556 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:41.171326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88520e0a-9231-4d31-8d5b-483aa55ab556 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:41.172014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88520e0a-9231-4d31-8d5b-483aa55ab556 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:41.172472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88520e0a-9231-4d31-8d5b-483aa55ab556 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:41.172900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88520e0a-9231-4d31-8d5b-483aa55ab556 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:41.201899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-88520e0a-9231-4d31-8d5b-483aa55ab556 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044085 Aug 08 08:54:41.202449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 638/1305] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:41 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:41.500559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6a5259ad-967c-4894-ae70-c21113be3030 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:41.501194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6a5259ad-967c-4894-ae70-c21113be3030 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:41.508064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6a5259ad-967c-4894-ae70-c21113be3030 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:41.508562 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6a5259ad-967c-4894-ae70-c21113be3030 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:41.509036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6a5259ad-967c-4894-ae70-c21113be3030 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:41.509743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6a5259ad-967c-4894-ae70-c21113be3030 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:41.510196 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6a5259ad-967c-4894-ae70-c21113be3030 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:41.510625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6a5259ad-967c-4894-ae70-c21113be3030 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:41.577642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6a5259ad-967c-4894-ae70-c21113be3030 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:41.586262 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6a5259ad-967c-4894-ae70-c21113be3030 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.089583 Aug 08 08:54:41.586834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 668/1306] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:41 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:42.214647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d52e2900-5af0-439c-9c9e-012a8617441d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:42.216862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d52e2900-5af0-439c-9c9e-012a8617441d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:42.223235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d52e2900-5af0-439c-9c9e-012a8617441d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:42.223722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d52e2900-5af0-439c-9c9e-012a8617441d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:42.224159 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d52e2900-5af0-439c-9c9e-012a8617441d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:42.224849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d52e2900-5af0-439c-9c9e-012a8617441d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:42.225337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d52e2900-5af0-439c-9c9e-012a8617441d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:42.225770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d52e2900-5af0-439c-9c9e-012a8617441d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:42.253991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d52e2900-5af0-439c-9c9e-012a8617441d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Aug 08 08:54:42.254536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 639/1307] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:42 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:42.606972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-77b73581-508b-4d5e-a560-2683773967a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:42.607780 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-77b73581-508b-4d5e-a560-2683773967a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:42.614170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77b73581-508b-4d5e-a560-2683773967a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:42.614657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77b73581-508b-4d5e-a560-2683773967a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:42.615097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77b73581-508b-4d5e-a560-2683773967a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:42.615793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77b73581-508b-4d5e-a560-2683773967a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:42.616761 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77b73581-508b-4d5e-a560-2683773967a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:42.617217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77b73581-508b-4d5e-a560-2683773967a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:42.677428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-77b73581-508b-4d5e-a560-2683773967a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:42.685371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-77b73581-508b-4d5e-a560-2683773967a3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082337 Aug 08 08:54:42.685934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 669/1308] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:42 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:43.266678 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a48c6611-3904-4f2e-a381-e209757f009e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:43.268802 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a48c6611-3904-4f2e-a381-e209757f009e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:43.275273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a48c6611-3904-4f2e-a381-e209757f009e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:43.275752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a48c6611-3904-4f2e-a381-e209757f009e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:43.276182 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a48c6611-3904-4f2e-a381-e209757f009e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:43.276865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a48c6611-3904-4f2e-a381-e209757f009e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:43.277350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a48c6611-3904-4f2e-a381-e209757f009e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:43.277777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a48c6611-3904-4f2e-a381-e209757f009e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:43.308803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a48c6611-3904-4f2e-a381-e209757f009e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046054 Aug 08 08:54:43.309383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 640/1309] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:43.706788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-43dbda92-e04f-432f-a8a0-84d5141c93d7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:43.707327 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-43dbda92-e04f-432f-a8a0-84d5141c93d7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:43.713686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43dbda92-e04f-432f-a8a0-84d5141c93d7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:43.714166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43dbda92-e04f-432f-a8a0-84d5141c93d7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:43.714599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43dbda92-e04f-432f-a8a0-84d5141c93d7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:43.715283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43dbda92-e04f-432f-a8a0-84d5141c93d7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:43.715731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43dbda92-e04f-432f-a8a0-84d5141c93d7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:43.716150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-43dbda92-e04f-432f-a8a0-84d5141c93d7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:43.776288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-43dbda92-e04f-432f-a8a0-84d5141c93d7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:43.783713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-43dbda92-e04f-432f-a8a0-84d5141c93d7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.080896 Aug 08 08:54:43.784263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 670/1310] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:43 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:44.321931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9af61550-284a-42d6-9c7c-8d816f51a486 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:44.324068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9af61550-284a-42d6-9c7c-8d816f51a486 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:44.330376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9af61550-284a-42d6-9c7c-8d816f51a486 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:44.330855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9af61550-284a-42d6-9c7c-8d816f51a486 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:44.331292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9af61550-284a-42d6-9c7c-8d816f51a486 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:44.331975 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9af61550-284a-42d6-9c7c-8d816f51a486 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:44.332435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9af61550-284a-42d6-9c7c-8d816f51a486 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:44.332862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9af61550-284a-42d6-9c7c-8d816f51a486 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:44.361679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9af61550-284a-42d6-9c7c-8d816f51a486 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Aug 08 08:54:44.362227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 641/1311] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:44.805132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-850c5787-1fb5-498b-946c-647f81a4a479 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:44.805766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-850c5787-1fb5-498b-946c-647f81a4a479 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:44.812184 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-850c5787-1fb5-498b-946c-647f81a4a479 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:44.812671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-850c5787-1fb5-498b-946c-647f81a4a479 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:44.813112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-850c5787-1fb5-498b-946c-647f81a4a479 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:44.813836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-850c5787-1fb5-498b-946c-647f81a4a479 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:44.814300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-850c5787-1fb5-498b-946c-647f81a4a479 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:44.814727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-850c5787-1fb5-498b-946c-647f81a4a479 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:44.877685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-850c5787-1fb5-498b-946c-647f81a4a479 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:44.886189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-850c5787-1fb5-498b-946c-647f81a4a479 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085462 Aug 08 08:54:44.886759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 671/1312] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:44 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:45.373608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-68a4cc54-673a-4cf8-b79b-bad77fd02418 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:45.375760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-68a4cc54-673a-4cf8-b79b-bad77fd02418 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:45.382381 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68a4cc54-673a-4cf8-b79b-bad77fd02418 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:45.382868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68a4cc54-673a-4cf8-b79b-bad77fd02418 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:45.383310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68a4cc54-673a-4cf8-b79b-bad77fd02418 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:45.383999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68a4cc54-673a-4cf8-b79b-bad77fd02418 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:45.384457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68a4cc54-673a-4cf8-b79b-bad77fd02418 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:45.384887 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68a4cc54-673a-4cf8-b79b-bad77fd02418 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:45.412767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-68a4cc54-673a-4cf8-b79b-bad77fd02418 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Aug 08 08:54:45.414127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 642/1313] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:45.907871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3ebcb100-322a-44d4-b16d-ec6a771ebc4d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:45.908496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3ebcb100-322a-44d4-b16d-ec6a771ebc4d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:45.915779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ebcb100-322a-44d4-b16d-ec6a771ebc4d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:45.916265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ebcb100-322a-44d4-b16d-ec6a771ebc4d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:45.916705 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ebcb100-322a-44d4-b16d-ec6a771ebc4d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:45.917434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ebcb100-322a-44d4-b16d-ec6a771ebc4d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:45.917894 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ebcb100-322a-44d4-b16d-ec6a771ebc4d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:45.918326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3ebcb100-322a-44d4-b16d-ec6a771ebc4d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:45.981972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3ebcb100-322a-44d4-b16d-ec6a771ebc4d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:45.989783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3ebcb100-322a-44d4-b16d-ec6a771ebc4d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086921 Aug 08 08:54:45.990294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 672/1314] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:45 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:46.424970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0026be73-29d9-454c-8957-e21350a1f3f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:46.430040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0026be73-29d9-454c-8957-e21350a1f3f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:46.433701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026be73-29d9-454c-8957-e21350a1f3f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:46.434184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026be73-29d9-454c-8957-e21350a1f3f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:46.434622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026be73-29d9-454c-8957-e21350a1f3f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:46.435309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026be73-29d9-454c-8957-e21350a1f3f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:46.435763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026be73-29d9-454c-8957-e21350a1f3f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:46.436191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0026be73-29d9-454c-8957-e21350a1f3f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:46.464941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0026be73-29d9-454c-8957-e21350a1f3f1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043908 Aug 08 08:54:46.465525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 643/1315] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:46 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:47.011029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-08ae3d7b-b677-442d-a3c8-16820556d1e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:47.011636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-08ae3d7b-b677-442d-a3c8-16820556d1e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:47.017969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-08ae3d7b-b677-442d-a3c8-16820556d1e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:47.018450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-08ae3d7b-b677-442d-a3c8-16820556d1e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:47.018882 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-08ae3d7b-b677-442d-a3c8-16820556d1e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:47.019564 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-08ae3d7b-b677-442d-a3c8-16820556d1e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:47.020018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-08ae3d7b-b677-442d-a3c8-16820556d1e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:47.020440 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-08ae3d7b-b677-442d-a3c8-16820556d1e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:47.331844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-08ae3d7b-b677-442d-a3c8-16820556d1e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:47.339501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-08ae3d7b-b677-442d-a3c8-16820556d1e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.332479 Aug 08 08:54:47.340061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 673/1316] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:47 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:47.477719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-76209d9c-801a-46cc-832b-7e0cb9388e84 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:47.479889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-76209d9c-801a-46cc-832b-7e0cb9388e84 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:47.486477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76209d9c-801a-46cc-832b-7e0cb9388e84 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:47.486959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76209d9c-801a-46cc-832b-7e0cb9388e84 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:47.487394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76209d9c-801a-46cc-832b-7e0cb9388e84 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:47.488079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76209d9c-801a-46cc-832b-7e0cb9388e84 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:47.488534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76209d9c-801a-46cc-832b-7e0cb9388e84 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:47.488958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76209d9c-801a-46cc-832b-7e0cb9388e84 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:47.518090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-76209d9c-801a-46cc-832b-7e0cb9388e84 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044846 Aug 08 08:54:47.518555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 644/1317] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:48.362708 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2101e263-81ba-44c7-970d-2652c6802142 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:48.363343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2101e263-81ba-44c7-970d-2652c6802142 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:48.369774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2101e263-81ba-44c7-970d-2652c6802142 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:48.370252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2101e263-81ba-44c7-970d-2652c6802142 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:48.370684 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2101e263-81ba-44c7-970d-2652c6802142 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:48.371363 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2101e263-81ba-44c7-970d-2652c6802142 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:48.371811 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2101e263-81ba-44c7-970d-2652c6802142 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:48.372232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2101e263-81ba-44c7-970d-2652c6802142 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:48.435247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2101e263-81ba-44c7-970d-2652c6802142 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:48.442674 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2101e263-81ba-44c7-970d-2652c6802142 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083891 Aug 08 08:54:48.443231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 674/1318] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:48 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:48.530160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4c0ac82e-a60d-46a3-a224-6b4344be2017 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:48.532299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4c0ac82e-a60d-46a3-a224-6b4344be2017 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:48.538649 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c0ac82e-a60d-46a3-a224-6b4344be2017 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:48.539154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c0ac82e-a60d-46a3-a224-6b4344be2017 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:48.539601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c0ac82e-a60d-46a3-a224-6b4344be2017 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:48.540290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c0ac82e-a60d-46a3-a224-6b4344be2017 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:48.540746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c0ac82e-a60d-46a3-a224-6b4344be2017 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:48.541199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c0ac82e-a60d-46a3-a224-6b4344be2017 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:48.570056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4c0ac82e-a60d-46a3-a224-6b4344be2017 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Aug 08 08:54:48.570695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 645/1319] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:49.464087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-67f93a2f-5dd7-4e59-bff7-10d7177e14b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:49.464695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-67f93a2f-5dd7-4e59-bff7-10d7177e14b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:49.471256 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67f93a2f-5dd7-4e59-bff7-10d7177e14b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:49.471738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67f93a2f-5dd7-4e59-bff7-10d7177e14b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:49.472170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67f93a2f-5dd7-4e59-bff7-10d7177e14b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:49.472854 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67f93a2f-5dd7-4e59-bff7-10d7177e14b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:49.473335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67f93a2f-5dd7-4e59-bff7-10d7177e14b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:49.473759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67f93a2f-5dd7-4e59-bff7-10d7177e14b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:49.533485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-67f93a2f-5dd7-4e59-bff7-10d7177e14b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:49.536838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:54:49.541319 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-67f93a2f-5dd7-4e59-bff7-10d7177e14b3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081142 Aug 08 08:54:49.541869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 675/1320] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:49 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:49.582020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4748e896-4a51-4338-a2d9-d1e8e4880e0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:49.584154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4748e896-4a51-4338-a2d9-d1e8e4880e0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:49.590429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4748e896-4a51-4338-a2d9-d1e8e4880e0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:49.590903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4748e896-4a51-4338-a2d9-d1e8e4880e0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:49.591339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4748e896-4a51-4338-a2d9-d1e8e4880e0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:49.592011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4748e896-4a51-4338-a2d9-d1e8e4880e0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:49.592459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4748e896-4a51-4338-a2d9-d1e8e4880e0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:49.592876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4748e896-4a51-4338-a2d9-d1e8e4880e0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:49.621771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4748e896-4a51-4338-a2d9-d1e8e4880e0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043656 Aug 08 08:54:49.622303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 646/1321] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:50.563168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-42b096fe-07ae-45be-a8d9-379d52852c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:50.563780 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-42b096fe-07ae-45be-a8d9-379d52852c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:50.570858 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42b096fe-07ae-45be-a8d9-379d52852c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:50.571288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42b096fe-07ae-45be-a8d9-379d52852c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:50.571727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42b096fe-07ae-45be-a8d9-379d52852c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:50.572479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42b096fe-07ae-45be-a8d9-379d52852c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:50.572939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42b096fe-07ae-45be-a8d9-379d52852c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:50.573395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42b096fe-07ae-45be-a8d9-379d52852c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:50.633452 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-31581c5c-df96-4c27-bc73-0c10f216b23e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:50.634679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-42b096fe-07ae-45be-a8d9-379d52852c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:50.635690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-31581c5c-df96-4c27-bc73-0c10f216b23e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:50.642215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31581c5c-df96-4c27-bc73-0c10f216b23e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:50.642384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-42b096fe-07ae-45be-a8d9-379d52852c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083298 Aug 08 08:54:50.642703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31581c5c-df96-4c27-bc73-0c10f216b23e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:50.642829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 676/1322] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:50 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:50.643149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31581c5c-df96-4c27-bc73-0c10f216b23e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:50.643846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31581c5c-df96-4c27-bc73-0c10f216b23e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:50.644303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31581c5c-df96-4c27-bc73-0c10f216b23e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:50.644729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31581c5c-df96-4c27-bc73-0c10f216b23e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:50.673489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-31581c5c-df96-4c27-bc73-0c10f216b23e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Aug 08 08:54:50.674029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 647/1323] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:50 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:54:51.664193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6d9c2bbb-a589-47c6-87ff-c9b26ad89af8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:51.664805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6d9c2bbb-a589-47c6-87ff-c9b26ad89af8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:51.670821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d9c2bbb-a589-47c6-87ff-c9b26ad89af8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:51.671305 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d9c2bbb-a589-47c6-87ff-c9b26ad89af8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:51.671745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d9c2bbb-a589-47c6-87ff-c9b26ad89af8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:51.672434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d9c2bbb-a589-47c6-87ff-c9b26ad89af8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:51.672894 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d9c2bbb-a589-47c6-87ff-c9b26ad89af8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:51.673357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d9c2bbb-a589-47c6-87ff-c9b26ad89af8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:51.684964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1cf94c6b-9f23-4ea0-a5ca-bfa574199b07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:51.687157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1cf94c6b-9f23-4ea0-a5ca-bfa574199b07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:51.693551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf94c6b-9f23-4ea0-a5ca-bfa574199b07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:51.694028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf94c6b-9f23-4ea0-a5ca-bfa574199b07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:51.694598 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf94c6b-9f23-4ea0-a5ca-bfa574199b07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:51.695294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf94c6b-9f23-4ea0-a5ca-bfa574199b07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:51.695742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf94c6b-9f23-4ea0-a5ca-bfa574199b07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:51.696161 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1cf94c6b-9f23-4ea0-a5ca-bfa574199b07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:51.725416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1cf94c6b-9f23-4ea0-a5ca-bfa574199b07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 Aug 08 08:54:51.726584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 648/1324] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:51 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:54:51.735670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6d9c2bbb-a589-47c6-87ff-c9b26ad89af8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:51.743449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6d9c2bbb-a589-47c6-87ff-c9b26ad89af8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084111 Aug 08 08:54:51.744011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 677/1325] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:51 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:52.738684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-03a2f660-0904-4338-9dce-40a6f6109bb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:52.740887 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-03a2f660-0904-4338-9dce-40a6f6109bb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:52.747609 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03a2f660-0904-4338-9dce-40a6f6109bb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:52.748125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03a2f660-0904-4338-9dce-40a6f6109bb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:52.748564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03a2f660-0904-4338-9dce-40a6f6109bb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:52.749308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03a2f660-0904-4338-9dce-40a6f6109bb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:52.749770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03a2f660-0904-4338-9dce-40a6f6109bb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:52.750198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03a2f660-0904-4338-9dce-40a6f6109bb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:52.763642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a64fd4b6-a4cd-487b-8d3b-2ab46c3ad80f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:52.764925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a64fd4b6-a4cd-487b-8d3b-2ab46c3ad80f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:52.771680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a64fd4b6-a4cd-487b-8d3b-2ab46c3ad80f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:52.772165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a64fd4b6-a4cd-487b-8d3b-2ab46c3ad80f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:52.773332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a64fd4b6-a4cd-487b-8d3b-2ab46c3ad80f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:52.774034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a64fd4b6-a4cd-487b-8d3b-2ab46c3ad80f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:52.774488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a64fd4b6-a4cd-487b-8d3b-2ab46c3ad80f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:52.774916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a64fd4b6-a4cd-487b-8d3b-2ab46c3ad80f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:52.779921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-03a2f660-0904-4338-9dce-40a6f6109bb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045169 Aug 08 08:54:52.780475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 649/1326] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:52 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:52.836836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a64fd4b6-a4cd-487b-8d3b-2ab46c3ad80f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:52.844466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a64fd4b6-a4cd-487b-8d3b-2ab46c3ad80f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084630 Aug 08 08:54:52.845034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 678/1327] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:52 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:54:53.792648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0a06adb7-1899-402f-b50c-2fdb4ca1f3e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:53.794911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0a06adb7-1899-402f-b50c-2fdb4ca1f3e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:53.801372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a06adb7-1899-402f-b50c-2fdb4ca1f3e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:53.801858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a06adb7-1899-402f-b50c-2fdb4ca1f3e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:53.802300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a06adb7-1899-402f-b50c-2fdb4ca1f3e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:53.802993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a06adb7-1899-402f-b50c-2fdb4ca1f3e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:53.803482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a06adb7-1899-402f-b50c-2fdb4ca1f3e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:53.804230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a06adb7-1899-402f-b50c-2fdb4ca1f3e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:53.806599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:54:53.832881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0a06adb7-1899-402f-b50c-2fdb4ca1f3e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044883 Aug 08 08:54:53.833466 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 650/1328] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:53 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:53.864369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-66f44ed5-8e71-48bb-96d9-ab9d27a4328a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:53.864993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-66f44ed5-8e71-48bb-96d9-ab9d27a4328a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:53.871501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66f44ed5-8e71-48bb-96d9-ab9d27a4328a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:53.871984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66f44ed5-8e71-48bb-96d9-ab9d27a4328a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:53.872417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66f44ed5-8e71-48bb-96d9-ab9d27a4328a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:53.873110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66f44ed5-8e71-48bb-96d9-ab9d27a4328a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:53.873587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66f44ed5-8e71-48bb-96d9-ab9d27a4328a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:53.874007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-66f44ed5-8e71-48bb-96d9-ab9d27a4328a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:53.938422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-66f44ed5-8e71-48bb-96d9-ab9d27a4328a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:53.946180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-66f44ed5-8e71-48bb-96d9-ab9d27a4328a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085636 Aug 08 08:54:53.951399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 679/1329] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:53 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:54.846290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6f90cefc-7ee1-41cb-98fc-c88dd7d5e547 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:54.848375 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6f90cefc-7ee1-41cb-98fc-c88dd7d5e547 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:54.856003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f90cefc-7ee1-41cb-98fc-c88dd7d5e547 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:54.856486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f90cefc-7ee1-41cb-98fc-c88dd7d5e547 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:54.856925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f90cefc-7ee1-41cb-98fc-c88dd7d5e547 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:54.857658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f90cefc-7ee1-41cb-98fc-c88dd7d5e547 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:54.858380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f90cefc-7ee1-41cb-98fc-c88dd7d5e547 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:54.858812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6f90cefc-7ee1-41cb-98fc-c88dd7d5e547 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:54.887226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6f90cefc-7ee1-41cb-98fc-c88dd7d5e547 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045055 Aug 08 08:54:54.887766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 651/1330] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:54 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:54.966277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-17371bad-95fd-4e6e-9156-0a258c94c6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:54.966887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-17371bad-95fd-4e6e-9156-0a258c94c6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:54.973272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17371bad-95fd-4e6e-9156-0a258c94c6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:54.973754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17371bad-95fd-4e6e-9156-0a258c94c6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:54.974187 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17371bad-95fd-4e6e-9156-0a258c94c6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:54.974867 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17371bad-95fd-4e6e-9156-0a258c94c6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:54.975858 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17371bad-95fd-4e6e-9156-0a258c94c6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:54.976287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17371bad-95fd-4e6e-9156-0a258c94c6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:55.036790 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-17371bad-95fd-4e6e-9156-0a258c94c6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:55.044863 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-17371bad-95fd-4e6e-9156-0a258c94c6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082437 Aug 08 08:54:55.045455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 680/1331] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:54 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:55.900104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fb51a8a0-254c-4136-8ada-e2e37a194664 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:55.902330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fb51a8a0-254c-4136-8ada-e2e37a194664 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:55.908682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb51a8a0-254c-4136-8ada-e2e37a194664 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:55.909188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb51a8a0-254c-4136-8ada-e2e37a194664 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:55.909636 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb51a8a0-254c-4136-8ada-e2e37a194664 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:55.910319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb51a8a0-254c-4136-8ada-e2e37a194664 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:55.910772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb51a8a0-254c-4136-8ada-e2e37a194664 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:55.911203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb51a8a0-254c-4136-8ada-e2e37a194664 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:55.939631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fb51a8a0-254c-4136-8ada-e2e37a194664 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Aug 08 08:54:55.940184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 652/1332] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:56.066015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8cf4545c-9017-46cc-9c49-db4732e832a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:56.066584 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8cf4545c-9017-46cc-9c49-db4732e832a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:56.073886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cf4545c-9017-46cc-9c49-db4732e832a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:56.074371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cf4545c-9017-46cc-9c49-db4732e832a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:56.074835 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cf4545c-9017-46cc-9c49-db4732e832a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:56.075523 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cf4545c-9017-46cc-9c49-db4732e832a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:56.075974 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cf4545c-9017-46cc-9c49-db4732e832a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:56.076391 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cf4545c-9017-46cc-9c49-db4732e832a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:56.137745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8cf4545c-9017-46cc-9c49-db4732e832a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:56.145188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8cf4545c-9017-46cc-9c49-db4732e832a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083056 Aug 08 08:54:56.145747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 681/1333] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:56 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:56.952269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-264ffb9b-4f88-4e97-b34f-1cb308591150 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:56.954478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-264ffb9b-4f88-4e97-b34f-1cb308591150 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:56.961020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-264ffb9b-4f88-4e97-b34f-1cb308591150 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:56.961533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-264ffb9b-4f88-4e97-b34f-1cb308591150 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:56.961971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-264ffb9b-4f88-4e97-b34f-1cb308591150 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:56.962658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-264ffb9b-4f88-4e97-b34f-1cb308591150 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:56.963111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-264ffb9b-4f88-4e97-b34f-1cb308591150 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:56.963539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-264ffb9b-4f88-4e97-b34f-1cb308591150 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:56.997506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-264ffb9b-4f88-4e97-b34f-1cb308591150 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049071 Aug 08 08:54:56.998088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 653/1334] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:57.164947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7e2d8946-81a0-4bc6-b457-0c08679e3d86 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:57.165601 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7e2d8946-81a0-4bc6-b457-0c08679e3d86 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:57.172058 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e2d8946-81a0-4bc6-b457-0c08679e3d86 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:57.172546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e2d8946-81a0-4bc6-b457-0c08679e3d86 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:57.172980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e2d8946-81a0-4bc6-b457-0c08679e3d86 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:57.173704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e2d8946-81a0-4bc6-b457-0c08679e3d86 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:57.174160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e2d8946-81a0-4bc6-b457-0c08679e3d86 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:57.174587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e2d8946-81a0-4bc6-b457-0c08679e3d86 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:57.236775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7e2d8946-81a0-4bc6-b457-0c08679e3d86 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:57.244590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7e2d8946-81a0-4bc6-b457-0c08679e3d86 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083660 Aug 08 08:54:57.245156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 682/1335] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:57 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:58.010629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f23172db-30e9-464a-915f-4ef88c485c65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:58.012759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f23172db-30e9-464a-915f-4ef88c485c65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:58.019091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f23172db-30e9-464a-915f-4ef88c485c65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:58.019569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f23172db-30e9-464a-915f-4ef88c485c65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:58.020003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f23172db-30e9-464a-915f-4ef88c485c65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:58.020682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f23172db-30e9-464a-915f-4ef88c485c65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:58.021131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f23172db-30e9-464a-915f-4ef88c485c65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:58.021574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f23172db-30e9-464a-915f-4ef88c485c65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:58.049642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f23172db-30e9-464a-915f-4ef88c485c65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043669 Aug 08 08:54:58.050179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 654/1336] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:58.265729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e7f1b716-70e8-4a11-b9e3-0d1505c325df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:58.266265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e7f1b716-70e8-4a11-b9e3-0d1505c325df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:58.272580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7f1b716-70e8-4a11-b9e3-0d1505c325df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:58.273059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7f1b716-70e8-4a11-b9e3-0d1505c325df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:58.273522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7f1b716-70e8-4a11-b9e3-0d1505c325df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:58.274207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7f1b716-70e8-4a11-b9e3-0d1505c325df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:58.274660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7f1b716-70e8-4a11-b9e3-0d1505c325df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:58.275085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7f1b716-70e8-4a11-b9e3-0d1505c325df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:58.339159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e7f1b716-70e8-4a11-b9e3-0d1505c325df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:58.346673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e7f1b716-70e8-4a11-b9e3-0d1505c325df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084893 Aug 08 08:54:58.347232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 683/1337] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:58 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:54:58.747663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 08:54:58.747926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 08:54:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 08:54:59.061950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-99681595-0cb0-4313-b4d7-d81b34afe8c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:59.064005 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-99681595-0cb0-4313-b4d7-d81b34afe8c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:59.070393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99681595-0cb0-4313-b4d7-d81b34afe8c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:59.070876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99681595-0cb0-4313-b4d7-d81b34afe8c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:59.071314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99681595-0cb0-4313-b4d7-d81b34afe8c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:59.071997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99681595-0cb0-4313-b4d7-d81b34afe8c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:59.072446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99681595-0cb0-4313-b4d7-d81b34afe8c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:59.072868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99681595-0cb0-4313-b4d7-d81b34afe8c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:59.101601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-99681595-0cb0-4313-b4d7-d81b34afe8c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043600 Aug 08 08:54:59.102161 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 655/1338] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:54:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:54:59.367366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3f77c2a7-1c49-4ff3-b15f-aa4ab29f7dbe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:54:59.367987 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3f77c2a7-1c49-4ff3-b15f-aa4ab29f7dbe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:54:59.374408 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f77c2a7-1c49-4ff3-b15f-aa4ab29f7dbe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:59.374895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f77c2a7-1c49-4ff3-b15f-aa4ab29f7dbe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:59.375331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f77c2a7-1c49-4ff3-b15f-aa4ab29f7dbe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:59.376023 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f77c2a7-1c49-4ff3-b15f-aa4ab29f7dbe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:54:59.376477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f77c2a7-1c49-4ff3-b15f-aa4ab29f7dbe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:54:59.376904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f77c2a7-1c49-4ff3-b15f-aa4ab29f7dbe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:54:59.440393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3f77c2a7-1c49-4ff3-b15f-aa4ab29f7dbe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:54:59.448788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3f77c2a7-1c49-4ff3-b15f-aa4ab29f7dbe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085443 Aug 08 08:54:59.449372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 684/1339] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:54:59 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:00.114442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fff9ca6e-a45a-43ed-8cb6-4c4781ded469 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:00.117195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fff9ca6e-a45a-43ed-8cb6-4c4781ded469 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:00.123677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fff9ca6e-a45a-43ed-8cb6-4c4781ded469 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:00.124161 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fff9ca6e-a45a-43ed-8cb6-4c4781ded469 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:00.124600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fff9ca6e-a45a-43ed-8cb6-4c4781ded469 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:00.125339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fff9ca6e-a45a-43ed-8cb6-4c4781ded469 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:00.125794 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fff9ca6e-a45a-43ed-8cb6-4c4781ded469 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:00.126222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fff9ca6e-a45a-43ed-8cb6-4c4781ded469 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:00.154386 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fff9ca6e-a45a-43ed-8cb6-4c4781ded469 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044136 Aug 08 08:55:00.154937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 656/1340] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:00 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:00.477337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6440f279-c7fb-4292-a49a-09c72cc466d6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:00.477954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6440f279-c7fb-4292-a49a-09c72cc466d6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:00.484715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6440f279-c7fb-4292-a49a-09c72cc466d6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:00.485232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6440f279-c7fb-4292-a49a-09c72cc466d6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:00.485675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6440f279-c7fb-4292-a49a-09c72cc466d6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:00.486366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6440f279-c7fb-4292-a49a-09c72cc466d6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:00.486824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6440f279-c7fb-4292-a49a-09c72cc466d6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:00.487251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6440f279-c7fb-4292-a49a-09c72cc466d6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:00.548822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6440f279-c7fb-4292-a49a-09c72cc466d6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:00.556347 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6440f279-c7fb-4292-a49a-09c72cc466d6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083621 Aug 08 08:55:00.556908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 685/1341] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:00 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:01.167137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0f055e7a-26e2-4e74-a27b-537ee0de0cb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:01.169378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0f055e7a-26e2-4e74-a27b-537ee0de0cb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:01.175859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f055e7a-26e2-4e74-a27b-537ee0de0cb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:01.176346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f055e7a-26e2-4e74-a27b-537ee0de0cb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:01.176788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f055e7a-26e2-4e74-a27b-537ee0de0cb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:01.177501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f055e7a-26e2-4e74-a27b-537ee0de0cb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:01.178021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f055e7a-26e2-4e74-a27b-537ee0de0cb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:01.178479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f055e7a-26e2-4e74-a27b-537ee0de0cb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:01.206492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0f055e7a-26e2-4e74-a27b-537ee0de0cb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043482 Aug 08 08:55:01.207039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 657/1342] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:01 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:01.577166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a4249fc1-111e-4161-bf83-6e96ee33b946 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:01.577808 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a4249fc1-111e-4161-bf83-6e96ee33b946 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:01.584168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4249fc1-111e-4161-bf83-6e96ee33b946 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:01.584660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4249fc1-111e-4161-bf83-6e96ee33b946 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:01.585182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4249fc1-111e-4161-bf83-6e96ee33b946 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:01.585884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4249fc1-111e-4161-bf83-6e96ee33b946 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:01.586343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4249fc1-111e-4161-bf83-6e96ee33b946 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:01.586776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4249fc1-111e-4161-bf83-6e96ee33b946 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:01.647621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a4249fc1-111e-4161-bf83-6e96ee33b946 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:01.655146 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a4249fc1-111e-4161-bf83-6e96ee33b946 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081859 Aug 08 08:55:01.655706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 686/1343] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:01 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:02.219399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-23b60eb3-9f50-4210-9c99-cb4b18b83975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:02.221614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-23b60eb3-9f50-4210-9c99-cb4b18b83975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:02.228653 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-23b60eb3-9f50-4210-9c99-cb4b18b83975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:02.229128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-23b60eb3-9f50-4210-9c99-cb4b18b83975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:02.229584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-23b60eb3-9f50-4210-9c99-cb4b18b83975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:02.230265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-23b60eb3-9f50-4210-9c99-cb4b18b83975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:02.230716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-23b60eb3-9f50-4210-9c99-cb4b18b83975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:02.231138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-23b60eb3-9f50-4210-9c99-cb4b18b83975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:02.258760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-23b60eb3-9f50-4210-9c99-cb4b18b83975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043256 Aug 08 08:55:02.259292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 658/1344] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:02 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:02.675942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ca774cfb-3aeb-4b4e-9cda-9a1a5a7cea90 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:02.676556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ca774cfb-3aeb-4b4e-9cda-9a1a5a7cea90 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:02.683007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca774cfb-3aeb-4b4e-9cda-9a1a5a7cea90 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:02.683493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca774cfb-3aeb-4b4e-9cda-9a1a5a7cea90 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:02.683931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca774cfb-3aeb-4b4e-9cda-9a1a5a7cea90 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:02.684620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca774cfb-3aeb-4b4e-9cda-9a1a5a7cea90 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:02.685078 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca774cfb-3aeb-4b4e-9cda-9a1a5a7cea90 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:02.685534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca774cfb-3aeb-4b4e-9cda-9a1a5a7cea90 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:02.749952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ca774cfb-3aeb-4b4e-9cda-9a1a5a7cea90 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:02.758168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ca774cfb-3aeb-4b4e-9cda-9a1a5a7cea90 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086046 Aug 08 08:55:02.758756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 687/1345] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:02 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:03.275118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-14d92d2b-44fa-4c16-84aa-7a2c4d2ad78d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:03.277304 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-14d92d2b-44fa-4c16-84aa-7a2c4d2ad78d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:03.283650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14d92d2b-44fa-4c16-84aa-7a2c4d2ad78d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:03.284137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14d92d2b-44fa-4c16-84aa-7a2c4d2ad78d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:03.284582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14d92d2b-44fa-4c16-84aa-7a2c4d2ad78d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:03.285310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14d92d2b-44fa-4c16-84aa-7a2c4d2ad78d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:03.285773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14d92d2b-44fa-4c16-84aa-7a2c4d2ad78d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:03.286211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14d92d2b-44fa-4c16-84aa-7a2c4d2ad78d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:03.315100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-14d92d2b-44fa-4c16-84aa-7a2c4d2ad78d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044143 Aug 08 08:55:03.315645 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 659/1346] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:03.779109 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e416868a-1740-41b0-8828-c2bcf83c5ccd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:03.779720 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e416868a-1740-41b0-8828-c2bcf83c5ccd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:03.786055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e416868a-1740-41b0-8828-c2bcf83c5ccd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:03.786540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e416868a-1740-41b0-8828-c2bcf83c5ccd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:03.786972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e416868a-1740-41b0-8828-c2bcf83c5ccd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:03.788317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e416868a-1740-41b0-8828-c2bcf83c5ccd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:03.788822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e416868a-1740-41b0-8828-c2bcf83c5ccd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:03.789289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e416868a-1740-41b0-8828-c2bcf83c5ccd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:03.851469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e416868a-1740-41b0-8828-c2bcf83c5ccd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:03.859096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e416868a-1740-41b0-8828-c2bcf83c5ccd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083803 Aug 08 08:55:03.859648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 688/1347] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:03 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:04.327388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-233896b7-2a4c-4401-9ee7-a0d570f446d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:04.329600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-233896b7-2a4c-4401-9ee7-a0d570f446d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:04.335928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-233896b7-2a4c-4401-9ee7-a0d570f446d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:04.336411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-233896b7-2a4c-4401-9ee7-a0d570f446d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:04.336850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-233896b7-2a4c-4401-9ee7-a0d570f446d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:04.337571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-233896b7-2a4c-4401-9ee7-a0d570f446d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:04.338025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-233896b7-2a4c-4401-9ee7-a0d570f446d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:04.338448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-233896b7-2a4c-4401-9ee7-a0d570f446d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:04.366976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-233896b7-2a4c-4401-9ee7-a0d570f446d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 Aug 08 08:55:04.367515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 660/1348] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:04.879244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fc8dd2f2-4979-4802-85cb-6448c8c0d56e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:04.879855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fc8dd2f2-4979-4802-85cb-6448c8c0d56e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:04.886613 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8dd2f2-4979-4802-85cb-6448c8c0d56e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:04.887097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8dd2f2-4979-4802-85cb-6448c8c0d56e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:04.887536 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8dd2f2-4979-4802-85cb-6448c8c0d56e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:04.888224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8dd2f2-4979-4802-85cb-6448c8c0d56e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:04.888681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8dd2f2-4979-4802-85cb-6448c8c0d56e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:04.889108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc8dd2f2-4979-4802-85cb-6448c8c0d56e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:04.950235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fc8dd2f2-4979-4802-85cb-6448c8c0d56e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:04.957687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fc8dd2f2-4979-4802-85cb-6448c8c0d56e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082296 Aug 08 08:55:04.958248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 689/1349] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:04 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:05.378678 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2fb8db6c-9e34-4a7f-88ef-958bd62eb58b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:05.381093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2fb8db6c-9e34-4a7f-88ef-958bd62eb58b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:05.383456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=60 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:55:05.388074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2fb8db6c-9e34-4a7f-88ef-958bd62eb58b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:05.388633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2fb8db6c-9e34-4a7f-88ef-958bd62eb58b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:05.389079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2fb8db6c-9e34-4a7f-88ef-958bd62eb58b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:05.395276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2fb8db6c-9e34-4a7f-88ef-958bd62eb58b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:05.395276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2fb8db6c-9e34-4a7f-88ef-958bd62eb58b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:05.395276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2fb8db6c-9e34-4a7f-88ef-958bd62eb58b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:05.421244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2fb8db6c-9e34-4a7f-88ef-958bd62eb58b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046514 Aug 08 08:55:05.421795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 661/1350] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:05 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:05.983962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6d23e847-08e4-44ca-a395-eae5616d2924 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:05.984571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6d23e847-08e4-44ca-a395-eae5616d2924 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:05.991026 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d23e847-08e4-44ca-a395-eae5616d2924 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:05.991457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d23e847-08e4-44ca-a395-eae5616d2924 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:05.991970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d23e847-08e4-44ca-a395-eae5616d2924 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:05.992808 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d23e847-08e4-44ca-a395-eae5616d2924 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:05.993290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d23e847-08e4-44ca-a395-eae5616d2924 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:05.993719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6d23e847-08e4-44ca-a395-eae5616d2924 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:06.054813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6d23e847-08e4-44ca-a395-eae5616d2924 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:06.062236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6d23e847-08e4-44ca-a395-eae5616d2924 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082343 Aug 08 08:55:06.062782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 690/1351] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:05 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:06.434522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7a71946b-f8cb-4bf7-b7c7-3bfd4d1b2c7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:06.436784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7a71946b-f8cb-4bf7-b7c7-3bfd4d1b2c7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:06.443188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a71946b-f8cb-4bf7-b7c7-3bfd4d1b2c7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:06.443681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a71946b-f8cb-4bf7-b7c7-3bfd4d1b2c7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:06.444123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a71946b-f8cb-4bf7-b7c7-3bfd4d1b2c7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:06.445490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a71946b-f8cb-4bf7-b7c7-3bfd4d1b2c7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:06.446146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a71946b-f8cb-4bf7-b7c7-3bfd4d1b2c7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:06.446576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7a71946b-f8cb-4bf7-b7c7-3bfd4d1b2c7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:06.474181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7a71946b-f8cb-4bf7-b7c7-3bfd4d1b2c7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Aug 08 08:55:06.474731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 662/1352] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:06 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:07.082691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ceb51616-bbe9-4970-9d60-38fc0c6a5be1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:07.083436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ceb51616-bbe9-4970-9d60-38fc0c6a5be1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:07.085780 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=56 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:55:07.090439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ceb51616-bbe9-4970-9d60-38fc0c6a5be1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:07.090930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ceb51616-bbe9-4970-9d60-38fc0c6a5be1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:07.091376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ceb51616-bbe9-4970-9d60-38fc0c6a5be1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:07.092076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ceb51616-bbe9-4970-9d60-38fc0c6a5be1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:07.092539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ceb51616-bbe9-4970-9d60-38fc0c6a5be1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:07.092972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ceb51616-bbe9-4970-9d60-38fc0c6a5be1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:07.157446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ceb51616-bbe9-4970-9d60-38fc0c6a5be1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:07.166232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ceb51616-bbe9-4970-9d60-38fc0c6a5be1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.087379 Aug 08 08:55:07.166792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 691/1353] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:07 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:07.486295 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-08689073-d539-442c-8fbd-462678d3f51c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:07.488443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-08689073-d539-442c-8fbd-462678d3f51c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:07.495079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08689073-d539-442c-8fbd-462678d3f51c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:07.495556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08689073-d539-442c-8fbd-462678d3f51c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:07.495992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08689073-d539-442c-8fbd-462678d3f51c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:07.496671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08689073-d539-442c-8fbd-462678d3f51c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:07.497119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08689073-d539-442c-8fbd-462678d3f51c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:07.497569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08689073-d539-442c-8fbd-462678d3f51c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:07.526355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-08689073-d539-442c-8fbd-462678d3f51c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 Aug 08 08:55:07.526905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 663/1354] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:07 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:08.187756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-eee6c2dd-921b-4b34-85f7-547d7bed2879 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:08.188286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-eee6c2dd-921b-4b34-85f7-547d7bed2879 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:08.195062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eee6c2dd-921b-4b34-85f7-547d7bed2879 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:08.195877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eee6c2dd-921b-4b34-85f7-547d7bed2879 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:08.196326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eee6c2dd-921b-4b34-85f7-547d7bed2879 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:08.197240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eee6c2dd-921b-4b34-85f7-547d7bed2879 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:08.197744 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eee6c2dd-921b-4b34-85f7-547d7bed2879 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:08.198174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eee6c2dd-921b-4b34-85f7-547d7bed2879 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:08.217403 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:55:08.262088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-eee6c2dd-921b-4b34-85f7-547d7bed2879 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:08.269686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-eee6c2dd-921b-4b34-85f7-547d7bed2879 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085842 Aug 08 08:55:08.270239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 692/1355] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:08 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:08.538998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d733b2b3-b69a-4746-b838-cdb4061d8e33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:08.542050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d733b2b3-b69a-4746-b838-cdb4061d8e33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:08.548476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d733b2b3-b69a-4746-b838-cdb4061d8e33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:08.548962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d733b2b3-b69a-4746-b838-cdb4061d8e33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:08.549439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d733b2b3-b69a-4746-b838-cdb4061d8e33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:08.550178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d733b2b3-b69a-4746-b838-cdb4061d8e33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:08.550652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d733b2b3-b69a-4746-b838-cdb4061d8e33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:08.551060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d733b2b3-b69a-4746-b838-cdb4061d8e33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:08.582130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d733b2b3-b69a-4746-b838-cdb4061d8e33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047127 Aug 08 08:55:08.582691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 664/1356] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:08 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:09.291217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cc62c173-15dd-4975-a781-6e741aaad810 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:09.291853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cc62c173-15dd-4975-a781-6e741aaad810 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:09.298309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc62c173-15dd-4975-a781-6e741aaad810 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:09.298797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc62c173-15dd-4975-a781-6e741aaad810 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:09.299241 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc62c173-15dd-4975-a781-6e741aaad810 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:09.299933 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc62c173-15dd-4975-a781-6e741aaad810 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:09.300393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc62c173-15dd-4975-a781-6e741aaad810 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:09.300820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc62c173-15dd-4975-a781-6e741aaad810 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:09.362752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cc62c173-15dd-4975-a781-6e741aaad810 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:09.370318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cc62c173-15dd-4975-a781-6e741aaad810 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083251 Aug 08 08:55:09.370875 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 693/1357] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:09 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:09.594404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-39afc168-fc4a-4bb3-9c7c-ee51a9b7bdba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:09.596468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-39afc168-fc4a-4bb3-9c7c-ee51a9b7bdba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:09.602806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39afc168-fc4a-4bb3-9c7c-ee51a9b7bdba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:09.603281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39afc168-fc4a-4bb3-9c7c-ee51a9b7bdba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:09.603712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39afc168-fc4a-4bb3-9c7c-ee51a9b7bdba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:09.604390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39afc168-fc4a-4bb3-9c7c-ee51a9b7bdba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:09.604838 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39afc168-fc4a-4bb3-9c7c-ee51a9b7bdba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:09.605287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39afc168-fc4a-4bb3-9c7c-ee51a9b7bdba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:09.633291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-39afc168-fc4a-4bb3-9c7c-ee51a9b7bdba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 Aug 08 08:55:09.634448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 665/1358] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:55:10.391410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9edd2a25-5507-4ce9-b5af-cef447132a4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:10.392533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9edd2a25-5507-4ce9-b5af-cef447132a4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:10.402631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9edd2a25-5507-4ce9-b5af-cef447132a4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:10.403118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9edd2a25-5507-4ce9-b5af-cef447132a4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:10.403553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9edd2a25-5507-4ce9-b5af-cef447132a4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:10.404380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9edd2a25-5507-4ce9-b5af-cef447132a4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:10.404834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9edd2a25-5507-4ce9-b5af-cef447132a4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:10.405292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9edd2a25-5507-4ce9-b5af-cef447132a4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:10.471758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9edd2a25-5507-4ce9-b5af-cef447132a4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:10.480153 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9edd2a25-5507-4ce9-b5af-cef447132a4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.093304 Aug 08 08:55:10.480733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 694/1359] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:10 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:10.646712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a3cdf753-9f25-49b3-9e89-01905dfafaab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:10.650822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a3cdf753-9f25-49b3-9e89-01905dfafaab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:10.658807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdf753-9f25-49b3-9e89-01905dfafaab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:10.659292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdf753-9f25-49b3-9e89-01905dfafaab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:10.659726 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdf753-9f25-49b3-9e89-01905dfafaab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:10.660416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdf753-9f25-49b3-9e89-01905dfafaab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:10.660867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdf753-9f25-49b3-9e89-01905dfafaab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:10.661316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdf753-9f25-49b3-9e89-01905dfafaab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:10.686745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:55:10.691576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a3cdf753-9f25-49b3-9e89-01905dfafaab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049895 Aug 08 08:55:10.700751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 666/1360] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:10 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:11.500893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fa057858-910b-48c2-846e-ccffec2e51ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:11.501537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fa057858-910b-48c2-846e-ccffec2e51ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:11.508064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa057858-910b-48c2-846e-ccffec2e51ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:11.509160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa057858-910b-48c2-846e-ccffec2e51ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:11.509600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa057858-910b-48c2-846e-ccffec2e51ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:11.510283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa057858-910b-48c2-846e-ccffec2e51ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:11.510739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa057858-910b-48c2-846e-ccffec2e51ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:11.511162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa057858-910b-48c2-846e-ccffec2e51ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:11.577919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fa057858-910b-48c2-846e-ccffec2e51ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:11.585399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fa057858-910b-48c2-846e-ccffec2e51ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.088281 Aug 08 08:55:11.585950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 695/1361] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:11 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:11.711148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-aef1818a-7fd1-4e64-afb9-c4eaf9fbc249 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:11.713905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-aef1818a-7fd1-4e64-afb9-c4eaf9fbc249 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:11.720789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aef1818a-7fd1-4e64-afb9-c4eaf9fbc249 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:11.721297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aef1818a-7fd1-4e64-afb9-c4eaf9fbc249 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:11.721731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aef1818a-7fd1-4e64-afb9-c4eaf9fbc249 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:11.722413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aef1818a-7fd1-4e64-afb9-c4eaf9fbc249 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:11.722866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aef1818a-7fd1-4e64-afb9-c4eaf9fbc249 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:11.723288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aef1818a-7fd1-4e64-afb9-c4eaf9fbc249 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:11.752029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-aef1818a-7fd1-4e64-afb9-c4eaf9fbc249 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Aug 08 08:55:11.752580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 667/1362] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:11 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:11.988444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 08:55:11.988661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 08:55:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 08:55:12.606330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c971852c-6978-4d44-a436-84f79148f34b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:12.606945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c971852c-6978-4d44-a436-84f79148f34b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:12.613600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c971852c-6978-4d44-a436-84f79148f34b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:12.614088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c971852c-6978-4d44-a436-84f79148f34b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:12.614524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c971852c-6978-4d44-a436-84f79148f34b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:12.615213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c971852c-6978-4d44-a436-84f79148f34b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:12.615669 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c971852c-6978-4d44-a436-84f79148f34b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:12.616095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c971852c-6978-4d44-a436-84f79148f34b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:12.676633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c971852c-6978-4d44-a436-84f79148f34b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:12.684689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c971852c-6978-4d44-a436-84f79148f34b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082333 Aug 08 08:55:12.685268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 696/1363] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:12 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:12.764583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-456c7228-2621-4d0e-808d-fbf595e7a8dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:12.766787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-456c7228-2621-4d0e-808d-fbf595e7a8dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:12.773070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456c7228-2621-4d0e-808d-fbf595e7a8dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:12.773579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456c7228-2621-4d0e-808d-fbf595e7a8dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:12.774134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456c7228-2621-4d0e-808d-fbf595e7a8dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:12.774775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456c7228-2621-4d0e-808d-fbf595e7a8dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:12.775224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456c7228-2621-4d0e-808d-fbf595e7a8dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:12.775643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456c7228-2621-4d0e-808d-fbf595e7a8dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:12.803825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-456c7228-2621-4d0e-808d-fbf595e7a8dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043176 Aug 08 08:55:12.804358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 668/1364] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:12 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:13.705737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b5352a76-68c4-48d6-93c4-ac42c6223c28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:13.706251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b5352a76-68c4-48d6-93c4-ac42c6223c28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:13.713538 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5352a76-68c4-48d6-93c4-ac42c6223c28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:13.714023 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5352a76-68c4-48d6-93c4-ac42c6223c28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:13.714458 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5352a76-68c4-48d6-93c4-ac42c6223c28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:13.715143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5352a76-68c4-48d6-93c4-ac42c6223c28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:13.715593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5352a76-68c4-48d6-93c4-ac42c6223c28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:13.716016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5352a76-68c4-48d6-93c4-ac42c6223c28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:13.776503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b5352a76-68c4-48d6-93c4-ac42c6223c28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:13.784068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b5352a76-68c4-48d6-93c4-ac42c6223c28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082248 Aug 08 08:55:13.784630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 697/1365] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:13 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:13.815806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d40177d2-20fa-4836-a5e5-eca6584ddb0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:13.818067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d40177d2-20fa-4836-a5e5-eca6584ddb0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:13.825047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d40177d2-20fa-4836-a5e5-eca6584ddb0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:13.825566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d40177d2-20fa-4836-a5e5-eca6584ddb0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:13.826010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d40177d2-20fa-4836-a5e5-eca6584ddb0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:13.826701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d40177d2-20fa-4836-a5e5-eca6584ddb0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:13.827164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d40177d2-20fa-4836-a5e5-eca6584ddb0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:13.827594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d40177d2-20fa-4836-a5e5-eca6584ddb0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:13.856225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d40177d2-20fa-4836-a5e5-eca6584ddb0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Aug 08 08:55:13.856776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 669/1366] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:14.803881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-90885ef5-f58d-4df8-a645-0f3cfd8d2952 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:14.804425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-90885ef5-f58d-4df8-a645-0f3cfd8d2952 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:14.811335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-90885ef5-f58d-4df8-a645-0f3cfd8d2952 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:14.811815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-90885ef5-f58d-4df8-a645-0f3cfd8d2952 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:14.812248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-90885ef5-f58d-4df8-a645-0f3cfd8d2952 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:14.812928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-90885ef5-f58d-4df8-a645-0f3cfd8d2952 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:14.813409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-90885ef5-f58d-4df8-a645-0f3cfd8d2952 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:14.813841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-90885ef5-f58d-4df8-a645-0f3cfd8d2952 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:14.869230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-633f3a76-8579-4d30-b548-05bc3045ca14 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:14.871448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-633f3a76-8579-4d30-b548-05bc3045ca14 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:14.874387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-90885ef5-f58d-4df8-a645-0f3cfd8d2952 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:14.877828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-633f3a76-8579-4d30-b548-05bc3045ca14 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:14.878316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-633f3a76-8579-4d30-b548-05bc3045ca14 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:14.878751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-633f3a76-8579-4d30-b548-05bc3045ca14 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:14.879442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-633f3a76-8579-4d30-b548-05bc3045ca14 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:14.879890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-633f3a76-8579-4d30-b548-05bc3045ca14 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:14.880314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-633f3a76-8579-4d30-b548-05bc3045ca14 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:14.881762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-90885ef5-f58d-4df8-a645-0f3cfd8d2952 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081845 Aug 08 08:55:14.882508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 698/1367] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:14 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:14.908796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-633f3a76-8579-4d30-b548-05bc3045ca14 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044011 Aug 08 08:55:14.909364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 670/1368] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:55:15.903273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-48cf054d-fe1f-4eb1-a7a7-9386c76cc5c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:15.903889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-48cf054d-fe1f-4eb1-a7a7-9386c76cc5c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:15.910282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48cf054d-fe1f-4eb1-a7a7-9386c76cc5c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:15.910769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48cf054d-fe1f-4eb1-a7a7-9386c76cc5c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:15.911205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48cf054d-fe1f-4eb1-a7a7-9386c76cc5c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:15.911893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48cf054d-fe1f-4eb1-a7a7-9386c76cc5c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:15.912349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48cf054d-fe1f-4eb1-a7a7-9386c76cc5c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:15.912776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48cf054d-fe1f-4eb1-a7a7-9386c76cc5c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:15.920122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ad584f75-0364-4077-a71f-4fbc19dd69d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:15.922394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ad584f75-0364-4077-a71f-4fbc19dd69d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:15.928575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad584f75-0364-4077-a71f-4fbc19dd69d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:15.929054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad584f75-0364-4077-a71f-4fbc19dd69d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:15.929641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad584f75-0364-4077-a71f-4fbc19dd69d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:15.930333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad584f75-0364-4077-a71f-4fbc19dd69d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:15.930850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad584f75-0364-4077-a71f-4fbc19dd69d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:15.931284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad584f75-0364-4077-a71f-4fbc19dd69d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:15.960359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ad584f75-0364-4077-a71f-4fbc19dd69d2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044430 Aug 08 08:55:15.960909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 671/1369] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:15 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:55:15.976944 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-48cf054d-fe1f-4eb1-a7a7-9386c76cc5c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:15.984952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-48cf054d-fe1f-4eb1-a7a7-9386c76cc5c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086148 Aug 08 08:55:15.985535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 699/1370] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:15 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:16.973120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c8fe7ed2-f81c-42b0-8ff4-59d9188a3a51 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:16.975265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c8fe7ed2-f81c-42b0-8ff4-59d9188a3a51 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:16.982520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8fe7ed2-f81c-42b0-8ff4-59d9188a3a51 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:16.983008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8fe7ed2-f81c-42b0-8ff4-59d9188a3a51 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:16.983746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8fe7ed2-f81c-42b0-8ff4-59d9188a3a51 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:16.984444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8fe7ed2-f81c-42b0-8ff4-59d9188a3a51 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:16.984897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8fe7ed2-f81c-42b0-8ff4-59d9188a3a51 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:16.985361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c8fe7ed2-f81c-42b0-8ff4-59d9188a3a51 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:17.005105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0cab6cdc-7bac-4724-b610-e6b997d24d15 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:17.005740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0cab6cdc-7bac-4724-b610-e6b997d24d15 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:17.012044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cab6cdc-7bac-4724-b610-e6b997d24d15 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:17.012535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cab6cdc-7bac-4724-b610-e6b997d24d15 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:17.012971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cab6cdc-7bac-4724-b610-e6b997d24d15 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:17.013702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cab6cdc-7bac-4724-b610-e6b997d24d15 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:17.013827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c8fe7ed2-f81c-42b0-8ff4-59d9188a3a51 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044543 Aug 08 08:55:17.014163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cab6cdc-7bac-4724-b610-e6b997d24d15 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:17.014606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 672/1371] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:17.014760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0cab6cdc-7bac-4724-b610-e6b997d24d15 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:17.076872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0cab6cdc-7bac-4724-b610-e6b997d24d15 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:17.084466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0cab6cdc-7bac-4724-b610-e6b997d24d15 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083136 Aug 08 08:55:17.085026 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 700/1372] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:17 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:55:18.026923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-50e9c7af-040e-4c62-b714-0246a56b25a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:18.029024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-50e9c7af-040e-4c62-b714-0246a56b25a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:18.035417 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50e9c7af-040e-4c62-b714-0246a56b25a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:18.035903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50e9c7af-040e-4c62-b714-0246a56b25a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:18.036344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50e9c7af-040e-4c62-b714-0246a56b25a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:18.037032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50e9c7af-040e-4c62-b714-0246a56b25a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:18.037517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50e9c7af-040e-4c62-b714-0246a56b25a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:18.037947 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50e9c7af-040e-4c62-b714-0246a56b25a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:18.066848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-50e9c7af-040e-4c62-b714-0246a56b25a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044589 Aug 08 08:55:18.067388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 673/1373] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:18 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:55:18.106035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cde50ea4-52c0-4d8e-bff8-3b76913e897d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:18.106782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cde50ea4-52c0-4d8e-bff8-3b76913e897d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:18.113404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cde50ea4-52c0-4d8e-bff8-3b76913e897d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:18.113881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cde50ea4-52c0-4d8e-bff8-3b76913e897d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:18.123959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cde50ea4-52c0-4d8e-bff8-3b76913e897d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:18.123959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cde50ea4-52c0-4d8e-bff8-3b76913e897d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:18.123959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cde50ea4-52c0-4d8e-bff8-3b76913e897d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:18.123959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cde50ea4-52c0-4d8e-bff8-3b76913e897d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:18.179178 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cde50ea4-52c0-4d8e-bff8-3b76913e897d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:18.186745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cde50ea4-52c0-4d8e-bff8-3b76913e897d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084791 Aug 08 08:55:18.187312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 701/1374] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:18 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:19.078962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b5379f0f-bedf-46aa-8032-8c2e4044786d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:19.081027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b5379f0f-bedf-46aa-8032-8c2e4044786d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:19.087693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5379f0f-bedf-46aa-8032-8c2e4044786d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:19.088174 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5379f0f-bedf-46aa-8032-8c2e4044786d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:19.088611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5379f0f-bedf-46aa-8032-8c2e4044786d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:19.089328 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5379f0f-bedf-46aa-8032-8c2e4044786d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:19.089786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5379f0f-bedf-46aa-8032-8c2e4044786d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:19.090210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5379f0f-bedf-46aa-8032-8c2e4044786d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:19.120778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b5379f0f-bedf-46aa-8032-8c2e4044786d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045829 Aug 08 08:55:19.121368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 674/1375] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:19.207487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c49dc105-d1c3-418a-9fcd-7be440bc373a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:19.208100 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c49dc105-d1c3-418a-9fcd-7be440bc373a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:19.215002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c49dc105-d1c3-418a-9fcd-7be440bc373a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:19.215479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c49dc105-d1c3-418a-9fcd-7be440bc373a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:19.215925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c49dc105-d1c3-418a-9fcd-7be440bc373a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:19.216613 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c49dc105-d1c3-418a-9fcd-7be440bc373a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:19.217069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c49dc105-d1c3-418a-9fcd-7be440bc373a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:19.217521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c49dc105-d1c3-418a-9fcd-7be440bc373a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:19.278031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c49dc105-d1c3-418a-9fcd-7be440bc373a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:19.285432 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c49dc105-d1c3-418a-9fcd-7be440bc373a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081721 Aug 08 08:55:19.285988 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 702/1376] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:19 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:20.132958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f7a65db0-a219-4397-96c2-cc3c2b289c82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:20.135917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f7a65db0-a219-4397-96c2-cc3c2b289c82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:20.142480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7a65db0-a219-4397-96c2-cc3c2b289c82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:20.142967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7a65db0-a219-4397-96c2-cc3c2b289c82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:20.143437 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7a65db0-a219-4397-96c2-cc3c2b289c82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:20.144167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7a65db0-a219-4397-96c2-cc3c2b289c82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:20.144656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7a65db0-a219-4397-96c2-cc3c2b289c82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:20.145086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7a65db0-a219-4397-96c2-cc3c2b289c82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:20.172840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f7a65db0-a219-4397-96c2-cc3c2b289c82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043843 Aug 08 08:55:20.173426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 675/1377] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:20 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:20.307067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4b9a3400-5961-4da8-b7b2-56bb902d488f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:20.307675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4b9a3400-5961-4da8-b7b2-56bb902d488f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:20.314076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b9a3400-5961-4da8-b7b2-56bb902d488f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:20.314554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b9a3400-5961-4da8-b7b2-56bb902d488f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:20.314991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b9a3400-5961-4da8-b7b2-56bb902d488f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:20.315672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b9a3400-5961-4da8-b7b2-56bb902d488f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:20.316122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b9a3400-5961-4da8-b7b2-56bb902d488f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:20.316542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4b9a3400-5961-4da8-b7b2-56bb902d488f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:20.381067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4b9a3400-5961-4da8-b7b2-56bb902d488f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:20.388536 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4b9a3400-5961-4da8-b7b2-56bb902d488f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086086 Aug 08 08:55:20.389096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 703/1378] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:20 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:21.185468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dde3eca2-10fb-42f2-b4f5-560603e5b921 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:21.187602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dde3eca2-10fb-42f2-b4f5-560603e5b921 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:21.193968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde3eca2-10fb-42f2-b4f5-560603e5b921 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:21.194453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde3eca2-10fb-42f2-b4f5-560603e5b921 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:21.194891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde3eca2-10fb-42f2-b4f5-560603e5b921 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:21.196082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde3eca2-10fb-42f2-b4f5-560603e5b921 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:21.196536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde3eca2-10fb-42f2-b4f5-560603e5b921 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:21.197168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde3eca2-10fb-42f2-b4f5-560603e5b921 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:21.226603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dde3eca2-10fb-42f2-b4f5-560603e5b921 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045111 Aug 08 08:55:21.227206 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 676/1379] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:21 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:21.408941 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bf4cbb6a-c85e-4e41-a587-905898b118c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:21.409687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bf4cbb6a-c85e-4e41-a587-905898b118c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:21.416549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf4cbb6a-c85e-4e41-a587-905898b118c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:21.419219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf4cbb6a-c85e-4e41-a587-905898b118c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:21.419219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf4cbb6a-c85e-4e41-a587-905898b118c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:21.419219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf4cbb6a-c85e-4e41-a587-905898b118c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:21.419219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf4cbb6a-c85e-4e41-a587-905898b118c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:21.420149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf4cbb6a-c85e-4e41-a587-905898b118c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:21.481314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bf4cbb6a-c85e-4e41-a587-905898b118c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:21.489038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bf4cbb6a-c85e-4e41-a587-905898b118c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084066 Aug 08 08:55:21.489620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 704/1380] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:21 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:22.239100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-57b0f12e-8c37-4f97-a664-94bf1e4c4d04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:22.241299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-57b0f12e-8c37-4f97-a664-94bf1e4c4d04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:22.247956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-57b0f12e-8c37-4f97-a664-94bf1e4c4d04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:22.248537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-57b0f12e-8c37-4f97-a664-94bf1e4c4d04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:22.248976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-57b0f12e-8c37-4f97-a664-94bf1e4c4d04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:22.253883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-57b0f12e-8c37-4f97-a664-94bf1e4c4d04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:22.253883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-57b0f12e-8c37-4f97-a664-94bf1e4c4d04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:22.253883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-57b0f12e-8c37-4f97-a664-94bf1e4c4d04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:22.279026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-57b0f12e-8c37-4f97-a664-94bf1e4c4d04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Aug 08 08:55:22.282563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 677/1381] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:22.510216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fd784111-f3b1-42e6-a2ef-a8d71c276e58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:22.510740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fd784111-f3b1-42e6-a2ef-a8d71c276e58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:22.517402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fd784111-f3b1-42e6-a2ef-a8d71c276e58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:22.517884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fd784111-f3b1-42e6-a2ef-a8d71c276e58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:22.518316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fd784111-f3b1-42e6-a2ef-a8d71c276e58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:22.518997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fd784111-f3b1-42e6-a2ef-a8d71c276e58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:22.519450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fd784111-f3b1-42e6-a2ef-a8d71c276e58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:22.519871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fd784111-f3b1-42e6-a2ef-a8d71c276e58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:22.580716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fd784111-f3b1-42e6-a2ef-a8d71c276e58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:22.588825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fd784111-f3b1-42e6-a2ef-a8d71c276e58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082530 Aug 08 08:55:22.589425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 705/1382] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:22 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:23.292312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b55b7284-140e-4f7c-9f21-9fe23cc03306 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:23.294527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b55b7284-140e-4f7c-9f21-9fe23cc03306 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:23.300891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b55b7284-140e-4f7c-9f21-9fe23cc03306 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:23.301403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b55b7284-140e-4f7c-9f21-9fe23cc03306 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:23.301841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b55b7284-140e-4f7c-9f21-9fe23cc03306 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:23.302527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b55b7284-140e-4f7c-9f21-9fe23cc03306 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:23.302984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b55b7284-140e-4f7c-9f21-9fe23cc03306 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:23.303411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b55b7284-140e-4f7c-9f21-9fe23cc03306 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:23.331592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b55b7284-140e-4f7c-9f21-9fe23cc03306 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043965 Aug 08 08:55:23.332132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 678/1383] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:23.609849 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a770acb8-14f0-45bc-8202-68a6ff7092e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:23.610463 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a770acb8-14f0-45bc-8202-68a6ff7092e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:23.616851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a770acb8-14f0-45bc-8202-68a6ff7092e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:23.617409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a770acb8-14f0-45bc-8202-68a6ff7092e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:23.617952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a770acb8-14f0-45bc-8202-68a6ff7092e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:23.618650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a770acb8-14f0-45bc-8202-68a6ff7092e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:23.619125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a770acb8-14f0-45bc-8202-68a6ff7092e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:23.619567 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a770acb8-14f0-45bc-8202-68a6ff7092e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:23.683057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a770acb8-14f0-45bc-8202-68a6ff7092e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:23.690826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a770acb8-14f0-45bc-8202-68a6ff7092e3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085024 Aug 08 08:55:23.691264 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 706/1384] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:23 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:24.343466 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8cf6300c-b2bc-43fc-b42b-21fff067a16c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:24.345656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8cf6300c-b2bc-43fc-b42b-21fff067a16c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:24.352067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cf6300c-b2bc-43fc-b42b-21fff067a16c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:24.352545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cf6300c-b2bc-43fc-b42b-21fff067a16c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:24.353014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cf6300c-b2bc-43fc-b42b-21fff067a16c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:24.353714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cf6300c-b2bc-43fc-b42b-21fff067a16c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:24.354162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cf6300c-b2bc-43fc-b42b-21fff067a16c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:24.354581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cf6300c-b2bc-43fc-b42b-21fff067a16c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:24.382102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8cf6300c-b2bc-43fc-b42b-21fff067a16c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042596 Aug 08 08:55:24.382643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 679/1385] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:24 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:24.711451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ca6ac819-beec-4693-8031-7589e4bc61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:24.712107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ca6ac819-beec-4693-8031-7589e4bc61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:24.718465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca6ac819-beec-4693-8031-7589e4bc61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:24.718946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca6ac819-beec-4693-8031-7589e4bc61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:24.719381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca6ac819-beec-4693-8031-7589e4bc61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:24.720067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca6ac819-beec-4693-8031-7589e4bc61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:24.720521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca6ac819-beec-4693-8031-7589e4bc61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:24.720947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca6ac819-beec-4693-8031-7589e4bc61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:24.784577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ca6ac819-beec-4693-8031-7589e4bc61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:24.792643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ca6ac819-beec-4693-8031-7589e4bc61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085033 Aug 08 08:55:24.793217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 707/1386] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:24 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:24.979045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 08:55:24.979216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 08:55:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 08:55:25.394786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-87ba015a-7090-4a85-940d-26c782cf9d5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:25.396951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-87ba015a-7090-4a85-940d-26c782cf9d5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:25.403901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87ba015a-7090-4a85-940d-26c782cf9d5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:25.404380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87ba015a-7090-4a85-940d-26c782cf9d5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:25.404810 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87ba015a-7090-4a85-940d-26c782cf9d5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:25.405508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87ba015a-7090-4a85-940d-26c782cf9d5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:25.405962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87ba015a-7090-4a85-940d-26c782cf9d5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:25.406380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-87ba015a-7090-4a85-940d-26c782cf9d5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:25.435199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-87ba015a-7090-4a85-940d-26c782cf9d5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Aug 08 08:55:25.435741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 680/1387] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:25.813314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-09c4cc54-fa7b-4f64-bef6-7e90a162615b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:25.813932 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-09c4cc54-fa7b-4f64-bef6-7e90a162615b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:25.820912 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09c4cc54-fa7b-4f64-bef6-7e90a162615b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:25.821443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09c4cc54-fa7b-4f64-bef6-7e90a162615b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:25.821878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09c4cc54-fa7b-4f64-bef6-7e90a162615b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:25.822573 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09c4cc54-fa7b-4f64-bef6-7e90a162615b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:25.823030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09c4cc54-fa7b-4f64-bef6-7e90a162615b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:25.823458 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09c4cc54-fa7b-4f64-bef6-7e90a162615b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:25.887671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-09c4cc54-fa7b-4f64-bef6-7e90a162615b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:25.895095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-09c4cc54-fa7b-4f64-bef6-7e90a162615b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085712 Aug 08 08:55:25.895649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 708/1388] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:25 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:26.447690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fdd49454-c1ac-4466-8df4-cc0e73b73d18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:26.449921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fdd49454-c1ac-4466-8df4-cc0e73b73d18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:26.455795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdd49454-c1ac-4466-8df4-cc0e73b73d18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:26.456271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdd49454-c1ac-4466-8df4-cc0e73b73d18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:26.456705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdd49454-c1ac-4466-8df4-cc0e73b73d18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:26.457414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdd49454-c1ac-4466-8df4-cc0e73b73d18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:26.457867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdd49454-c1ac-4466-8df4-cc0e73b73d18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:26.458289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fdd49454-c1ac-4466-8df4-cc0e73b73d18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:26.486420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fdd49454-c1ac-4466-8df4-cc0e73b73d18 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043027 Aug 08 08:55:26.486958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 681/1389] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:26.916382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4c62db88-05fc-460a-a186-ea5eee924601 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:26.916990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4c62db88-05fc-460a-a186-ea5eee924601 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:26.923418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c62db88-05fc-460a-a186-ea5eee924601 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:26.923901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c62db88-05fc-460a-a186-ea5eee924601 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:26.924336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c62db88-05fc-460a-a186-ea5eee924601 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:26.925019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c62db88-05fc-460a-a186-ea5eee924601 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:26.925507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c62db88-05fc-460a-a186-ea5eee924601 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:26.925932 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c62db88-05fc-460a-a186-ea5eee924601 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:26.930358 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:55:26.987049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4c62db88-05fc-460a-a186-ea5eee924601 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:26.994936 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4c62db88-05fc-460a-a186-ea5eee924601 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082685 Aug 08 08:55:26.995484 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 709/1390] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:26 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:27.498304 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f97d6b93-aaa9-4ea3-80ee-78a9dd265d10 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:27.500381 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f97d6b93-aaa9-4ea3-80ee-78a9dd265d10 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:27.506686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f97d6b93-aaa9-4ea3-80ee-78a9dd265d10 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:27.507158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f97d6b93-aaa9-4ea3-80ee-78a9dd265d10 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:27.507588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f97d6b93-aaa9-4ea3-80ee-78a9dd265d10 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:27.509187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f97d6b93-aaa9-4ea3-80ee-78a9dd265d10 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:27.509648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f97d6b93-aaa9-4ea3-80ee-78a9dd265d10 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:27.510071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f97d6b93-aaa9-4ea3-80ee-78a9dd265d10 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:27.537521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f97d6b93-aaa9-4ea3-80ee-78a9dd265d10 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043215 Aug 08 08:55:27.538052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 682/1391] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:27 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:55:28.015453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-53c2a75c-e0ab-427a-9bcc-d1c5e7e1a6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:28.015989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-53c2a75c-e0ab-427a-9bcc-d1c5e7e1a6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:28.022438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53c2a75c-e0ab-427a-9bcc-d1c5e7e1a6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:28.022922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53c2a75c-e0ab-427a-9bcc-d1c5e7e1a6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:28.023362 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53c2a75c-e0ab-427a-9bcc-d1c5e7e1a6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:28.024191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53c2a75c-e0ab-427a-9bcc-d1c5e7e1a6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:28.024634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53c2a75c-e0ab-427a-9bcc-d1c5e7e1a6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:28.025062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-53c2a75c-e0ab-427a-9bcc-d1c5e7e1a6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:28.085655 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-53c2a75c-e0ab-427a-9bcc-d1c5e7e1a6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:28.093216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-53c2a75c-e0ab-427a-9bcc-d1c5e7e1a6e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081728 Aug 08 08:55:28.093771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 710/1392] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:28 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:28.549947 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bf4dd087-2b8a-45c9-adfd-6dd64382fed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:28.552088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bf4dd087-2b8a-45c9-adfd-6dd64382fed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:28.559091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf4dd087-2b8a-45c9-adfd-6dd64382fed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:28.559580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf4dd087-2b8a-45c9-adfd-6dd64382fed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:28.560091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf4dd087-2b8a-45c9-adfd-6dd64382fed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:28.560787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf4dd087-2b8a-45c9-adfd-6dd64382fed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:28.561315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf4dd087-2b8a-45c9-adfd-6dd64382fed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:28.561744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf4dd087-2b8a-45c9-adfd-6dd64382fed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:28.576035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:55:28.591217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bf4dd087-2b8a-45c9-adfd-6dd64382fed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045222 Aug 08 08:55:28.591767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 683/1393] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:28 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:29.114349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-567d6e5c-5c3a-4042-ba9a-c242622165ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:29.114957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-567d6e5c-5c3a-4042-ba9a-c242622165ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:29.121903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-567d6e5c-5c3a-4042-ba9a-c242622165ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:29.122392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-567d6e5c-5c3a-4042-ba9a-c242622165ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:29.122832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-567d6e5c-5c3a-4042-ba9a-c242622165ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:29.123524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-567d6e5c-5c3a-4042-ba9a-c242622165ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:29.123982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-567d6e5c-5c3a-4042-ba9a-c242622165ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:29.124407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-567d6e5c-5c3a-4042-ba9a-c242622165ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:29.187466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-567d6e5c-5c3a-4042-ba9a-c242622165ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:29.194921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-567d6e5c-5c3a-4042-ba9a-c242622165ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084477 Aug 08 08:55:29.196118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 711/1394] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:29 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:29.604444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fc1358bb-db94-4382-85c2-9aaf0947f180 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:29.606650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fc1358bb-db94-4382-85c2-9aaf0947f180 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:29.613436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1358bb-db94-4382-85c2-9aaf0947f180 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:29.613918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1358bb-db94-4382-85c2-9aaf0947f180 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:29.614357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1358bb-db94-4382-85c2-9aaf0947f180 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:29.615043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1358bb-db94-4382-85c2-9aaf0947f180 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:29.615498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1358bb-db94-4382-85c2-9aaf0947f180 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:29.615923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1358bb-db94-4382-85c2-9aaf0947f180 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:29.644795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fc1358bb-db94-4382-85c2-9aaf0947f180 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045412 Aug 08 08:55:29.645368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 684/1395] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:29 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:30.216430 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-11095787-949a-4b5e-ad44-5f291b6ef35c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:30.217043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-11095787-949a-4b5e-ad44-5f291b6ef35c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:30.223437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11095787-949a-4b5e-ad44-5f291b6ef35c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:30.223924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11095787-949a-4b5e-ad44-5f291b6ef35c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:30.224365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11095787-949a-4b5e-ad44-5f291b6ef35c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:30.225060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11095787-949a-4b5e-ad44-5f291b6ef35c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:30.225544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11095787-949a-4b5e-ad44-5f291b6ef35c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:30.225973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11095787-949a-4b5e-ad44-5f291b6ef35c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:30.286863 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-11095787-949a-4b5e-ad44-5f291b6ef35c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:30.294307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-11095787-949a-4b5e-ad44-5f291b6ef35c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081771 Aug 08 08:55:30.294891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 712/1396] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:30 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:30.655945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-88748df2-5d0c-4492-8b45-03eb13cf52b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:30.658204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-88748df2-5d0c-4492-8b45-03eb13cf52b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:30.664741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88748df2-5d0c-4492-8b45-03eb13cf52b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:30.665268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88748df2-5d0c-4492-8b45-03eb13cf52b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:30.665711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88748df2-5d0c-4492-8b45-03eb13cf52b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:30.666404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88748df2-5d0c-4492-8b45-03eb13cf52b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:30.666861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88748df2-5d0c-4492-8b45-03eb13cf52b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:30.667345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88748df2-5d0c-4492-8b45-03eb13cf52b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:30.697104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-88748df2-5d0c-4492-8b45-03eb13cf52b8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Aug 08 08:55:30.697673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 685/1397] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:30 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:31.314641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-61242124-5e20-4c34-9b23-c5e205616886 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:31.315263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-61242124-5e20-4c34-9b23-c5e205616886 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:31.321629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61242124-5e20-4c34-9b23-c5e205616886 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:31.322113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61242124-5e20-4c34-9b23-c5e205616886 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:31.322549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61242124-5e20-4c34-9b23-c5e205616886 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:31.323240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61242124-5e20-4c34-9b23-c5e205616886 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:31.323698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61242124-5e20-4c34-9b23-c5e205616886 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:31.324123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61242124-5e20-4c34-9b23-c5e205616886 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:31.386900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-61242124-5e20-4c34-9b23-c5e205616886 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:31.394602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-61242124-5e20-4c34-9b23-c5e205616886 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083733 Aug 08 08:55:31.395161 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 713/1398] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:31 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:31.709229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f10d4d7b-213f-46ae-94bb-f2dfdceea24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:31.712047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f10d4d7b-213f-46ae-94bb-f2dfdceea24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:31.718474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f10d4d7b-213f-46ae-94bb-f2dfdceea24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:31.718962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f10d4d7b-213f-46ae-94bb-f2dfdceea24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:31.719400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f10d4d7b-213f-46ae-94bb-f2dfdceea24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:31.720094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f10d4d7b-213f-46ae-94bb-f2dfdceea24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:31.720557 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f10d4d7b-213f-46ae-94bb-f2dfdceea24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:31.720990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f10d4d7b-213f-46ae-94bb-f2dfdceea24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:31.749405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f10d4d7b-213f-46ae-94bb-f2dfdceea24d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044110 Aug 08 08:55:31.749956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 686/1399] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:31 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:32.416002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-da722499-a832-4e2b-8694-cd7e5414b62a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:32.416619 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-da722499-a832-4e2b-8694-cd7e5414b62a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:32.423061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da722499-a832-4e2b-8694-cd7e5414b62a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:32.423548 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da722499-a832-4e2b-8694-cd7e5414b62a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:32.423991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da722499-a832-4e2b-8694-cd7e5414b62a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:32.424681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da722499-a832-4e2b-8694-cd7e5414b62a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:32.425137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da722499-a832-4e2b-8694-cd7e5414b62a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:32.425587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da722499-a832-4e2b-8694-cd7e5414b62a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:32.488149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-da722499-a832-4e2b-8694-cd7e5414b62a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:32.496116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-da722499-a832-4e2b-8694-cd7e5414b62a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084526 Aug 08 08:55:32.496675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 714/1400] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:32 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:32.761500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-51744b47-8de3-4502-be2c-7e8000b98564 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:32.763563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-51744b47-8de3-4502-be2c-7e8000b98564 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:32.769955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51744b47-8de3-4502-be2c-7e8000b98564 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:32.770431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51744b47-8de3-4502-be2c-7e8000b98564 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:32.770864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51744b47-8de3-4502-be2c-7e8000b98564 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:32.771548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51744b47-8de3-4502-be2c-7e8000b98564 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:32.771998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51744b47-8de3-4502-be2c-7e8000b98564 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:32.772420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51744b47-8de3-4502-be2c-7e8000b98564 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:32.801297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-51744b47-8de3-4502-be2c-7e8000b98564 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Aug 08 08:55:32.801836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 687/1401] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:33.516700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-eca3c621-a3cd-4910-9260-3b31085156b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:33.517372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-eca3c621-a3cd-4910-9260-3b31085156b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:33.523859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eca3c621-a3cd-4910-9260-3b31085156b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:33.524347 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eca3c621-a3cd-4910-9260-3b31085156b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:33.524780 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eca3c621-a3cd-4910-9260-3b31085156b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:33.525498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eca3c621-a3cd-4910-9260-3b31085156b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:33.525955 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eca3c621-a3cd-4910-9260-3b31085156b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:33.526379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eca3c621-a3cd-4910-9260-3b31085156b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:33.590344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-eca3c621-a3cd-4910-9260-3b31085156b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:33.597779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-eca3c621-a3cd-4910-9260-3b31085156b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084933 Aug 08 08:55:33.598337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 715/1402] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:33 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:33.812616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-df4f7424-ccd0-4d20-b320-b10b87da4d4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:33.814803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-df4f7424-ccd0-4d20-b320-b10b87da4d4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:33.821563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df4f7424-ccd0-4d20-b320-b10b87da4d4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:33.822053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df4f7424-ccd0-4d20-b320-b10b87da4d4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:33.822494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df4f7424-ccd0-4d20-b320-b10b87da4d4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:33.823188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df4f7424-ccd0-4d20-b320-b10b87da4d4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:33.823647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df4f7424-ccd0-4d20-b320-b10b87da4d4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:33.824085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df4f7424-ccd0-4d20-b320-b10b87da4d4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:33.853620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-df4f7424-ccd0-4d20-b320-b10b87da4d4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 Aug 08 08:55:33.854169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 688/1403] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:33 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:34.619580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bcb9799c-f6e1-4630-b077-965b3f096e28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:34.620198 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bcb9799c-f6e1-4630-b077-965b3f096e28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:34.626633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcb9799c-f6e1-4630-b077-965b3f096e28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:34.627116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcb9799c-f6e1-4630-b077-965b3f096e28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:34.627553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcb9799c-f6e1-4630-b077-965b3f096e28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:34.628240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcb9799c-f6e1-4630-b077-965b3f096e28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:34.628697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcb9799c-f6e1-4630-b077-965b3f096e28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:34.629123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bcb9799c-f6e1-4630-b077-965b3f096e28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:34.691515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bcb9799c-f6e1-4630-b077-965b3f096e28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:34.699099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bcb9799c-f6e1-4630-b077-965b3f096e28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084265 Aug 08 08:55:34.699662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 716/1404] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:34 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:34.866038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4ef081d7-bdde-422b-9d02-e7389bc5aade tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:34.868743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4ef081d7-bdde-422b-9d02-e7389bc5aade tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:34.875016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ef081d7-bdde-422b-9d02-e7389bc5aade tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:34.875494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ef081d7-bdde-422b-9d02-e7389bc5aade tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:34.875926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ef081d7-bdde-422b-9d02-e7389bc5aade tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:34.876608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ef081d7-bdde-422b-9d02-e7389bc5aade tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:34.877053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ef081d7-bdde-422b-9d02-e7389bc5aade tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:34.877500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4ef081d7-bdde-422b-9d02-e7389bc5aade tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:34.907167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4ef081d7-bdde-422b-9d02-e7389bc5aade tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045095 Aug 08 08:55:34.907708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 689/1405] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:35.719625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-486aa3a1-b947-4987-b38f-7e1da48a329d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:35.720288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-486aa3a1-b947-4987-b38f-7e1da48a329d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:35.726808 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-486aa3a1-b947-4987-b38f-7e1da48a329d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:35.727295 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-486aa3a1-b947-4987-b38f-7e1da48a329d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:35.727733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-486aa3a1-b947-4987-b38f-7e1da48a329d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:35.728417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-486aa3a1-b947-4987-b38f-7e1da48a329d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:35.728872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-486aa3a1-b947-4987-b38f-7e1da48a329d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:35.729330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-486aa3a1-b947-4987-b38f-7e1da48a329d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:35.791182 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-486aa3a1-b947-4987-b38f-7e1da48a329d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:35.798743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-486aa3a1-b947-4987-b38f-7e1da48a329d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083002 Aug 08 08:55:35.799299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 717/1406] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:35 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:35.919201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-985e6555-940b-4aca-9e09-1d671332b236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:35.921445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-985e6555-940b-4aca-9e09-1d671332b236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:35.923855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=58 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:55:35.928403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-985e6555-940b-4aca-9e09-1d671332b236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:35.928919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-985e6555-940b-4aca-9e09-1d671332b236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:35.929402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-985e6555-940b-4aca-9e09-1d671332b236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:35.930597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-985e6555-940b-4aca-9e09-1d671332b236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:35.931050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-985e6555-940b-4aca-9e09-1d671332b236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:35.931477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-985e6555-940b-4aca-9e09-1d671332b236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:35.960152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-985e6555-940b-4aca-9e09-1d671332b236 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044930 Aug 08 08:55:35.960705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 690/1407] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:35 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:55:36.819888 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b8b28f2a-917c-4b71-99db-00c2c44d9fe9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:36.820637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b8b28f2a-917c-4b71-99db-00c2c44d9fe9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:36.826798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b28f2a-917c-4b71-99db-00c2c44d9fe9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:36.827286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b28f2a-917c-4b71-99db-00c2c44d9fe9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:36.827722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b28f2a-917c-4b71-99db-00c2c44d9fe9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:36.828415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b28f2a-917c-4b71-99db-00c2c44d9fe9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:36.828873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b28f2a-917c-4b71-99db-00c2c44d9fe9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:36.829331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b8b28f2a-917c-4b71-99db-00c2c44d9fe9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:36.889704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b8b28f2a-917c-4b71-99db-00c2c44d9fe9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:36.897116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b8b28f2a-917c-4b71-99db-00c2c44d9fe9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081177 Aug 08 08:55:36.897695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 718/1408] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:36 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:36.971920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-76084ba6-696a-4683-9f9c-ffef31be0b93 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:36.974089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-76084ba6-696a-4683-9f9c-ffef31be0b93 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:36.980837 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76084ba6-696a-4683-9f9c-ffef31be0b93 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:36.981348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76084ba6-696a-4683-9f9c-ffef31be0b93 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:36.981784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76084ba6-696a-4683-9f9c-ffef31be0b93 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:36.982459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76084ba6-696a-4683-9f9c-ffef31be0b93 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:36.982907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76084ba6-696a-4683-9f9c-ffef31be0b93 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:36.983327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76084ba6-696a-4683-9f9c-ffef31be0b93 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:37.011862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-76084ba6-696a-4683-9f9c-ffef31be0b93 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043870 Aug 08 08:55:37.012397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 691/1409] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:37.917994 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b850a049-033e-45cd-922f-f467f48b1e92 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:37.918605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b850a049-033e-45cd-922f-f467f48b1e92 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:37.920894 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=56 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:55:37.928874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b850a049-033e-45cd-922f-f467f48b1e92 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:37.929404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b850a049-033e-45cd-922f-f467f48b1e92 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:37.929848 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b850a049-033e-45cd-922f-f467f48b1e92 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:37.930574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b850a049-033e-45cd-922f-f467f48b1e92 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:37.931035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b850a049-033e-45cd-922f-f467f48b1e92 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:37.931465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b850a049-033e-45cd-922f-f467f48b1e92 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:37.995502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b850a049-033e-45cd-922f-f467f48b1e92 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:38.003032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b850a049-033e-45cd-922f-f467f48b1e92 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.089503 Aug 08 08:55:38.003590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 719/1410] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:37 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:38.024461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-73384d94-6282-40f2-806b-05725be34243 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:38.026583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-73384d94-6282-40f2-806b-05725be34243 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:38.032877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73384d94-6282-40f2-806b-05725be34243 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:38.033400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73384d94-6282-40f2-806b-05725be34243 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:38.033837 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73384d94-6282-40f2-806b-05725be34243 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:38.034520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73384d94-6282-40f2-806b-05725be34243 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:38.034977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73384d94-6282-40f2-806b-05725be34243 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:38.035402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73384d94-6282-40f2-806b-05725be34243 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:38.064020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-73384d94-6282-40f2-806b-05725be34243 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Aug 08 08:55:38.064595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 692/1411] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:38 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:39.024052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-236289c0-3644-43ae-81f5-0ff445e0152a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:39.024752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-236289c0-3644-43ae-81f5-0ff445e0152a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:39.031324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236289c0-3644-43ae-81f5-0ff445e0152a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:39.031810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236289c0-3644-43ae-81f5-0ff445e0152a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:39.032245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236289c0-3644-43ae-81f5-0ff445e0152a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:39.032966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236289c0-3644-43ae-81f5-0ff445e0152a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:39.033451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236289c0-3644-43ae-81f5-0ff445e0152a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:39.033872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-236289c0-3644-43ae-81f5-0ff445e0152a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:39.076568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a5cfb80f-7a39-43d3-bc60-7e6c322a024d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:39.078879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a5cfb80f-7a39-43d3-bc60-7e6c322a024d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:39.085305 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5cfb80f-7a39-43d3-bc60-7e6c322a024d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:39.085791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5cfb80f-7a39-43d3-bc60-7e6c322a024d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:39.086777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5cfb80f-7a39-43d3-bc60-7e6c322a024d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:39.087472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5cfb80f-7a39-43d3-bc60-7e6c322a024d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:39.088040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5cfb80f-7a39-43d3-bc60-7e6c322a024d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:39.088469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5cfb80f-7a39-43d3-bc60-7e6c322a024d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:39.095211 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-236289c0-3644-43ae-81f5-0ff445e0152a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:39.102585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-236289c0-3644-43ae-81f5-0ff445e0152a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082953 Aug 08 08:55:39.103467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 720/1412] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:39 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:39.117027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a5cfb80f-7a39-43d3-bc60-7e6c322a024d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Aug 08 08:55:39.117717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 693/1413] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:39 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:55:40.123348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6dd9c3fb-a39a-470e-9b9e-dd29b5d0723b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:40.124096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6dd9c3fb-a39a-470e-9b9e-dd29b5d0723b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:40.129355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e2060b30-f8bc-49ce-bac3-4e92147239b6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:40.130433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6dd9c3fb-a39a-470e-9b9e-dd29b5d0723b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:40.130918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6dd9c3fb-a39a-470e-9b9e-dd29b5d0723b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:40.131353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6dd9c3fb-a39a-470e-9b9e-dd29b5d0723b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:40.131607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e2060b30-f8bc-49ce-bac3-4e92147239b6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:40.132044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6dd9c3fb-a39a-470e-9b9e-dd29b5d0723b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:40.132499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6dd9c3fb-a39a-470e-9b9e-dd29b5d0723b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:40.133472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6dd9c3fb-a39a-470e-9b9e-dd29b5d0723b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:40.138637 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2060b30-f8bc-49ce-bac3-4e92147239b6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:40.139122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2060b30-f8bc-49ce-bac3-4e92147239b6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:40.139561 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2060b30-f8bc-49ce-bac3-4e92147239b6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:40.140256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2060b30-f8bc-49ce-bac3-4e92147239b6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:40.140710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2060b30-f8bc-49ce-bac3-4e92147239b6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:40.141137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2060b30-f8bc-49ce-bac3-4e92147239b6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:40.169555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e2060b30-f8bc-49ce-bac3-4e92147239b6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044096 Aug 08 08:55:40.170120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 694/1414] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:40 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:40.196685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6dd9c3fb-a39a-470e-9b9e-dd29b5d0723b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:40.204372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6dd9c3fb-a39a-470e-9b9e-dd29b5d0723b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084853 Aug 08 08:55:40.204914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 721/1415] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:40 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:41.181573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-469b4df5-c5af-4e13-addb-0fd1bcab8dec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:41.183706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-469b4df5-c5af-4e13-addb-0fd1bcab8dec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:41.190042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469b4df5-c5af-4e13-addb-0fd1bcab8dec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:41.190520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469b4df5-c5af-4e13-addb-0fd1bcab8dec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:41.190952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469b4df5-c5af-4e13-addb-0fd1bcab8dec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:41.191635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469b4df5-c5af-4e13-addb-0fd1bcab8dec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:41.192084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469b4df5-c5af-4e13-addb-0fd1bcab8dec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:41.192505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469b4df5-c5af-4e13-addb-0fd1bcab8dec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:41.220517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-469b4df5-c5af-4e13-addb-0fd1bcab8dec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042835 Aug 08 08:55:41.221051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 695/1416] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:41 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:41.225046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-012ec9ff-479b-4a69-8b48-403c8bbd3978 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:41.225713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-012ec9ff-479b-4a69-8b48-403c8bbd3978 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:41.232612 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-012ec9ff-479b-4a69-8b48-403c8bbd3978 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:41.233093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-012ec9ff-479b-4a69-8b48-403c8bbd3978 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:41.233565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-012ec9ff-479b-4a69-8b48-403c8bbd3978 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:41.234527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-012ec9ff-479b-4a69-8b48-403c8bbd3978 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:41.234986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-012ec9ff-479b-4a69-8b48-403c8bbd3978 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:41.235414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-012ec9ff-479b-4a69-8b48-403c8bbd3978 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:41.296100 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-012ec9ff-479b-4a69-8b48-403c8bbd3978 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:41.303554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-012ec9ff-479b-4a69-8b48-403c8bbd3978 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082317 Aug 08 08:55:41.304138 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 722/1417] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:41 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:55:42.232161 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-18cf6c8f-103a-4863-8055-380e02224c58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:42.234625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-18cf6c8f-103a-4863-8055-380e02224c58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:42.240969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18cf6c8f-103a-4863-8055-380e02224c58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:42.241486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18cf6c8f-103a-4863-8055-380e02224c58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:42.241928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18cf6c8f-103a-4863-8055-380e02224c58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:42.242701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18cf6c8f-103a-4863-8055-380e02224c58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:42.243113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18cf6c8f-103a-4863-8055-380e02224c58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:42.243542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18cf6c8f-103a-4863-8055-380e02224c58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:42.271720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-18cf6c8f-103a-4863-8055-380e02224c58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043525 Aug 08 08:55:42.272264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 696/1418] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:42 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:55:42.324688 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c3ec4bfa-92c0-4f9d-a3f0-6df007ab51c1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:42.325337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c3ec4bfa-92c0-4f9d-a3f0-6df007ab51c1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:42.331679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c3ec4bfa-92c0-4f9d-a3f0-6df007ab51c1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:42.332162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c3ec4bfa-92c0-4f9d-a3f0-6df007ab51c1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:42.332600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c3ec4bfa-92c0-4f9d-a3f0-6df007ab51c1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:42.333320 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c3ec4bfa-92c0-4f9d-a3f0-6df007ab51c1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:42.333779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c3ec4bfa-92c0-4f9d-a3f0-6df007ab51c1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:42.334204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c3ec4bfa-92c0-4f9d-a3f0-6df007ab51c1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:42.399538 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c3ec4bfa-92c0-4f9d-a3f0-6df007ab51c1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:42.407013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c3ec4bfa-92c0-4f9d-a3f0-6df007ab51c1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086784 Aug 08 08:55:42.407581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 723/1419] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:42 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:43.283994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9173548f-0e4f-45c4-92bc-b5a14008f050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:43.286211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9173548f-0e4f-45c4-92bc-b5a14008f050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:43.293365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9173548f-0e4f-45c4-92bc-b5a14008f050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:43.293855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9173548f-0e4f-45c4-92bc-b5a14008f050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:43.294296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9173548f-0e4f-45c4-92bc-b5a14008f050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:43.294988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9173548f-0e4f-45c4-92bc-b5a14008f050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:43.295447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9173548f-0e4f-45c4-92bc-b5a14008f050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:43.295876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9173548f-0e4f-45c4-92bc-b5a14008f050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:43.323791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9173548f-0e4f-45c4-92bc-b5a14008f050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043824 Aug 08 08:55:43.324339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 697/1420] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:43.427191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1c55a538-1f3f-48fd-b5fb-d5e0d94a77ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:43.427803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1c55a538-1f3f-48fd-b5fb-d5e0d94a77ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:43.434833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c55a538-1f3f-48fd-b5fb-d5e0d94a77ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:43.435320 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c55a538-1f3f-48fd-b5fb-d5e0d94a77ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:43.435753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c55a538-1f3f-48fd-b5fb-d5e0d94a77ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:43.436438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c55a538-1f3f-48fd-b5fb-d5e0d94a77ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:43.436890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c55a538-1f3f-48fd-b5fb-d5e0d94a77ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:43.437354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c55a538-1f3f-48fd-b5fb-d5e0d94a77ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:43.498147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1c55a538-1f3f-48fd-b5fb-d5e0d94a77ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:43.505651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1c55a538-1f3f-48fd-b5fb-d5e0d94a77ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082318 Aug 08 08:55:43.506208 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 724/1421] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:43 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:44.336946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a3295f94-bfad-4417-bf98-e4ca962a567b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:44.339159 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a3295f94-bfad-4417-bf98-e4ca962a567b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:44.345542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3295f94-bfad-4417-bf98-e4ca962a567b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:44.346023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3295f94-bfad-4417-bf98-e4ca962a567b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:44.346461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3295f94-bfad-4417-bf98-e4ca962a567b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:44.347146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3295f94-bfad-4417-bf98-e4ca962a567b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:44.347635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3295f94-bfad-4417-bf98-e4ca962a567b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:44.348064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3295f94-bfad-4417-bf98-e4ca962a567b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:44.376534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a3295f94-bfad-4417-bf98-e4ca962a567b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 Aug 08 08:55:44.377085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 698/1422] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:44.526817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5908f392-c4e4-4c9f-adfd-63df177cbb85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:44.527418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5908f392-c4e4-4c9f-adfd-63df177cbb85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:44.533910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5908f392-c4e4-4c9f-adfd-63df177cbb85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:44.534393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5908f392-c4e4-4c9f-adfd-63df177cbb85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:44.534829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5908f392-c4e4-4c9f-adfd-63df177cbb85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:44.535510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5908f392-c4e4-4c9f-adfd-63df177cbb85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:44.535963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5908f392-c4e4-4c9f-adfd-63df177cbb85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:44.536384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5908f392-c4e4-4c9f-adfd-63df177cbb85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:44.598762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5908f392-c4e4-4c9f-adfd-63df177cbb85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:44.602466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:55:44.606705 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5908f392-c4e4-4c9f-adfd-63df177cbb85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084363 Aug 08 08:55:44.607260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 725/1423] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:44 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:45.388656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4a712143-c432-427c-857c-7b9f1d5a5a6e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:45.390825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4a712143-c432-427c-857c-7b9f1d5a5a6e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:45.397255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a712143-c432-427c-857c-7b9f1d5a5a6e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:45.397737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a712143-c432-427c-857c-7b9f1d5a5a6e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:45.398688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a712143-c432-427c-857c-7b9f1d5a5a6e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:45.399468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a712143-c432-427c-857c-7b9f1d5a5a6e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:45.399916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a712143-c432-427c-857c-7b9f1d5a5a6e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:45.400343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a712143-c432-427c-857c-7b9f1d5a5a6e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:45.429138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4a712143-c432-427c-857c-7b9f1d5a5a6e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044386 Aug 08 08:55:45.429878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 699/1424] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:45.627919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e3eb0a28-f1d6-4707-b649-21efe85507ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:45.628523 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e3eb0a28-f1d6-4707-b649-21efe85507ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:45.635207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3eb0a28-f1d6-4707-b649-21efe85507ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:45.635686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3eb0a28-f1d6-4707-b649-21efe85507ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:45.636115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3eb0a28-f1d6-4707-b649-21efe85507ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:45.636798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3eb0a28-f1d6-4707-b649-21efe85507ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:45.637286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3eb0a28-f1d6-4707-b649-21efe85507ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:45.637712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3eb0a28-f1d6-4707-b649-21efe85507ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:45.697973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e3eb0a28-f1d6-4707-b649-21efe85507ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:45.705287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e3eb0a28-f1d6-4707-b649-21efe85507ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081487 Aug 08 08:55:45.705852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 726/1425] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:45 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:46.441453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7f7d4caf-37c8-49e7-b889-c5913cbe5724 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:46.443580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7f7d4caf-37c8-49e7-b889-c5913cbe5724 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:46.449939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f7d4caf-37c8-49e7-b889-c5913cbe5724 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:46.450419 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f7d4caf-37c8-49e7-b889-c5913cbe5724 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:46.450850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f7d4caf-37c8-49e7-b889-c5913cbe5724 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:46.451529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f7d4caf-37c8-49e7-b889-c5913cbe5724 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:46.451982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f7d4caf-37c8-49e7-b889-c5913cbe5724 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:46.452403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f7d4caf-37c8-49e7-b889-c5913cbe5724 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:46.454702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:55:46.482447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7f7d4caf-37c8-49e7-b889-c5913cbe5724 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Aug 08 08:55:46.485793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 700/1426] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:46 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:46.726149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5b645dc3-9b6d-4507-88fb-7efcae41b1ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:46.726845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5b645dc3-9b6d-4507-88fb-7efcae41b1ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:46.733130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b645dc3-9b6d-4507-88fb-7efcae41b1ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:46.733641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b645dc3-9b6d-4507-88fb-7efcae41b1ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:46.734334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b645dc3-9b6d-4507-88fb-7efcae41b1ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:46.735014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b645dc3-9b6d-4507-88fb-7efcae41b1ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:46.735466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b645dc3-9b6d-4507-88fb-7efcae41b1ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:46.735885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b645dc3-9b6d-4507-88fb-7efcae41b1ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:46.801910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5b645dc3-9b6d-4507-88fb-7efcae41b1ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:46.809550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5b645dc3-9b6d-4507-88fb-7efcae41b1ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.087226 Aug 08 08:55:46.810103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 727/1427] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:46 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:47.495426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d33caa85-78e4-4177-94a8-2917b495ff68 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:47.497597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d33caa85-78e4-4177-94a8-2917b495ff68 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:47.504216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d33caa85-78e4-4177-94a8-2917b495ff68 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:47.504699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d33caa85-78e4-4177-94a8-2917b495ff68 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:47.505132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d33caa85-78e4-4177-94a8-2917b495ff68 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:47.505833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d33caa85-78e4-4177-94a8-2917b495ff68 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:47.506283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d33caa85-78e4-4177-94a8-2917b495ff68 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:47.506703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d33caa85-78e4-4177-94a8-2917b495ff68 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:47.534619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d33caa85-78e4-4177-94a8-2917b495ff68 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043873 Aug 08 08:55:47.535181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 701/1428] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:47.830257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-649d6fe4-3d90-4f1f-b4fa-bcf783844b8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:47.830865 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-649d6fe4-3d90-4f1f-b4fa-bcf783844b8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:47.837887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-649d6fe4-3d90-4f1f-b4fa-bcf783844b8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:47.838367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-649d6fe4-3d90-4f1f-b4fa-bcf783844b8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:47.838794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-649d6fe4-3d90-4f1f-b4fa-bcf783844b8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:47.839527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-649d6fe4-3d90-4f1f-b4fa-bcf783844b8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:47.839977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-649d6fe4-3d90-4f1f-b4fa-bcf783844b8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:47.840398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-649d6fe4-3d90-4f1f-b4fa-bcf783844b8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:47.903678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-649d6fe4-3d90-4f1f-b4fa-bcf783844b8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:47.911162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-649d6fe4-3d90-4f1f-b4fa-bcf783844b8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085164 Aug 08 08:55:47.911750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 728/1429] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:47 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:48.547946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-df604fca-6ca0-43cb-8470-f61466386620 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:48.549940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-df604fca-6ca0-43cb-8470-f61466386620 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:48.556914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df604fca-6ca0-43cb-8470-f61466386620 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:48.557445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df604fca-6ca0-43cb-8470-f61466386620 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:48.557878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df604fca-6ca0-43cb-8470-f61466386620 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:48.558562 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df604fca-6ca0-43cb-8470-f61466386620 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:48.559012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df604fca-6ca0-43cb-8470-f61466386620 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:48.559436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-df604fca-6ca0-43cb-8470-f61466386620 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:48.588514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-df604fca-6ca0-43cb-8470-f61466386620 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045389 Aug 08 08:55:48.589237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 702/1430] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:48.932554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b5be0672-2765-4504-9daf-218b98e473d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:48.933194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b5be0672-2765-4504-9daf-218b98e473d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:48.939671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5be0672-2765-4504-9daf-218b98e473d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:48.940142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5be0672-2765-4504-9daf-218b98e473d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:48.940574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5be0672-2765-4504-9daf-218b98e473d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:48.941288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5be0672-2765-4504-9daf-218b98e473d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:48.941742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5be0672-2765-4504-9daf-218b98e473d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:48.942166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b5be0672-2765-4504-9daf-218b98e473d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:49.003252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b5be0672-2765-4504-9daf-218b98e473d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:49.010652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b5be0672-2765-4504-9daf-218b98e473d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082591 Aug 08 08:55:49.011207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 729/1431] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:48 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:49.606526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cb5ed52a-7514-479e-ad0d-7c64f7fd2c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:49.608672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cb5ed52a-7514-479e-ad0d-7c64f7fd2c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:49.615298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb5ed52a-7514-479e-ad0d-7c64f7fd2c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:49.615781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb5ed52a-7514-479e-ad0d-7c64f7fd2c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:49.616218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb5ed52a-7514-479e-ad0d-7c64f7fd2c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:49.616950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb5ed52a-7514-479e-ad0d-7c64f7fd2c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:49.617556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb5ed52a-7514-479e-ad0d-7c64f7fd2c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:49.617985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb5ed52a-7514-479e-ad0d-7c64f7fd2c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:49.646171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cb5ed52a-7514-479e-ad0d-7c64f7fd2c79 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043623 Aug 08 08:55:49.646714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 703/1432] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:55:50.031597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d4c175b7-84db-46be-8690-3b28a7bfb986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:50.032140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d4c175b7-84db-46be-8690-3b28a7bfb986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:50.038477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4c175b7-84db-46be-8690-3b28a7bfb986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:50.039595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4c175b7-84db-46be-8690-3b28a7bfb986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:50.040135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4c175b7-84db-46be-8690-3b28a7bfb986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:50.040817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4c175b7-84db-46be-8690-3b28a7bfb986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:50.041304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4c175b7-84db-46be-8690-3b28a7bfb986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:50.041729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4c175b7-84db-46be-8690-3b28a7bfb986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:50.102436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d4c175b7-84db-46be-8690-3b28a7bfb986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:50.110151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d4c175b7-84db-46be-8690-3b28a7bfb986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082817 Aug 08 08:55:50.110704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 730/1433] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:50 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:50.658978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7e31d34c-96a5-4421-a1c9-df00d73021d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:50.661118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7e31d34c-96a5-4421-a1c9-df00d73021d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:50.668310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e31d34c-96a5-4421-a1c9-df00d73021d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:50.668733 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e31d34c-96a5-4421-a1c9-df00d73021d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:50.669196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e31d34c-96a5-4421-a1c9-df00d73021d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:50.669891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e31d34c-96a5-4421-a1c9-df00d73021d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:50.670349 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e31d34c-96a5-4421-a1c9-df00d73021d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:50.670779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e31d34c-96a5-4421-a1c9-df00d73021d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:50.698525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7e31d34c-96a5-4421-a1c9-df00d73021d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043506 Aug 08 08:55:50.699075 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 704/1434] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:50 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:51.130766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9a3f44df-731b-462f-a93c-97148458fe9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:51.131374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9a3f44df-731b-462f-a93c-97148458fe9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:51.138454 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a3f44df-731b-462f-a93c-97148458fe9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:51.139248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a3f44df-731b-462f-a93c-97148458fe9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:51.139683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a3f44df-731b-462f-a93c-97148458fe9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:51.140372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a3f44df-731b-462f-a93c-97148458fe9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:51.140824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a3f44df-731b-462f-a93c-97148458fe9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:51.141279 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a3f44df-731b-462f-a93c-97148458fe9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:51.205369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9a3f44df-731b-462f-a93c-97148458fe9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:51.213634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9a3f44df-731b-462f-a93c-97148458fe9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086718 Aug 08 08:55:51.214190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 731/1435] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:51 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:51.710845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0381a3de-a89f-43c4-871a-c071fe970082 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:51.713014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0381a3de-a89f-43c4-871a-c071fe970082 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:51.719441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0381a3de-a89f-43c4-871a-c071fe970082 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:51.719922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0381a3de-a89f-43c4-871a-c071fe970082 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:51.720357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0381a3de-a89f-43c4-871a-c071fe970082 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:51.721040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0381a3de-a89f-43c4-871a-c071fe970082 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:51.721522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0381a3de-a89f-43c4-871a-c071fe970082 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:51.721948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0381a3de-a89f-43c4-871a-c071fe970082 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:51.750570 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0381a3de-a89f-43c4-871a-c071fe970082 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043823 Aug 08 08:55:51.751112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 705/1436] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:51 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:55:52.234671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c04b5c94-1f79-4a7f-8eb1-f75ca89b451e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:52.235389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c04b5c94-1f79-4a7f-8eb1-f75ca89b451e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:52.243038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c04b5c94-1f79-4a7f-8eb1-f75ca89b451e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:52.243522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c04b5c94-1f79-4a7f-8eb1-f75ca89b451e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:52.243988 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c04b5c94-1f79-4a7f-8eb1-f75ca89b451e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:52.244682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c04b5c94-1f79-4a7f-8eb1-f75ca89b451e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:52.245137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c04b5c94-1f79-4a7f-8eb1-f75ca89b451e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:52.245583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c04b5c94-1f79-4a7f-8eb1-f75ca89b451e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:52.336450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c04b5c94-1f79-4a7f-8eb1-f75ca89b451e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:52.344197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c04b5c94-1f79-4a7f-8eb1-f75ca89b451e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.113338 Aug 08 08:55:52.344765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 732/1437] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:52 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:55:52.763375 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c0d73706-1637-47eb-81e9-182941d102fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:52.765575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c0d73706-1637-47eb-81e9-182941d102fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:52.771874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0d73706-1637-47eb-81e9-182941d102fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:52.772358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0d73706-1637-47eb-81e9-182941d102fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:52.772789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0d73706-1637-47eb-81e9-182941d102fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:52.774252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0d73706-1637-47eb-81e9-182941d102fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:52.774706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0d73706-1637-47eb-81e9-182941d102fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:52.775127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c0d73706-1637-47eb-81e9-182941d102fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:52.802482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c0d73706-1637-47eb-81e9-182941d102fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043034 Aug 08 08:55:52.803017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 706/1438] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:52 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:53.364224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3d3359c0-c53b-441d-9fc3-dece1ee8d868 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:53.364852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3d3359c0-c53b-441d-9fc3-dece1ee8d868 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:53.371342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d3359c0-c53b-441d-9fc3-dece1ee8d868 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:53.371831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d3359c0-c53b-441d-9fc3-dece1ee8d868 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:53.372275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d3359c0-c53b-441d-9fc3-dece1ee8d868 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:53.372969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d3359c0-c53b-441d-9fc3-dece1ee8d868 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:53.373465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d3359c0-c53b-441d-9fc3-dece1ee8d868 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:53.373898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3d3359c0-c53b-441d-9fc3-dece1ee8d868 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:53.434716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3d3359c0-c53b-441d-9fc3-dece1ee8d868 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:53.442353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3d3359c0-c53b-441d-9fc3-dece1ee8d868 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082284 Aug 08 08:55:53.442910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 733/1439] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:53 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:53.814340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-69bc2f00-d9a0-4207-9c23-79661e8f629e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:53.816529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-69bc2f00-d9a0-4207-9c23-79661e8f629e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:53.823672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69bc2f00-d9a0-4207-9c23-79661e8f629e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:53.824154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69bc2f00-d9a0-4207-9c23-79661e8f629e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:53.824590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69bc2f00-d9a0-4207-9c23-79661e8f629e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:53.825311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69bc2f00-d9a0-4207-9c23-79661e8f629e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:53.825770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69bc2f00-d9a0-4207-9c23-79661e8f629e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:53.826197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69bc2f00-d9a0-4207-9c23-79661e8f629e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:53.853596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-69bc2f00-d9a0-4207-9c23-79661e8f629e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043097 Aug 08 08:55:53.854139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 707/1440] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:53 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:54.463640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8cd0742a-4d33-4e08-968a-f9b01590c87e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:54.464247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8cd0742a-4d33-4e08-968a-f9b01590c87e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:54.470636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd0742a-4d33-4e08-968a-f9b01590c87e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:54.471120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd0742a-4d33-4e08-968a-f9b01590c87e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:54.471570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd0742a-4d33-4e08-968a-f9b01590c87e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:54.472317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd0742a-4d33-4e08-968a-f9b01590c87e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:54.472770 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd0742a-4d33-4e08-968a-f9b01590c87e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:54.473220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cd0742a-4d33-4e08-968a-f9b01590c87e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:54.540852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8cd0742a-4d33-4e08-968a-f9b01590c87e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:54.548643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8cd0742a-4d33-4e08-968a-f9b01590c87e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.089363 Aug 08 08:55:54.549234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 734/1441] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:54 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:54.865937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3499e5c6-192b-4957-9255-5bac273cbdb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:54.868707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3499e5c6-192b-4957-9255-5bac273cbdb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:54.875096 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3499e5c6-192b-4957-9255-5bac273cbdb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:54.875573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3499e5c6-192b-4957-9255-5bac273cbdb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:54.876015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3499e5c6-192b-4957-9255-5bac273cbdb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:54.876694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3499e5c6-192b-4957-9255-5bac273cbdb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:54.877169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3499e5c6-192b-4957-9255-5bac273cbdb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:54.877596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3499e5c6-192b-4957-9255-5bac273cbdb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:54.905489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3499e5c6-192b-4957-9255-5bac273cbdb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043442 Aug 08 08:55:54.906024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 708/1442] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:54 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:55.569440 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6716caed-4001-4678-9715-ad202d2c4077 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:55.570822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6716caed-4001-4678-9715-ad202d2c4077 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:55.576841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6716caed-4001-4678-9715-ad202d2c4077 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:55.577354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6716caed-4001-4678-9715-ad202d2c4077 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:55.577787 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6716caed-4001-4678-9715-ad202d2c4077 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:55.578469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6716caed-4001-4678-9715-ad202d2c4077 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:55.578923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6716caed-4001-4678-9715-ad202d2c4077 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:55.579345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6716caed-4001-4678-9715-ad202d2c4077 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:55.640787 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6716caed-4001-4678-9715-ad202d2c4077 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:55.648778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6716caed-4001-4678-9715-ad202d2c4077 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082662 Aug 08 08:55:55.649428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 735/1443] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:55 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:55.917748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ad01f4b1-584b-47b1-83d9-09a5c2e6610e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:55.919871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ad01f4b1-584b-47b1-83d9-09a5c2e6610e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:55.926230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad01f4b1-584b-47b1-83d9-09a5c2e6610e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:55.926707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad01f4b1-584b-47b1-83d9-09a5c2e6610e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:55.927139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad01f4b1-584b-47b1-83d9-09a5c2e6610e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:55.927811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad01f4b1-584b-47b1-83d9-09a5c2e6610e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:55.928256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad01f4b1-584b-47b1-83d9-09a5c2e6610e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:55.928676 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad01f4b1-584b-47b1-83d9-09a5c2e6610e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:55.957072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ad01f4b1-584b-47b1-83d9-09a5c2e6610e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Aug 08 08:55:55.957630 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 709/1444] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:56.670423 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b2769095-2587-4b91-96a7-ba8de8cbd618 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:56.670952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b2769095-2587-4b91-96a7-ba8de8cbd618 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:56.677323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2769095-2587-4b91-96a7-ba8de8cbd618 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:56.677802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2769095-2587-4b91-96a7-ba8de8cbd618 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:56.678233 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2769095-2587-4b91-96a7-ba8de8cbd618 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:56.678917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2769095-2587-4b91-96a7-ba8de8cbd618 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:56.679370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2769095-2587-4b91-96a7-ba8de8cbd618 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:56.679784 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2769095-2587-4b91-96a7-ba8de8cbd618 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:56.741316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b2769095-2587-4b91-96a7-ba8de8cbd618 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:56.748895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b2769095-2587-4b91-96a7-ba8de8cbd618 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082441 Aug 08 08:55:56.749487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 736/1445] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:56 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:56.969545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fe276369-5635-446e-ba8f-3ff44bbb25bb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:56.971594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fe276369-5635-446e-ba8f-3ff44bbb25bb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:56.978073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe276369-5635-446e-ba8f-3ff44bbb25bb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:56.978559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe276369-5635-446e-ba8f-3ff44bbb25bb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:56.978998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe276369-5635-446e-ba8f-3ff44bbb25bb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:56.979687 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe276369-5635-446e-ba8f-3ff44bbb25bb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:56.980142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe276369-5635-446e-ba8f-3ff44bbb25bb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:56.980569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe276369-5635-446e-ba8f-3ff44bbb25bb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:57.008887 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fe276369-5635-446e-ba8f-3ff44bbb25bb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043505 Aug 08 08:55:57.009538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 710/1446] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:57.769656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-93d0ce2c-5aed-47b4-aade-c137eee13f51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:57.770269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-93d0ce2c-5aed-47b4-aade-c137eee13f51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:57.776945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93d0ce2c-5aed-47b4-aade-c137eee13f51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:57.777487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93d0ce2c-5aed-47b4-aade-c137eee13f51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:57.777923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93d0ce2c-5aed-47b4-aade-c137eee13f51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:57.778606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93d0ce2c-5aed-47b4-aade-c137eee13f51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:57.779059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93d0ce2c-5aed-47b4-aade-c137eee13f51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:57.779478 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93d0ce2c-5aed-47b4-aade-c137eee13f51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:57.840014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-93d0ce2c-5aed-47b4-aade-c137eee13f51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:57.847365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-93d0ce2c-5aed-47b4-aade-c137eee13f51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081597 Aug 08 08:55:57.847919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 737/1447] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:57 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:58.021347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-01bdc5a7-89b5-4ba1-9480-7f47444980ff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:58.023521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-01bdc5a7-89b5-4ba1-9480-7f47444980ff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:58.029875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01bdc5a7-89b5-4ba1-9480-7f47444980ff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:58.030360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01bdc5a7-89b5-4ba1-9480-7f47444980ff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:58.030800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01bdc5a7-89b5-4ba1-9480-7f47444980ff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:58.031510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01bdc5a7-89b5-4ba1-9480-7f47444980ff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:58.031970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01bdc5a7-89b5-4ba1-9480-7f47444980ff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:58.032403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01bdc5a7-89b5-4ba1-9480-7f47444980ff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:58.061113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-01bdc5a7-89b5-4ba1-9480-7f47444980ff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043882 Aug 08 08:55:58.061691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 711/1448] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:58.868488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1693da3d-a4d2-4e14-96ed-2787f4fe5b44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:58.868996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1693da3d-a4d2-4e14-96ed-2787f4fe5b44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:58.875406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1693da3d-a4d2-4e14-96ed-2787f4fe5b44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:58.875890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1693da3d-a4d2-4e14-96ed-2787f4fe5b44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:58.876320 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1693da3d-a4d2-4e14-96ed-2787f4fe5b44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:58.877004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1693da3d-a4d2-4e14-96ed-2787f4fe5b44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:58.877489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1693da3d-a4d2-4e14-96ed-2787f4fe5b44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:58.877913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1693da3d-a4d2-4e14-96ed-2787f4fe5b44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:58.941266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1693da3d-a4d2-4e14-96ed-2787f4fe5b44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:55:58.948860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1693da3d-a4d2-4e14-96ed-2787f4fe5b44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084948 Aug 08 08:55:58.949451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 738/1449] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:58 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:55:59.073369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dc972ba8-2c69-473b-9a69-26746f5c07c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:59.075534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dc972ba8-2c69-473b-9a69-26746f5c07c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:59.081973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc972ba8-2c69-473b-9a69-26746f5c07c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:59.082482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc972ba8-2c69-473b-9a69-26746f5c07c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:59.082922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc972ba8-2c69-473b-9a69-26746f5c07c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:59.083634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc972ba8-2c69-473b-9a69-26746f5c07c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:59.084092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc972ba8-2c69-473b-9a69-26746f5c07c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:59.084515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc972ba8-2c69-473b-9a69-26746f5c07c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:59.112938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dc972ba8-2c69-473b-9a69-26746f5c07c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 Aug 08 08:55:59.113522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 712/1450] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:55:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:55:59.969841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-745799e7-bf93-41e5-ac6a-4de0bbb219dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:55:59.970497 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-745799e7-bf93-41e5-ac6a-4de0bbb219dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:55:59.977538 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-745799e7-bf93-41e5-ac6a-4de0bbb219dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:59.978034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-745799e7-bf93-41e5-ac6a-4de0bbb219dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:59.978452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-745799e7-bf93-41e5-ac6a-4de0bbb219dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:55:59.979132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-745799e7-bf93-41e5-ac6a-4de0bbb219dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:55:59.979587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-745799e7-bf93-41e5-ac6a-4de0bbb219dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:55:59.980008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-745799e7-bf93-41e5-ac6a-4de0bbb219dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:00.042184 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-745799e7-bf93-41e5-ac6a-4de0bbb219dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:00.049589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-745799e7-bf93-41e5-ac6a-4de0bbb219dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083656 Aug 08 08:56:00.050150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 739/1451] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:55:59 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:00.125674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-eec7d82f-f4f7-49ce-b72e-2cf15e9e6aa7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:00.127836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-eec7d82f-f4f7-49ce-b72e-2cf15e9e6aa7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:00.134962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eec7d82f-f4f7-49ce-b72e-2cf15e9e6aa7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:00.135447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eec7d82f-f4f7-49ce-b72e-2cf15e9e6aa7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:00.135884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eec7d82f-f4f7-49ce-b72e-2cf15e9e6aa7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:00.136571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eec7d82f-f4f7-49ce-b72e-2cf15e9e6aa7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:00.137025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eec7d82f-f4f7-49ce-b72e-2cf15e9e6aa7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:00.137479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-eec7d82f-f4f7-49ce-b72e-2cf15e9e6aa7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:00.165925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-eec7d82f-f4f7-49ce-b72e-2cf15e9e6aa7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044179 Aug 08 08:56:00.166473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 713/1452] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:00 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:01.070332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1af3b88f-ac54-45bd-97ea-ed67c5a35a76 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:01.070937 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1af3b88f-ac54-45bd-97ea-ed67c5a35a76 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:01.077328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1af3b88f-ac54-45bd-97ea-ed67c5a35a76 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:01.077816 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1af3b88f-ac54-45bd-97ea-ed67c5a35a76 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:01.078247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1af3b88f-ac54-45bd-97ea-ed67c5a35a76 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:01.078933 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1af3b88f-ac54-45bd-97ea-ed67c5a35a76 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:01.079386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1af3b88f-ac54-45bd-97ea-ed67c5a35a76 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:01.079810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1af3b88f-ac54-45bd-97ea-ed67c5a35a76 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:01.140766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1af3b88f-ac54-45bd-97ea-ed67c5a35a76 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:01.148758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1af3b88f-ac54-45bd-97ea-ed67c5a35a76 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082309 Aug 08 08:56:01.149344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 740/1453] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:01 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:01.178065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f855e97e-9411-47e5-8572-bc58683efbcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:01.180415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f855e97e-9411-47e5-8572-bc58683efbcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:01.186769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f855e97e-9411-47e5-8572-bc58683efbcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:01.187248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f855e97e-9411-47e5-8572-bc58683efbcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:01.187684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f855e97e-9411-47e5-8572-bc58683efbcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:01.188373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f855e97e-9411-47e5-8572-bc58683efbcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:01.188857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f855e97e-9411-47e5-8572-bc58683efbcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:01.189317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f855e97e-9411-47e5-8572-bc58683efbcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:01.217654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f855e97e-9411-47e5-8572-bc58683efbcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 Aug 08 08:56:01.218198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 714/1454] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:01 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:02.168969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a4fd7f01-c073-4e6c-9db0-bd1c6580d718 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:02.169668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a4fd7f01-c073-4e6c-9db0-bd1c6580d718 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:02.176038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4fd7f01-c073-4e6c-9db0-bd1c6580d718 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:02.176511 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4fd7f01-c073-4e6c-9db0-bd1c6580d718 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:02.176949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4fd7f01-c073-4e6c-9db0-bd1c6580d718 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:02.177674 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4fd7f01-c073-4e6c-9db0-bd1c6580d718 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:02.178134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4fd7f01-c073-4e6c-9db0-bd1c6580d718 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:02.178561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4fd7f01-c073-4e6c-9db0-bd1c6580d718 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:02.230346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0f7a61b4-a1a1-48c1-8bd4-d8506d80923c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:02.232488 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0f7a61b4-a1a1-48c1-8bd4-d8506d80923c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:02.239393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f7a61b4-a1a1-48c1-8bd4-d8506d80923c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:02.239881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f7a61b4-a1a1-48c1-8bd4-d8506d80923c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:02.240339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f7a61b4-a1a1-48c1-8bd4-d8506d80923c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:02.241031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f7a61b4-a1a1-48c1-8bd4-d8506d80923c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:02.242087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f7a61b4-a1a1-48c1-8bd4-d8506d80923c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:02.242512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f7a61b4-a1a1-48c1-8bd4-d8506d80923c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:02.242627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a4fd7f01-c073-4e6c-9db0-bd1c6580d718 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:02.250306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a4fd7f01-c073-4e6c-9db0-bd1c6580d718 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085136 Aug 08 08:56:02.250877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 741/1455] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:02 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:02.272839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0f7a61b4-a1a1-48c1-8bd4-d8506d80923c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046808 Aug 08 08:56:02.273649 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 715/1456] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:02 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:56:03.271356 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-77ecb7ec-40cb-4c3c-b2cc-ddd7c467d0a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:03.271964 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-77ecb7ec-40cb-4c3c-b2cc-ddd7c467d0a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:03.278441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77ecb7ec-40cb-4c3c-b2cc-ddd7c467d0a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:03.278925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77ecb7ec-40cb-4c3c-b2cc-ddd7c467d0a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:03.279362 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77ecb7ec-40cb-4c3c-b2cc-ddd7c467d0a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:03.280056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77ecb7ec-40cb-4c3c-b2cc-ddd7c467d0a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:03.280509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77ecb7ec-40cb-4c3c-b2cc-ddd7c467d0a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:03.280935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77ecb7ec-40cb-4c3c-b2cc-ddd7c467d0a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:03.284777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-42d79e8d-49de-4ac0-94cb-bec6fefc240f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:03.286938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-42d79e8d-49de-4ac0-94cb-bec6fefc240f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:03.293418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42d79e8d-49de-4ac0-94cb-bec6fefc240f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:03.293902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42d79e8d-49de-4ac0-94cb-bec6fefc240f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:03.294333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42d79e8d-49de-4ac0-94cb-bec6fefc240f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:03.295019 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42d79e8d-49de-4ac0-94cb-bec6fefc240f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:03.295471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42d79e8d-49de-4ac0-94cb-bec6fefc240f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:03.295892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42d79e8d-49de-4ac0-94cb-bec6fefc240f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:03.299695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:03.321107 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:03.325695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-42d79e8d-49de-4ac0-94cb-bec6fefc240f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044663 Aug 08 08:56:03.326274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 716/1457] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:56:03.345963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-77ecb7ec-40cb-4c3c-b2cc-ddd7c467d0a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:03.354415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-77ecb7ec-40cb-4c3c-b2cc-ddd7c467d0a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086962 Aug 08 08:56:03.354979 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 742/1458] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:03 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:04.338510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-07019d9e-5ead-4c6c-807c-cda0736fd8a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:04.340656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-07019d9e-5ead-4c6c-807c-cda0736fd8a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:04.347605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07019d9e-5ead-4c6c-807c-cda0736fd8a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:04.348087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07019d9e-5ead-4c6c-807c-cda0736fd8a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:04.348523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07019d9e-5ead-4c6c-807c-cda0736fd8a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:04.349235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07019d9e-5ead-4c6c-807c-cda0736fd8a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:04.349694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07019d9e-5ead-4c6c-807c-cda0736fd8a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:04.350118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07019d9e-5ead-4c6c-807c-cda0736fd8a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:04.375587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bc824c7e-ae0a-4197-a8a1-f53a026d1127 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:04.376201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bc824c7e-ae0a-4197-a8a1-f53a026d1127 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:04.379035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-07019d9e-5ead-4c6c-807c-cda0736fd8a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044948 Aug 08 08:56:04.379590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 717/1459] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:04.382788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc824c7e-ae0a-4197-a8a1-f53a026d1127 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:04.383276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc824c7e-ae0a-4197-a8a1-f53a026d1127 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:04.383719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc824c7e-ae0a-4197-a8a1-f53a026d1127 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:04.384415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc824c7e-ae0a-4197-a8a1-f53a026d1127 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:04.384870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc824c7e-ae0a-4197-a8a1-f53a026d1127 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:04.385331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bc824c7e-ae0a-4197-a8a1-f53a026d1127 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:04.446092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bc824c7e-ae0a-4197-a8a1-f53a026d1127 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:04.453465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bc824c7e-ae0a-4197-a8a1-f53a026d1127 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081698 Aug 08 08:56:04.454022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 743/1460] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:04 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:05.390769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4df9e167-f0e2-4841-ba08-25c822715442 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:05.392911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4df9e167-f0e2-4841-ba08-25c822715442 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:05.399436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4df9e167-f0e2-4841-ba08-25c822715442 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:05.399916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4df9e167-f0e2-4841-ba08-25c822715442 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:05.400354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4df9e167-f0e2-4841-ba08-25c822715442 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:05.401039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4df9e167-f0e2-4841-ba08-25c822715442 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:05.401529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4df9e167-f0e2-4841-ba08-25c822715442 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:05.401959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4df9e167-f0e2-4841-ba08-25c822715442 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:05.431449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4df9e167-f0e2-4841-ba08-25c822715442 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044632 Aug 08 08:56:05.431999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 718/1461] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:05 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:05.474631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-510abe35-52bb-4ffb-86b0-a3623173230d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:05.475163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-510abe35-52bb-4ffb-86b0-a3623173230d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:05.482271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-510abe35-52bb-4ffb-86b0-a3623173230d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:05.482762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-510abe35-52bb-4ffb-86b0-a3623173230d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:05.483204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-510abe35-52bb-4ffb-86b0-a3623173230d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:05.483900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-510abe35-52bb-4ffb-86b0-a3623173230d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:05.484631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-510abe35-52bb-4ffb-86b0-a3623173230d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:05.485063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-510abe35-52bb-4ffb-86b0-a3623173230d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:05.546645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-510abe35-52bb-4ffb-86b0-a3623173230d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:05.554969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-510abe35-52bb-4ffb-86b0-a3623173230d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083363 Aug 08 08:56:05.555621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 744/1462] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:05 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:06.443715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3562fe52-55d0-4e23-9ab6-a1ad122d9dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:06.446698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3562fe52-55d0-4e23-9ab6-a1ad122d9dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:06.448957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=58 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:06.453619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3562fe52-55d0-4e23-9ab6-a1ad122d9dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:06.454099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3562fe52-55d0-4e23-9ab6-a1ad122d9dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:06.454560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3562fe52-55d0-4e23-9ab6-a1ad122d9dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:06.455235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3562fe52-55d0-4e23-9ab6-a1ad122d9dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:06.455681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3562fe52-55d0-4e23-9ab6-a1ad122d9dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:06.456099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3562fe52-55d0-4e23-9ab6-a1ad122d9dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:06.483739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3562fe52-55d0-4e23-9ab6-a1ad122d9dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043984 Aug 08 08:56:06.484527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 719/1463] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:06 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:06.575666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dea312da-e2a2-46d6-a8ff-2a5c4fd82f58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:06.576273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dea312da-e2a2-46d6-a8ff-2a5c4fd82f58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:06.583033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea312da-e2a2-46d6-a8ff-2a5c4fd82f58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:06.583515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea312da-e2a2-46d6-a8ff-2a5c4fd82f58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:06.583948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea312da-e2a2-46d6-a8ff-2a5c4fd82f58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:06.584630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea312da-e2a2-46d6-a8ff-2a5c4fd82f58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:06.585082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea312da-e2a2-46d6-a8ff-2a5c4fd82f58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:06.585553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea312da-e2a2-46d6-a8ff-2a5c4fd82f58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:06.646383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dea312da-e2a2-46d6-a8ff-2a5c4fd82f58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:06.654494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dea312da-e2a2-46d6-a8ff-2a5c4fd82f58 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082696 Aug 08 08:56:06.655056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 745/1464] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:06 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:07.497163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d99e4b27-c693-4a7d-94c0-57744f24ae07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:07.499293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d99e4b27-c693-4a7d-94c0-57744f24ae07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:07.505849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d99e4b27-c693-4a7d-94c0-57744f24ae07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:07.506340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d99e4b27-c693-4a7d-94c0-57744f24ae07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:07.506781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d99e4b27-c693-4a7d-94c0-57744f24ae07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:07.508416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d99e4b27-c693-4a7d-94c0-57744f24ae07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:07.508884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d99e4b27-c693-4a7d-94c0-57744f24ae07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:07.509358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d99e4b27-c693-4a7d-94c0-57744f24ae07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:07.537253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d99e4b27-c693-4a7d-94c0-57744f24ae07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044809 Aug 08 08:56:07.537799 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 720/1465] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:07 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:07.674709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b9007124-f5bf-4a2e-b40b-96f660327e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:07.675349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b9007124-f5bf-4a2e-b40b-96f660327e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:07.682899 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9007124-f5bf-4a2e-b40b-96f660327e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:07.683383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9007124-f5bf-4a2e-b40b-96f660327e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:07.683817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9007124-f5bf-4a2e-b40b-96f660327e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:07.684504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9007124-f5bf-4a2e-b40b-96f660327e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:07.684957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9007124-f5bf-4a2e-b40b-96f660327e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:07.685414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9007124-f5bf-4a2e-b40b-96f660327e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:07.748880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b9007124-f5bf-4a2e-b40b-96f660327e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:07.756289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b9007124-f5bf-4a2e-b40b-96f660327e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085432 Aug 08 08:56:07.756851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 746/1466] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:07 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:08.550152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-372ebdec-72a5-4094-8e65-61dd52633f49 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:08.552323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-372ebdec-72a5-4094-8e65-61dd52633f49 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:08.559479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-372ebdec-72a5-4094-8e65-61dd52633f49 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:08.559986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-372ebdec-72a5-4094-8e65-61dd52633f49 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:08.560406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-372ebdec-72a5-4094-8e65-61dd52633f49 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:08.561101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-372ebdec-72a5-4094-8e65-61dd52633f49 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:08.561590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-372ebdec-72a5-4094-8e65-61dd52633f49 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:08.562025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-372ebdec-72a5-4094-8e65-61dd52633f49 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:08.591156 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-372ebdec-72a5-4094-8e65-61dd52633f49 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045013 Aug 08 08:56:08.591697 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 721/1467] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:08 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:08.776879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2ae8bdf8-d5e3-4ecd-9efd-450062628c49 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:08.777466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2ae8bdf8-d5e3-4ecd-9efd-450062628c49 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:08.779698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=56 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:08.784550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ae8bdf8-d5e3-4ecd-9efd-450062628c49 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:08.785033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ae8bdf8-d5e3-4ecd-9efd-450062628c49 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:08.785490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ae8bdf8-d5e3-4ecd-9efd-450062628c49 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:08.786175 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ae8bdf8-d5e3-4ecd-9efd-450062628c49 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:08.786628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ae8bdf8-d5e3-4ecd-9efd-450062628c49 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:08.787091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ae8bdf8-d5e3-4ecd-9efd-450062628c49 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:08.852008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2ae8bdf8-d5e3-4ecd-9efd-450062628c49 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:08.859598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2ae8bdf8-d5e3-4ecd-9efd-450062628c49 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086970 Aug 08 08:56:08.860153 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 747/1468] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:08 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:09.603349 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-92a3c82e-5261-451e-bb0f-4101f94cbf2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:09.605495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-92a3c82e-5261-451e-bb0f-4101f94cbf2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:09.612040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92a3c82e-5261-451e-bb0f-4101f94cbf2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:09.612514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92a3c82e-5261-451e-bb0f-4101f94cbf2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:09.612944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92a3c82e-5261-451e-bb0f-4101f94cbf2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:09.613662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92a3c82e-5261-451e-bb0f-4101f94cbf2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:09.614110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92a3c82e-5261-451e-bb0f-4101f94cbf2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:09.614526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92a3c82e-5261-451e-bb0f-4101f94cbf2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:09.643038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-92a3c82e-5261-451e-bb0f-4101f94cbf2d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Aug 08 08:56:09.643566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 722/1469] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:09.880133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cd1af9cd-d915-4b28-b461-43e8174dbae1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:09.880742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cd1af9cd-d915-4b28-b461-43e8174dbae1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:09.887318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd1af9cd-d915-4b28-b461-43e8174dbae1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:09.887799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd1af9cd-d915-4b28-b461-43e8174dbae1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:09.888226 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd1af9cd-d915-4b28-b461-43e8174dbae1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:09.888908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd1af9cd-d915-4b28-b461-43e8174dbae1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:09.889383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd1af9cd-d915-4b28-b461-43e8174dbae1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:09.889805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd1af9cd-d915-4b28-b461-43e8174dbae1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:09.950111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cd1af9cd-d915-4b28-b461-43e8174dbae1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:09.957595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cd1af9cd-d915-4b28-b461-43e8174dbae1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081274 Aug 08 08:56:09.958152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 748/1470] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:09 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:10.655759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a7b188ff-4d6c-4011-a85e-66192bafd619 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:10.657945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a7b188ff-4d6c-4011-a85e-66192bafd619 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:10.664972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7b188ff-4d6c-4011-a85e-66192bafd619 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:10.665490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7b188ff-4d6c-4011-a85e-66192bafd619 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:10.665925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7b188ff-4d6c-4011-a85e-66192bafd619 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:10.666703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7b188ff-4d6c-4011-a85e-66192bafd619 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:10.667161 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7b188ff-4d6c-4011-a85e-66192bafd619 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:10.667584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7b188ff-4d6c-4011-a85e-66192bafd619 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:10.701589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a7b188ff-4d6c-4011-a85e-66192bafd619 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049892 Aug 08 08:56:10.702255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 723/1471] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:10 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:10.977813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-956aba94-7a57-4f6f-b120-2c282f10d7d1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:10.978368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-956aba94-7a57-4f6f-b120-2c282f10d7d1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:10.985169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-956aba94-7a57-4f6f-b120-2c282f10d7d1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:10.985663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-956aba94-7a57-4f6f-b120-2c282f10d7d1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:10.986094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-956aba94-7a57-4f6f-b120-2c282f10d7d1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:10.986784 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-956aba94-7a57-4f6f-b120-2c282f10d7d1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:10.987236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-956aba94-7a57-4f6f-b120-2c282f10d7d1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:10.987659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-956aba94-7a57-4f6f-b120-2c282f10d7d1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:11.052272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-956aba94-7a57-4f6f-b120-2c282f10d7d1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:11.061081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-956aba94-7a57-4f6f-b120-2c282f10d7d1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.087258 Aug 08 08:56:11.061681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 749/1472] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:10 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:11.714612 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b409582f-eda9-4702-ae25-20606cc09dcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:11.716683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b409582f-eda9-4702-ae25-20606cc09dcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:11.723063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b409582f-eda9-4702-ae25-20606cc09dcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:11.723548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b409582f-eda9-4702-ae25-20606cc09dcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:11.723987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b409582f-eda9-4702-ae25-20606cc09dcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:11.724676 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b409582f-eda9-4702-ae25-20606cc09dcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:11.725129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b409582f-eda9-4702-ae25-20606cc09dcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:11.725582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b409582f-eda9-4702-ae25-20606cc09dcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:11.754734 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b409582f-eda9-4702-ae25-20606cc09dcf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044663 Aug 08 08:56:11.755290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 724/1473] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:11 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:12.082579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d4913aa1-6405-4de6-9e02-d3779b4cd9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:12.083133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d4913aa1-6405-4de6-9e02-d3779b4cd9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:12.090221 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4913aa1-6405-4de6-9e02-d3779b4cd9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:12.090713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4913aa1-6405-4de6-9e02-d3779b4cd9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:12.091154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4913aa1-6405-4de6-9e02-d3779b4cd9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:12.091854 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4913aa1-6405-4de6-9e02-d3779b4cd9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:12.092318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4913aa1-6405-4de6-9e02-d3779b4cd9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:12.092751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4913aa1-6405-4de6-9e02-d3779b4cd9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:12.156480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d4913aa1-6405-4de6-9e02-d3779b4cd9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:12.164096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d4913aa1-6405-4de6-9e02-d3779b4cd9cf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085558 Aug 08 08:56:12.164664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 750/1474] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:12 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:12.766973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7d02ad6f-59dc-479d-9005-05af0e17993b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:12.769172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7d02ad6f-59dc-479d-9005-05af0e17993b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:12.775696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d02ad6f-59dc-479d-9005-05af0e17993b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:12.776165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d02ad6f-59dc-479d-9005-05af0e17993b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:12.776605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d02ad6f-59dc-479d-9005-05af0e17993b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:12.777330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d02ad6f-59dc-479d-9005-05af0e17993b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:12.777785 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d02ad6f-59dc-479d-9005-05af0e17993b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:12.778209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d02ad6f-59dc-479d-9005-05af0e17993b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:12.807880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7d02ad6f-59dc-479d-9005-05af0e17993b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Aug 08 08:56:12.808430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 725/1475] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:12 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:13.183957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b3614a50-4f35-40d2-bb12-11e6d09c0ce9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:13.184575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b3614a50-4f35-40d2-bb12-11e6d09c0ce9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:13.190938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3614a50-4f35-40d2-bb12-11e6d09c0ce9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:13.191424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3614a50-4f35-40d2-bb12-11e6d09c0ce9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:13.191866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3614a50-4f35-40d2-bb12-11e6d09c0ce9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:13.192554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3614a50-4f35-40d2-bb12-11e6d09c0ce9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:13.193016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3614a50-4f35-40d2-bb12-11e6d09c0ce9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:13.193468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3614a50-4f35-40d2-bb12-11e6d09c0ce9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:13.254445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b3614a50-4f35-40d2-bb12-11e6d09c0ce9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:13.262197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b3614a50-4f35-40d2-bb12-11e6d09c0ce9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082125 Aug 08 08:56:13.262760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 751/1476] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:13 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:13.820778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5a60b341-fa3e-410e-97fd-aeeba906ee04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:13.822967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5a60b341-fa3e-410e-97fd-aeeba906ee04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:13.829283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a60b341-fa3e-410e-97fd-aeeba906ee04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:13.829760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a60b341-fa3e-410e-97fd-aeeba906ee04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:13.830196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a60b341-fa3e-410e-97fd-aeeba906ee04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:13.830872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a60b341-fa3e-410e-97fd-aeeba906ee04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:13.831320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a60b341-fa3e-410e-97fd-aeeba906ee04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:13.831737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a60b341-fa3e-410e-97fd-aeeba906ee04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:13.860008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5a60b341-fa3e-410e-97fd-aeeba906ee04 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Aug 08 08:56:13.860536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 726/1477] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:14.283179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0a12b326-5e44-4257-881b-1fbc9440ddd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:14.283848 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0a12b326-5e44-4257-881b-1fbc9440ddd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:14.291905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a12b326-5e44-4257-881b-1fbc9440ddd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:14.292401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a12b326-5e44-4257-881b-1fbc9440ddd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:14.292845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a12b326-5e44-4257-881b-1fbc9440ddd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:14.293578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a12b326-5e44-4257-881b-1fbc9440ddd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:14.294041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a12b326-5e44-4257-881b-1fbc9440ddd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:14.294473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a12b326-5e44-4257-881b-1fbc9440ddd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:14.354857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0a12b326-5e44-4257-881b-1fbc9440ddd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:14.362500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0a12b326-5e44-4257-881b-1fbc9440ddd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083349 Aug 08 08:56:14.363059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 752/1478] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:14 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:14.872276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d12808f4-b8db-4f52-a972-2878af75ab33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:14.874459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d12808f4-b8db-4f52-a972-2878af75ab33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:14.880821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d12808f4-b8db-4f52-a972-2878af75ab33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:14.881333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d12808f4-b8db-4f52-a972-2878af75ab33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:14.881764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d12808f4-b8db-4f52-a972-2878af75ab33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:14.882534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d12808f4-b8db-4f52-a972-2878af75ab33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:14.882988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d12808f4-b8db-4f52-a972-2878af75ab33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:14.883411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d12808f4-b8db-4f52-a972-2878af75ab33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:14.911132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d12808f4-b8db-4f52-a972-2878af75ab33 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042866 Aug 08 08:56:14.911662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 727/1479] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:15.384061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2b758ceb-e0b4-4a5b-a5ac-c511536ba3b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:15.384674 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2b758ceb-e0b4-4a5b-a5ac-c511536ba3b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:15.391006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b758ceb-e0b4-4a5b-a5ac-c511536ba3b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:15.391486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b758ceb-e0b4-4a5b-a5ac-c511536ba3b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:15.391922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b758ceb-e0b4-4a5b-a5ac-c511536ba3b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:15.392603 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b758ceb-e0b4-4a5b-a5ac-c511536ba3b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:15.393055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b758ceb-e0b4-4a5b-a5ac-c511536ba3b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:15.393502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b758ceb-e0b4-4a5b-a5ac-c511536ba3b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:15.454698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2b758ceb-e0b4-4a5b-a5ac-c511536ba3b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:15.462377 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2b758ceb-e0b4-4a5b-a5ac-c511536ba3b4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082664 Aug 08 08:56:15.462940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 753/1480] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:15 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:15.924071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9f933786-eb8e-4f28-aafc-0a2b6cc3e363 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:15.926282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9f933786-eb8e-4f28-aafc-0a2b6cc3e363 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:15.933434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f933786-eb8e-4f28-aafc-0a2b6cc3e363 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:15.933913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f933786-eb8e-4f28-aafc-0a2b6cc3e363 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:15.934351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f933786-eb8e-4f28-aafc-0a2b6cc3e363 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:15.935042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f933786-eb8e-4f28-aafc-0a2b6cc3e363 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:15.935494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f933786-eb8e-4f28-aafc-0a2b6cc3e363 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:15.935920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f933786-eb8e-4f28-aafc-0a2b6cc3e363 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:15.963812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9f933786-eb8e-4f28-aafc-0a2b6cc3e363 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 Aug 08 08:56:15.964360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 728/1481] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:15 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:16.482868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f319d140-dc4b-4de8-acac-60021595e6cb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:16.483516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f319d140-dc4b-4de8-acac-60021595e6cb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:16.490279 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f319d140-dc4b-4de8-acac-60021595e6cb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:16.490771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f319d140-dc4b-4de8-acac-60021595e6cb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:16.491234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f319d140-dc4b-4de8-acac-60021595e6cb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:16.491935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f319d140-dc4b-4de8-acac-60021595e6cb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:16.492397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f319d140-dc4b-4de8-acac-60021595e6cb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:16.492830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f319d140-dc4b-4de8-acac-60021595e6cb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:16.557638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f319d140-dc4b-4de8-acac-60021595e6cb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:16.565167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f319d140-dc4b-4de8-acac-60021595e6cb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086175 Aug 08 08:56:16.565724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 754/1482] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:16 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:16.975356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-339d0614-eb71-4c19-a004-1aa1ce11758e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:16.978134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-339d0614-eb71-4c19-a004-1aa1ce11758e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:16.984754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-339d0614-eb71-4c19-a004-1aa1ce11758e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:16.985276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-339d0614-eb71-4c19-a004-1aa1ce11758e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:16.985716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-339d0614-eb71-4c19-a004-1aa1ce11758e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:16.986407 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-339d0614-eb71-4c19-a004-1aa1ce11758e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:16.986861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-339d0614-eb71-4c19-a004-1aa1ce11758e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:16.987290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-339d0614-eb71-4c19-a004-1aa1ce11758e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:17.014897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-339d0614-eb71-4c19-a004-1aa1ce11758e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043503 Aug 08 08:56:17.015434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 729/1483] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:17.586189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e8dadac8-6082-457b-afcf-c842f16ce599 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:17.586799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e8dadac8-6082-457b-afcf-c842f16ce599 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:17.593218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8dadac8-6082-457b-afcf-c842f16ce599 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:17.593733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8dadac8-6082-457b-afcf-c842f16ce599 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:17.594170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8dadac8-6082-457b-afcf-c842f16ce599 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:17.594867 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8dadac8-6082-457b-afcf-c842f16ce599 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:17.595323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8dadac8-6082-457b-afcf-c842f16ce599 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:17.595745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8dadac8-6082-457b-afcf-c842f16ce599 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:17.656616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e8dadac8-6082-457b-afcf-c842f16ce599 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:17.664206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e8dadac8-6082-457b-afcf-c842f16ce599 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082628 Aug 08 08:56:17.664772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 755/1484] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:17 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:18.027100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b8411ca1-c32e-4fcf-ae72-65f298ebd7a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:18.029281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b8411ca1-c32e-4fcf-ae72-65f298ebd7a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:18.035828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8411ca1-c32e-4fcf-ae72-65f298ebd7a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:18.036257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8411ca1-c32e-4fcf-ae72-65f298ebd7a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:18.036696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8411ca1-c32e-4fcf-ae72-65f298ebd7a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:18.037414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8411ca1-c32e-4fcf-ae72-65f298ebd7a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:18.037872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8411ca1-c32e-4fcf-ae72-65f298ebd7a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:18.038792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b8411ca1-c32e-4fcf-ae72-65f298ebd7a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:18.067344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b8411ca1-c32e-4fcf-ae72-65f298ebd7a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044229 Aug 08 08:56:18.078462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 730/1485] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:18 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:18.684397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a6d18328-0ea6-49c6-b840-eb0bacbd1967 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:18.684946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a6d18328-0ea6-49c6-b840-eb0bacbd1967 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:18.691424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6d18328-0ea6-49c6-b840-eb0bacbd1967 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:18.691916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6d18328-0ea6-49c6-b840-eb0bacbd1967 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:18.692361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6d18328-0ea6-49c6-b840-eb0bacbd1967 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:18.693105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6d18328-0ea6-49c6-b840-eb0bacbd1967 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:18.693657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6d18328-0ea6-49c6-b840-eb0bacbd1967 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:18.694088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6d18328-0ea6-49c6-b840-eb0bacbd1967 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:18.755727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a6d18328-0ea6-49c6-b840-eb0bacbd1967 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:18.763355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a6d18328-0ea6-49c6-b840-eb0bacbd1967 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082937 Aug 08 08:56:18.763916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 756/1486] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:18 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:19.088646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-de11fef4-85fa-45f9-aefd-d0da065421cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:19.091451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-de11fef4-85fa-45f9-aefd-d0da065421cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:19.097877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de11fef4-85fa-45f9-aefd-d0da065421cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:19.098356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de11fef4-85fa-45f9-aefd-d0da065421cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:19.098792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de11fef4-85fa-45f9-aefd-d0da065421cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:19.099481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de11fef4-85fa-45f9-aefd-d0da065421cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:19.099932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de11fef4-85fa-45f9-aefd-d0da065421cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:19.100357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de11fef4-85fa-45f9-aefd-d0da065421cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:19.128480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-de11fef4-85fa-45f9-aefd-d0da065421cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 Aug 08 08:56:19.129045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 731/1487] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:19.783806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-920cbeca-4b9f-4cfb-9410-b014c834013f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:19.784423 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-920cbeca-4b9f-4cfb-9410-b014c834013f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:19.791638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-920cbeca-4b9f-4cfb-9410-b014c834013f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:19.792113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-920cbeca-4b9f-4cfb-9410-b014c834013f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:19.792548 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-920cbeca-4b9f-4cfb-9410-b014c834013f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:19.793269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-920cbeca-4b9f-4cfb-9410-b014c834013f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:19.793729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-920cbeca-4b9f-4cfb-9410-b014c834013f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:19.794158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-920cbeca-4b9f-4cfb-9410-b014c834013f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:19.855462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-920cbeca-4b9f-4cfb-9410-b014c834013f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:19.863326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-920cbeca-4b9f-4cfb-9410-b014c834013f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083377 Aug 08 08:56:19.863886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 757/1488] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:19 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:20.141388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a0e525bd-6b53-448d-9ba2-8d5a7abfef70 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:20.143555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a0e525bd-6b53-448d-9ba2-8d5a7abfef70 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:20.150669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0e525bd-6b53-448d-9ba2-8d5a7abfef70 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:20.151154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0e525bd-6b53-448d-9ba2-8d5a7abfef70 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:20.151601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0e525bd-6b53-448d-9ba2-8d5a7abfef70 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:20.152287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0e525bd-6b53-448d-9ba2-8d5a7abfef70 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:20.152741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0e525bd-6b53-448d-9ba2-8d5a7abfef70 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:20.153188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0e525bd-6b53-448d-9ba2-8d5a7abfef70 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:20.181878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a0e525bd-6b53-448d-9ba2-8d5a7abfef70 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Aug 08 08:56:20.182445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 732/1489] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:20 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:20.885187 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cb3062c3-aee2-4dfc-9746-da7508f574ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:20.885797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cb3062c3-aee2-4dfc-9746-da7508f574ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:20.891953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb3062c3-aee2-4dfc-9746-da7508f574ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:20.892455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb3062c3-aee2-4dfc-9746-da7508f574ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:20.892901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb3062c3-aee2-4dfc-9746-da7508f574ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:20.893649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb3062c3-aee2-4dfc-9746-da7508f574ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:20.894112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb3062c3-aee2-4dfc-9746-da7508f574ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:20.894545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb3062c3-aee2-4dfc-9746-da7508f574ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:20.957120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cb3062c3-aee2-4dfc-9746-da7508f574ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:20.964683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cb3062c3-aee2-4dfc-9746-da7508f574ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084181 Aug 08 08:56:20.965273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 758/1490] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:20 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:21.194374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-656fcf62-467a-466e-ac12-fef147b39541 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:21.196436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-656fcf62-467a-466e-ac12-fef147b39541 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:21.202772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-656fcf62-467a-466e-ac12-fef147b39541 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:21.203255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-656fcf62-467a-466e-ac12-fef147b39541 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:21.203695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-656fcf62-467a-466e-ac12-fef147b39541 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:21.204387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-656fcf62-467a-466e-ac12-fef147b39541 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:21.204847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-656fcf62-467a-466e-ac12-fef147b39541 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:21.205311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-656fcf62-467a-466e-ac12-fef147b39541 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:21.218967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:21.234042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-656fcf62-467a-466e-ac12-fef147b39541 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Aug 08 08:56:21.235300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 733/1491] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:21 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:21.985533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e2038aba-f6ba-45ad-a4f7-3f51053b5755 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:21.986154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e2038aba-f6ba-45ad-a4f7-3f51053b5755 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:21.992586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2038aba-f6ba-45ad-a4f7-3f51053b5755 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:21.993067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2038aba-f6ba-45ad-a4f7-3f51053b5755 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:21.993540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2038aba-f6ba-45ad-a4f7-3f51053b5755 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:21.994229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2038aba-f6ba-45ad-a4f7-3f51053b5755 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:21.994689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2038aba-f6ba-45ad-a4f7-3f51053b5755 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:21.995119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2038aba-f6ba-45ad-a4f7-3f51053b5755 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:21.999089 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:22.056451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e2038aba-f6ba-45ad-a4f7-3f51053b5755 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:22.063786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e2038aba-f6ba-45ad-a4f7-3f51053b5755 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082466 Aug 08 08:56:22.064349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 759/1492] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:21 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:22.246551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2ee6162b-46da-4c11-8565-60fd6a08eb94 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:22.248842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2ee6162b-46da-4c11-8565-60fd6a08eb94 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:22.255817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ee6162b-46da-4c11-8565-60fd6a08eb94 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:22.256294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ee6162b-46da-4c11-8565-60fd6a08eb94 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:22.257347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ee6162b-46da-4c11-8565-60fd6a08eb94 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:22.258053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ee6162b-46da-4c11-8565-60fd6a08eb94 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:22.258480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ee6162b-46da-4c11-8565-60fd6a08eb94 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:22.258902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ee6162b-46da-4c11-8565-60fd6a08eb94 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:22.286524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2ee6162b-46da-4c11-8565-60fd6a08eb94 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Aug 08 08:56:22.287060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 734/1493] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:23.085821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-34307c3e-0daa-4016-bd1a-7a1520902a51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:23.086469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-34307c3e-0daa-4016-bd1a-7a1520902a51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:23.092778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34307c3e-0daa-4016-bd1a-7a1520902a51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:23.093303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34307c3e-0daa-4016-bd1a-7a1520902a51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:23.093748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34307c3e-0daa-4016-bd1a-7a1520902a51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:23.094441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34307c3e-0daa-4016-bd1a-7a1520902a51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:23.094898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34307c3e-0daa-4016-bd1a-7a1520902a51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:23.095327 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34307c3e-0daa-4016-bd1a-7a1520902a51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:23.155925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-34307c3e-0daa-4016-bd1a-7a1520902a51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:23.164068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-34307c3e-0daa-4016-bd1a-7a1520902a51 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082591 Aug 08 08:56:23.164624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 760/1494] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:23 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:23.298771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cb130cd1-b4f2-4eeb-9cc9-e547290daf29 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:23.300935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cb130cd1-b4f2-4eeb-9cc9-e547290daf29 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:23.307325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb130cd1-b4f2-4eeb-9cc9-e547290daf29 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:23.307801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb130cd1-b4f2-4eeb-9cc9-e547290daf29 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:23.308230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb130cd1-b4f2-4eeb-9cc9-e547290daf29 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:23.308911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb130cd1-b4f2-4eeb-9cc9-e547290daf29 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:23.309398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb130cd1-b4f2-4eeb-9cc9-e547290daf29 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:23.309820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cb130cd1-b4f2-4eeb-9cc9-e547290daf29 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:23.338566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cb130cd1-b4f2-4eeb-9cc9-e547290daf29 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 Aug 08 08:56:23.339042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 735/1495] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:24.185049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dabf0b80-b102-4170-8b4f-e48c82b4e875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:24.185687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dabf0b80-b102-4170-8b4f-e48c82b4e875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:24.192108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dabf0b80-b102-4170-8b4f-e48c82b4e875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:24.192597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dabf0b80-b102-4170-8b4f-e48c82b4e875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:24.193032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dabf0b80-b102-4170-8b4f-e48c82b4e875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:24.193739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dabf0b80-b102-4170-8b4f-e48c82b4e875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:24.194193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dabf0b80-b102-4170-8b4f-e48c82b4e875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:24.194618 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dabf0b80-b102-4170-8b4f-e48c82b4e875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:24.257087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dabf0b80-b102-4170-8b4f-e48c82b4e875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:24.264532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dabf0b80-b102-4170-8b4f-e48c82b4e875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083394 Aug 08 08:56:24.265086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 761/1496] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:24 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:24.350476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4f093f56-c22b-432a-af71-8758cef2a1d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:24.353455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4f093f56-c22b-432a-af71-8758cef2a1d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:24.360077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f093f56-c22b-432a-af71-8758cef2a1d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:24.360556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f093f56-c22b-432a-af71-8758cef2a1d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:24.360989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f093f56-c22b-432a-af71-8758cef2a1d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:24.361706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f093f56-c22b-432a-af71-8758cef2a1d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:24.362158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f093f56-c22b-432a-af71-8758cef2a1d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:24.362584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f093f56-c22b-432a-af71-8758cef2a1d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:24.391284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4f093f56-c22b-432a-af71-8758cef2a1d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Aug 08 08:56:24.391840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 736/1497] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:24 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:25.285278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-258b6912-2c31-4bca-a261-6999135e009c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:25.285891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-258b6912-2c31-4bca-a261-6999135e009c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:25.292851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258b6912-2c31-4bca-a261-6999135e009c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:25.293364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258b6912-2c31-4bca-a261-6999135e009c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:25.293800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258b6912-2c31-4bca-a261-6999135e009c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:25.294487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258b6912-2c31-4bca-a261-6999135e009c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:25.294938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258b6912-2c31-4bca-a261-6999135e009c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:25.295359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-258b6912-2c31-4bca-a261-6999135e009c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:25.359111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-258b6912-2c31-4bca-a261-6999135e009c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:25.366823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-258b6912-2c31-4bca-a261-6999135e009c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085401 Aug 08 08:56:25.367449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 762/1498] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:25 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:25.404300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dd6ac894-8ef8-42c5-a568-30d0db98f9a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:25.406508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dd6ac894-8ef8-42c5-a568-30d0db98f9a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:25.412978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd6ac894-8ef8-42c5-a568-30d0db98f9a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:25.413495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd6ac894-8ef8-42c5-a568-30d0db98f9a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:25.413941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd6ac894-8ef8-42c5-a568-30d0db98f9a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:25.415297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd6ac894-8ef8-42c5-a568-30d0db98f9a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:25.415745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd6ac894-8ef8-42c5-a568-30d0db98f9a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:25.416166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd6ac894-8ef8-42c5-a568-30d0db98f9a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:25.445362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dd6ac894-8ef8-42c5-a568-30d0db98f9a7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Aug 08 08:56:25.445924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 737/1499] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:26.174172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:26.174671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:26.181047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:26.181561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:26.182001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:26.182698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:26.183156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:26.183585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:26.387284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a41c77b5-966a-453e-9953-d94a9fdb22b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:26.387903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a41c77b5-966a-453e-9953-d94a9fdb22b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:26.393876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a41c77b5-966a-453e-9953-d94a9fdb22b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:26.394361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a41c77b5-966a-453e-9953-d94a9fdb22b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:26.394808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a41c77b5-966a-453e-9953-d94a9fdb22b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:26.395532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a41c77b5-966a-453e-9953-d94a9fdb22b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:26.395992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a41c77b5-966a-453e-9953-d94a9fdb22b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:26.396427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a41c77b5-966a-453e-9953-d94a9fdb22b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:26.457401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a41c77b5-966a-453e-9953-d94a9fdb22b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:26.464911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a41c77b5-966a-453e-9953-d94a9fdb22b1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081638 Aug 08 08:56:26.465504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 738/1500] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:26 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:26.469962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-31a69cb5-53a4-449b-8ec0-248214d9999e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:26.472077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-31a69cb5-53a4-449b-8ec0-248214d9999e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:26.478147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a69cb5-53a4-449b-8ec0-248214d9999e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:26.478628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a69cb5-53a4-449b-8ec0-248214d9999e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:26.479066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a69cb5-53a4-449b-8ec0-248214d9999e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:26.479776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a69cb5-53a4-449b-8ec0-248214d9999e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:26.480217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a69cb5-53a4-449b-8ec0-248214d9999e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:26.480653 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a69cb5-53a4-449b-8ec0-248214d9999e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:26.509053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-31a69cb5-53a4-449b-8ec0-248214d9999e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042569 Aug 08 08:56:26.509631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 739/1501] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:27.486049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0ab90d51-6f47-4685-b3ed-380322fe5057 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:27.486674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0ab90d51-6f47-4685-b3ed-380322fe5057 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:27.493168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ab90d51-6f47-4685-b3ed-380322fe5057 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:27.493639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ab90d51-6f47-4685-b3ed-380322fe5057 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:27.494081 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ab90d51-6f47-4685-b3ed-380322fe5057 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:27.494774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ab90d51-6f47-4685-b3ed-380322fe5057 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:27.495237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ab90d51-6f47-4685-b3ed-380322fe5057 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:27.495667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0ab90d51-6f47-4685-b3ed-380322fe5057 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:27.556319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0ab90d51-6f47-4685-b3ed-380322fe5057 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:27.563716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0ab90d51-6f47-4685-b3ed-380322fe5057 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081810 Aug 08 08:56:27.564277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 740/1502] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:27 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:27.568677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9ba19ee1-ab7d-479c-88ad-240b562742be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:27.570938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9ba19ee1-ab7d-479c-88ad-240b562742be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:27.576612 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ba19ee1-ab7d-479c-88ad-240b562742be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:27.577099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ba19ee1-ab7d-479c-88ad-240b562742be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:27.577579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ba19ee1-ab7d-479c-88ad-240b562742be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:27.578335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ba19ee1-ab7d-479c-88ad-240b562742be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:27.578821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ba19ee1-ab7d-479c-88ad-240b562742be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:27.579249 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ba19ee1-ab7d-479c-88ad-240b562742be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:27.607740 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9ba19ee1-ab7d-479c-88ad-240b562742be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042490 Aug 08 08:56:27.608288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 741/1503] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:27 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:28.584698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7e559b4a-772f-454b-bfc6-59ba85754982 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:28.585441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7e559b4a-772f-454b-bfc6-59ba85754982 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:28.592275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e559b4a-772f-454b-bfc6-59ba85754982 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:28.592759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e559b4a-772f-454b-bfc6-59ba85754982 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:28.593286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e559b4a-772f-454b-bfc6-59ba85754982 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:28.593977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e559b4a-772f-454b-bfc6-59ba85754982 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:28.594433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e559b4a-772f-454b-bfc6-59ba85754982 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:28.594859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7e559b4a-772f-454b-bfc6-59ba85754982 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:28.656827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7e559b4a-772f-454b-bfc6-59ba85754982 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:28.664551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7e559b4a-772f-454b-bfc6-59ba85754982 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083928 Aug 08 08:56:28.665039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 742/1504] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:28 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:28.669710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9865623e-499d-4485-b3fc-fa57af586b1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:28.671801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9865623e-499d-4485-b3fc-fa57af586b1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:28.677298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9865623e-499d-4485-b3fc-fa57af586b1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:28.677778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9865623e-499d-4485-b3fc-fa57af586b1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:28.678207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9865623e-499d-4485-b3fc-fa57af586b1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:28.678881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9865623e-499d-4485-b3fc-fa57af586b1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:28.679328 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9865623e-499d-4485-b3fc-fa57af586b1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:28.680002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9865623e-499d-4485-b3fc-fa57af586b1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:28.708829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9865623e-499d-4485-b3fc-fa57af586b1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Aug 08 08:56:28.709387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 743/1505] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:28 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:29.686209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9c6f9034-af3e-4c6c-8fb1-9436269a4e9a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:29.686834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9c6f9034-af3e-4c6c-8fb1-9436269a4e9a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:29.693203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c6f9034-af3e-4c6c-8fb1-9436269a4e9a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:29.693693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c6f9034-af3e-4c6c-8fb1-9436269a4e9a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:29.694154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c6f9034-af3e-4c6c-8fb1-9436269a4e9a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:29.694880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c6f9034-af3e-4c6c-8fb1-9436269a4e9a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:29.695552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c6f9034-af3e-4c6c-8fb1-9436269a4e9a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:29.696129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c6f9034-af3e-4c6c-8fb1-9436269a4e9a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:29.761198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9c6f9034-af3e-4c6c-8fb1-9436269a4e9a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:29.768961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9c6f9034-af3e-4c6c-8fb1-9436269a4e9a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086711 Aug 08 08:56:29.769537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 744/1506] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:29 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:29.774713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-03c41323-1495-4b44-82b0-b60f7f1150f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:29.776805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-03c41323-1495-4b44-82b0-b60f7f1150f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:29.783626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03c41323-1495-4b44-82b0-b60f7f1150f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:29.784632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03c41323-1495-4b44-82b0-b60f7f1150f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:29.784632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03c41323-1495-4b44-82b0-b60f7f1150f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:29.785278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03c41323-1495-4b44-82b0-b60f7f1150f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:29.790415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03c41323-1495-4b44-82b0-b60f7f1150f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:29.790415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03c41323-1495-4b44-82b0-b60f7f1150f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:29.816329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-03c41323-1495-4b44-82b0-b60f7f1150f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045781 Aug 08 08:56:29.816875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 745/1507] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:29 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:30.791411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6b262b98-d878-415c-96a0-1f67a1821b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:30.792036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6b262b98-d878-415c-96a0-1f67a1821b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:30.798283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b262b98-d878-415c-96a0-1f67a1821b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:30.798793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b262b98-d878-415c-96a0-1f67a1821b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:30.799221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b262b98-d878-415c-96a0-1f67a1821b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:30.799897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b262b98-d878-415c-96a0-1f67a1821b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:30.800345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b262b98-d878-415c-96a0-1f67a1821b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:30.800765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b262b98-d878-415c-96a0-1f67a1821b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:30.903908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6b262b98-d878-415c-96a0-1f67a1821b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:30.911544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6b262b98-d878-415c-96a0-1f67a1821b1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.124523 Aug 08 08:56:30.912116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 746/1508] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:30 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:30.917318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1af46f93-b358-439a-bdf0-0ca6fed9f897 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:30.919438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1af46f93-b358-439a-bdf0-0ca6fed9f897 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:30.925072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1af46f93-b358-439a-bdf0-0ca6fed9f897 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:30.925594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1af46f93-b358-439a-bdf0-0ca6fed9f897 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:30.926035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1af46f93-b358-439a-bdf0-0ca6fed9f897 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:30.926731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1af46f93-b358-439a-bdf0-0ca6fed9f897 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:30.927189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1af46f93-b358-439a-bdf0-0ca6fed9f897 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:30.928493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1af46f93-b358-439a-bdf0-0ca6fed9f897 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:30.956550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1af46f93-b358-439a-bdf0-0ca6fed9f897 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Aug 08 08:56:30.957088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 747/1509] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:30 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:31.934299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-aa09cef4-1603-4d35-9933-8b77a9c56afe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:31.934927 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-aa09cef4-1603-4d35-9933-8b77a9c56afe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:31.941219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa09cef4-1603-4d35-9933-8b77a9c56afe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:31.941683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa09cef4-1603-4d35-9933-8b77a9c56afe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:31.942118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa09cef4-1603-4d35-9933-8b77a9c56afe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:31.942836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa09cef4-1603-4d35-9933-8b77a9c56afe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:31.943285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa09cef4-1603-4d35-9933-8b77a9c56afe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:31.943704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa09cef4-1603-4d35-9933-8b77a9c56afe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:32.006809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-aa09cef4-1603-4d35-9933-8b77a9c56afe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:32.014941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-aa09cef4-1603-4d35-9933-8b77a9c56afe tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084636 Aug 08 08:56:32.015495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 748/1510] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:31 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:32.019927 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-73505d2c-a039-45f0-a178-830925b9fe91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:32.022055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-73505d2c-a039-45f0-a178-830925b9fe91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:32.027534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73505d2c-a039-45f0-a178-830925b9fe91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:32.028013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73505d2c-a039-45f0-a178-830925b9fe91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:32.028453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73505d2c-a039-45f0-a178-830925b9fe91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:32.029138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73505d2c-a039-45f0-a178-830925b9fe91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:32.029674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73505d2c-a039-45f0-a178-830925b9fe91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:32.030103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73505d2c-a039-45f0-a178-830925b9fe91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:32.058269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-73505d2c-a039-45f0-a178-830925b9fe91 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 Aug 08 08:56:32.058752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 749/1511] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:33.038024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5593aa32-31ca-4bea-b9fa-15e76e8df848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:33.038718 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5593aa32-31ca-4bea-b9fa-15e76e8df848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:33.045043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5593aa32-31ca-4bea-b9fa-15e76e8df848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:33.045561 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5593aa32-31ca-4bea-b9fa-15e76e8df848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:33.046004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5593aa32-31ca-4bea-b9fa-15e76e8df848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:33.046692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5593aa32-31ca-4bea-b9fa-15e76e8df848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:33.047152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5593aa32-31ca-4bea-b9fa-15e76e8df848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:33.047578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5593aa32-31ca-4bea-b9fa-15e76e8df848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:33.051414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:33.107722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5593aa32-31ca-4bea-b9fa-15e76e8df848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:33.115431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5593aa32-31ca-4bea-b9fa-15e76e8df848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081324 Aug 08 08:56:33.115997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 750/1512] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:33 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:33.121170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f0752adc-d3ff-480b-8a0e-3854efbad991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:33.123313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f0752adc-d3ff-480b-8a0e-3854efbad991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:33.128906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0752adc-d3ff-480b-8a0e-3854efbad991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:33.129424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0752adc-d3ff-480b-8a0e-3854efbad991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:33.129863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0752adc-d3ff-480b-8a0e-3854efbad991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:33.130555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0752adc-d3ff-480b-8a0e-3854efbad991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:33.131009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0752adc-d3ff-480b-8a0e-3854efbad991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:33.131437 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0752adc-d3ff-480b-8a0e-3854efbad991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:33.160354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f0752adc-d3ff-480b-8a0e-3854efbad991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043370 Aug 08 08:56:33.160903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 751/1513] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:33 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:34.136407 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1e404a1c-3222-4868-bddd-bb26474a9cb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:34.137024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1e404a1c-3222-4868-bddd-bb26474a9cb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:34.143324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e404a1c-3222-4868-bddd-bb26474a9cb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:34.143798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e404a1c-3222-4868-bddd-bb26474a9cb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:34.144232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e404a1c-3222-4868-bddd-bb26474a9cb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:34.145015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e404a1c-3222-4868-bddd-bb26474a9cb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:34.145493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e404a1c-3222-4868-bddd-bb26474a9cb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:34.145916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e404a1c-3222-4868-bddd-bb26474a9cb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:34.208957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1e404a1c-3222-4868-bddd-bb26474a9cb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:34.217236 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1e404a1c-3222-4868-bddd-bb26474a9cb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085310 Aug 08 08:56:34.217793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 752/1514] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:34 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:34.222249 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1d87576e-d2a3-4dc9-81fe-55ff027ef4ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:34.224324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1d87576e-d2a3-4dc9-81fe-55ff027ef4ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:34.229936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1d87576e-d2a3-4dc9-81fe-55ff027ef4ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:34.230408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1d87576e-d2a3-4dc9-81fe-55ff027ef4ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:34.230839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1d87576e-d2a3-4dc9-81fe-55ff027ef4ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:34.231512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1d87576e-d2a3-4dc9-81fe-55ff027ef4ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:34.231960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1d87576e-d2a3-4dc9-81fe-55ff027ef4ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:34.232376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1d87576e-d2a3-4dc9-81fe-55ff027ef4ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:34.262747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1d87576e-d2a3-4dc9-81fe-55ff027ef4ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Aug 08 08:56:34.263282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 753/1515] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:35.238209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fa24e937-644e-49b3-b7ad-11642577377b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:35.238957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fa24e937-644e-49b3-b7ad-11642577377b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:35.245318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa24e937-644e-49b3-b7ad-11642577377b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:35.245797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa24e937-644e-49b3-b7ad-11642577377b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:35.246232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa24e937-644e-49b3-b7ad-11642577377b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:35.246913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa24e937-644e-49b3-b7ad-11642577377b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:35.247364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa24e937-644e-49b3-b7ad-11642577377b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:35.247784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fa24e937-644e-49b3-b7ad-11642577377b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:35.308620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fa24e937-644e-49b3-b7ad-11642577377b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:35.316134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fa24e937-644e-49b3-b7ad-11642577377b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082142 Aug 08 08:56:35.316687 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 754/1516] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:35 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:35.322049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3f9bac59-3f55-49a9-964d-393d515f957e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:35.324220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3f9bac59-3f55-49a9-964d-393d515f957e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:35.329844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9bac59-3f55-49a9-964d-393d515f957e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:35.330323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9bac59-3f55-49a9-964d-393d515f957e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:35.330754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9bac59-3f55-49a9-964d-393d515f957e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:35.331522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9bac59-3f55-49a9-964d-393d515f957e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:35.331971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9bac59-3f55-49a9-964d-393d515f957e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:35.332392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9bac59-3f55-49a9-964d-393d515f957e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:35.360458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3f9bac59-3f55-49a9-964d-393d515f957e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042347 Aug 08 08:56:35.360992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 755/1517] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:35 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:36.178556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=33 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:36.202263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=26 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:36.337279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-710e8e58-ab22-4746-98e7-7f25dabce063 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:36.337891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-710e8e58-ab22-4746-98e7-7f25dabce063 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:36.344265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-710e8e58-ab22-4746-98e7-7f25dabce063 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:36.344741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-710e8e58-ab22-4746-98e7-7f25dabce063 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:36.345200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-710e8e58-ab22-4746-98e7-7f25dabce063 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:36.345884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-710e8e58-ab22-4746-98e7-7f25dabce063 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:36.346332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-710e8e58-ab22-4746-98e7-7f25dabce063 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:36.346751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-710e8e58-ab22-4746-98e7-7f25dabce063 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:36.407685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-710e8e58-ab22-4746-98e7-7f25dabce063 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:36.416077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-710e8e58-ab22-4746-98e7-7f25dabce063 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082831 Aug 08 08:56:36.416668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 756/1518] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:36 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:36.421350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-32289bfe-00ed-4f47-8260-da971bb3d0cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:36.423401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-32289bfe-00ed-4f47-8260-da971bb3d0cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:36.429100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32289bfe-00ed-4f47-8260-da971bb3d0cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:36.429664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32289bfe-00ed-4f47-8260-da971bb3d0cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:36.430164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32289bfe-00ed-4f47-8260-da971bb3d0cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:36.430844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32289bfe-00ed-4f47-8260-da971bb3d0cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:36.431295 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32289bfe-00ed-4f47-8260-da971bb3d0cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:36.431714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32289bfe-00ed-4f47-8260-da971bb3d0cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:36.458882 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-32289bfe-00ed-4f47-8260-da971bb3d0cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041203 Aug 08 08:56:36.459418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 757/1519] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:37.436243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-49fdd542-d1b3-451c-b66b-ac8ce2c7f01b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:37.436926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-49fdd542-d1b3-451c-b66b-ac8ce2c7f01b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:37.443334 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49fdd542-d1b3-451c-b66b-ac8ce2c7f01b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:37.443814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49fdd542-d1b3-451c-b66b-ac8ce2c7f01b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:37.444250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49fdd542-d1b3-451c-b66b-ac8ce2c7f01b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:37.445696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49fdd542-d1b3-451c-b66b-ac8ce2c7f01b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:37.446223 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49fdd542-d1b3-451c-b66b-ac8ce2c7f01b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:37.446651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49fdd542-d1b3-451c-b66b-ac8ce2c7f01b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:37.506444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-49fdd542-d1b3-451c-b66b-ac8ce2c7f01b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:37.514470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-49fdd542-d1b3-451c-b66b-ac8ce2c7f01b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082053 Aug 08 08:56:37.515027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 758/1520] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:37 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:37.527702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8ea2bf2b-112f-41bf-b57e-83410bed5143 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:37.527702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8ea2bf2b-112f-41bf-b57e-83410bed5143 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:37.527702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=80 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:37.528143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ea2bf2b-112f-41bf-b57e-83410bed5143 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:37.528629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ea2bf2b-112f-41bf-b57e-83410bed5143 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:37.529067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ea2bf2b-112f-41bf-b57e-83410bed5143 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:37.529779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ea2bf2b-112f-41bf-b57e-83410bed5143 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:37.530273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ea2bf2b-112f-41bf-b57e-83410bed5143 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:37.530693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ea2bf2b-112f-41bf-b57e-83410bed5143 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:37.560125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8ea2bf2b-112f-41bf-b57e-83410bed5143 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044112 Aug 08 08:56:37.560664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 759/1521] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:37 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:38.534662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a533d69c-9e36-4c82-8d69-b30b39439c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:38.535307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a533d69c-9e36-4c82-8d69-b30b39439c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:38.542573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a533d69c-9e36-4c82-8d69-b30b39439c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:38.543065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a533d69c-9e36-4c82-8d69-b30b39439c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:38.543518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a533d69c-9e36-4c82-8d69-b30b39439c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:38.544207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a533d69c-9e36-4c82-8d69-b30b39439c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:38.544661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a533d69c-9e36-4c82-8d69-b30b39439c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:38.545122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a533d69c-9e36-4c82-8d69-b30b39439c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:38.608872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a533d69c-9e36-4c82-8d69-b30b39439c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:38.616747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a533d69c-9e36-4c82-8d69-b30b39439c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085888 Aug 08 08:56:38.620741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 760/1522] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:38 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:38.622444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6b3194e3-6d44-4a73-a258-6663dcf9f602 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:38.624547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6b3194e3-6d44-4a73-a258-6663dcf9f602 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:38.630236 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b3194e3-6d44-4a73-a258-6663dcf9f602 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:38.630716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b3194e3-6d44-4a73-a258-6663dcf9f602 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:38.631151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b3194e3-6d44-4a73-a258-6663dcf9f602 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:38.631838 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b3194e3-6d44-4a73-a258-6663dcf9f602 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:38.632294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b3194e3-6d44-4a73-a258-6663dcf9f602 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:38.632849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6b3194e3-6d44-4a73-a258-6663dcf9f602 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:38.663371 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6b3194e3-6d44-4a73-a258-6663dcf9f602 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044457 Aug 08 08:56:38.664718 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 761/1523] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:38 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:39.638867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a63783ad-6673-4c33-ae50-9b3fe8fcb458 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:39.639543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a63783ad-6673-4c33-ae50-9b3fe8fcb458 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:39.645892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a63783ad-6673-4c33-ae50-9b3fe8fcb458 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:39.646376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a63783ad-6673-4c33-ae50-9b3fe8fcb458 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:39.646813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a63783ad-6673-4c33-ae50-9b3fe8fcb458 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:39.647503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a63783ad-6673-4c33-ae50-9b3fe8fcb458 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:39.647979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a63783ad-6673-4c33-ae50-9b3fe8fcb458 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:39.648639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a63783ad-6673-4c33-ae50-9b3fe8fcb458 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:39.709682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a63783ad-6673-4c33-ae50-9b3fe8fcb458 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:39.717514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a63783ad-6673-4c33-ae50-9b3fe8fcb458 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082429 Aug 08 08:56:39.726191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 762/1524] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:39 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:39.726191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d8d12065-f4e8-42ba-adb0-a0e225186ba9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:39.726191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d8d12065-f4e8-42ba-adb0-a0e225186ba9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:39.730828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d12065-f4e8-42ba-adb0-a0e225186ba9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:39.731449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d12065-f4e8-42ba-adb0-a0e225186ba9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:39.731888 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d12065-f4e8-42ba-adb0-a0e225186ba9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:39.732580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d12065-f4e8-42ba-adb0-a0e225186ba9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:39.733032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d12065-f4e8-42ba-adb0-a0e225186ba9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:39.733514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d8d12065-f4e8-42ba-adb0-a0e225186ba9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:39.762704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d8d12065-f4e8-42ba-adb0-a0e225186ba9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043634 Aug 08 08:56:39.763257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 763/1525] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:39 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:40.740140 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b2d825ee-af4c-49ee-ab9d-f56fc6456f0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:40.740789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b2d825ee-af4c-49ee-ab9d-f56fc6456f0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:40.747203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2d825ee-af4c-49ee-ab9d-f56fc6456f0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:40.747678 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2d825ee-af4c-49ee-ab9d-f56fc6456f0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:40.748108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2d825ee-af4c-49ee-ab9d-f56fc6456f0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:40.748786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2d825ee-af4c-49ee-ab9d-f56fc6456f0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:40.749259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2d825ee-af4c-49ee-ab9d-f56fc6456f0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:40.749957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b2d825ee-af4c-49ee-ab9d-f56fc6456f0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:40.810749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b2d825ee-af4c-49ee-ab9d-f56fc6456f0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:40.818857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b2d825ee-af4c-49ee-ab9d-f56fc6456f0b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082134 Aug 08 08:56:40.818857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 764/1526] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:40 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:40.824060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0b6d7f38-8620-4029-b1b8-6d61ab2d7574 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:40.826211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0b6d7f38-8620-4029-b1b8-6d61ab2d7574 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:40.831809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b6d7f38-8620-4029-b1b8-6d61ab2d7574 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:40.832287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b6d7f38-8620-4029-b1b8-6d61ab2d7574 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:40.832719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b6d7f38-8620-4029-b1b8-6d61ab2d7574 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:40.833426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b6d7f38-8620-4029-b1b8-6d61ab2d7574 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:40.833877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b6d7f38-8620-4029-b1b8-6d61ab2d7574 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:40.834300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b6d7f38-8620-4029-b1b8-6d61ab2d7574 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:40.862249 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0b6d7f38-8620-4029-b1b8-6d61ab2d7574 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042207 Aug 08 08:56:40.862777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 765/1527] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:40 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:41.840599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bf8b987f-c0e5-4eaf-a3ff-674367bfd0e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:41.841387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bf8b987f-c0e5-4eaf-a3ff-674367bfd0e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:41.847850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf8b987f-c0e5-4eaf-a3ff-674367bfd0e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:41.848399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf8b987f-c0e5-4eaf-a3ff-674367bfd0e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:41.848989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf8b987f-c0e5-4eaf-a3ff-674367bfd0e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:41.849713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf8b987f-c0e5-4eaf-a3ff-674367bfd0e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:41.850168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf8b987f-c0e5-4eaf-a3ff-674367bfd0e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:41.850596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf8b987f-c0e5-4eaf-a3ff-674367bfd0e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:41.916050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bf8b987f-c0e5-4eaf-a3ff-674367bfd0e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:41.918469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:41.924786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bf8b987f-c0e5-4eaf-a3ff-674367bfd0e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.088456 Aug 08 08:56:41.925383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 766/1528] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:41 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:56:41.931801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4026d582-779a-403e-b8fa-5d261fc2a8c0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:41.933410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4026d582-779a-403e-b8fa-5d261fc2a8c0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:41.938939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4026d582-779a-403e-b8fa-5d261fc2a8c0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:41.939469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4026d582-779a-403e-b8fa-5d261fc2a8c0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:41.939900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4026d582-779a-403e-b8fa-5d261fc2a8c0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:41.940594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4026d582-779a-403e-b8fa-5d261fc2a8c0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:41.941045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4026d582-779a-403e-b8fa-5d261fc2a8c0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:41.941504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4026d582-779a-403e-b8fa-5d261fc2a8c0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:41.970737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4026d582-779a-403e-b8fa-5d261fc2a8c0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Aug 08 08:56:41.971509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 767/1529] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:41 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:42.946643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-18e02900-4f24-4fdf-858a-ea51189edbd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:42.947340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-18e02900-4f24-4fdf-858a-ea51189edbd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:42.953680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18e02900-4f24-4fdf-858a-ea51189edbd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:42.954175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18e02900-4f24-4fdf-858a-ea51189edbd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:42.954617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18e02900-4f24-4fdf-858a-ea51189edbd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:42.955312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18e02900-4f24-4fdf-858a-ea51189edbd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:42.955772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18e02900-4f24-4fdf-858a-ea51189edbd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:42.956202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-18e02900-4f24-4fdf-858a-ea51189edbd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:43.019705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-18e02900-4f24-4fdf-858a-ea51189edbd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:43.027218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-18e02900-4f24-4fdf-858a-ea51189edbd1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084465 Aug 08 08:56:43.027771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 768/1530] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:42 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:43.032220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-485a67e3-ae21-4ae2-a24a-a4cd89edd669 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:43.034380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-485a67e3-ae21-4ae2-a24a-a4cd89edd669 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:43.040390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-485a67e3-ae21-4ae2-a24a-a4cd89edd669 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:43.040881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-485a67e3-ae21-4ae2-a24a-a4cd89edd669 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:43.041347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-485a67e3-ae21-4ae2-a24a-a4cd89edd669 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:43.042040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-485a67e3-ae21-4ae2-a24a-a4cd89edd669 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:43.042497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-485a67e3-ae21-4ae2-a24a-a4cd89edd669 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:43.042926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-485a67e3-ae21-4ae2-a24a-a4cd89edd669 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:43.072731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-485a67e3-ae21-4ae2-a24a-a4cd89edd669 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043977 Aug 08 08:56:43.073294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 769/1531] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:44.047865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e1d37b25-62bf-45ea-ba1b-15803560aef0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:44.048501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e1d37b25-62bf-45ea-ba1b-15803560aef0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:44.055457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e1d37b25-62bf-45ea-ba1b-15803560aef0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:44.055941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e1d37b25-62bf-45ea-ba1b-15803560aef0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:44.056379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e1d37b25-62bf-45ea-ba1b-15803560aef0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:44.057069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e1d37b25-62bf-45ea-ba1b-15803560aef0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:44.057549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e1d37b25-62bf-45ea-ba1b-15803560aef0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:44.057976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e1d37b25-62bf-45ea-ba1b-15803560aef0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:44.118516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e1d37b25-62bf-45ea-ba1b-15803560aef0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:44.126040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e1d37b25-62bf-45ea-ba1b-15803560aef0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082139 Aug 08 08:56:44.126601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 770/1532] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:44 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:44.131051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0710700d-2e73-43eb-b8bb-fefd0e8766b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:44.133854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0710700d-2e73-43eb-b8bb-fefd0e8766b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:44.139635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0710700d-2e73-43eb-b8bb-fefd0e8766b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:44.140125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0710700d-2e73-43eb-b8bb-fefd0e8766b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:44.140569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0710700d-2e73-43eb-b8bb-fefd0e8766b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:44.141324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0710700d-2e73-43eb-b8bb-fefd0e8766b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:44.141787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0710700d-2e73-43eb-b8bb-fefd0e8766b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:44.142218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0710700d-2e73-43eb-b8bb-fefd0e8766b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:44.170499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0710700d-2e73-43eb-b8bb-fefd0e8766b0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042927 Aug 08 08:56:44.171048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 771/1533] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:44.987151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 08:56:44.987728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 08:56:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 (ip 10.222.0.33) !!! Aug 08 08:56:45.147529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-442ac61d-6dab-4f1f-8d78-0e79c746949d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:45.148736 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-442ac61d-6dab-4f1f-8d78-0e79c746949d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:45.155104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-442ac61d-6dab-4f1f-8d78-0e79c746949d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:45.155586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-442ac61d-6dab-4f1f-8d78-0e79c746949d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:45.156025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-442ac61d-6dab-4f1f-8d78-0e79c746949d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:45.156713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-442ac61d-6dab-4f1f-8d78-0e79c746949d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:45.157195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-442ac61d-6dab-4f1f-8d78-0e79c746949d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:45.157622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-442ac61d-6dab-4f1f-8d78-0e79c746949d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:45.218808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-442ac61d-6dab-4f1f-8d78-0e79c746949d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:45.226593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-442ac61d-6dab-4f1f-8d78-0e79c746949d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082534 Aug 08 08:56:45.227151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 772/1534] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:45 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:45.231587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5575677c-4da2-40ab-9a2b-3bdbdff55a3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:45.233751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5575677c-4da2-40ab-9a2b-3bdbdff55a3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:45.239552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5575677c-4da2-40ab-9a2b-3bdbdff55a3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:45.239977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5575677c-4da2-40ab-9a2b-3bdbdff55a3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:45.240414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5575677c-4da2-40ab-9a2b-3bdbdff55a3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:45.241098 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5575677c-4da2-40ab-9a2b-3bdbdff55a3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:45.241581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5575677c-4da2-40ab-9a2b-3bdbdff55a3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:45.242054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5575677c-4da2-40ab-9a2b-3bdbdff55a3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:45.269566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5575677c-4da2-40ab-9a2b-3bdbdff55a3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041404 Aug 08 08:56:45.270273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 773/1535] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:46.247574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4c1684f7-9615-4c5a-98f2-fe2532f6d977 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:46.248247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4c1684f7-9615-4c5a-98f2-fe2532f6d977 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:46.254580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c1684f7-9615-4c5a-98f2-fe2532f6d977 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:46.255066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c1684f7-9615-4c5a-98f2-fe2532f6d977 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:46.255501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c1684f7-9615-4c5a-98f2-fe2532f6d977 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:46.256187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c1684f7-9615-4c5a-98f2-fe2532f6d977 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:46.256641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c1684f7-9615-4c5a-98f2-fe2532f6d977 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:46.257064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4c1684f7-9615-4c5a-98f2-fe2532f6d977 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:46.317169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4c1684f7-9615-4c5a-98f2-fe2532f6d977 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:46.324972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4c1684f7-9615-4c5a-98f2-fe2532f6d977 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081276 Aug 08 08:56:46.325566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 774/1536] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:46 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:46.329994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4dba6e16-3349-4eb3-a228-8f82b2b47e65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:46.332097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4dba6e16-3349-4eb3-a228-8f82b2b47e65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:46.338286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4dba6e16-3349-4eb3-a228-8f82b2b47e65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:46.338763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4dba6e16-3349-4eb3-a228-8f82b2b47e65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:46.339197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4dba6e16-3349-4eb3-a228-8f82b2b47e65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:46.339882 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4dba6e16-3349-4eb3-a228-8f82b2b47e65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:46.340341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4dba6e16-3349-4eb3-a228-8f82b2b47e65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:46.340763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4dba6e16-3349-4eb3-a228-8f82b2b47e65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:46.369132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4dba6e16-3349-4eb3-a228-8f82b2b47e65 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042605 Aug 08 08:56:46.369686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 775/1537] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:46 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:47.345752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-33518c1a-d944-4151-9fca-a7320c08e7c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:47.346407 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-33518c1a-d944-4151-9fca-a7320c08e7c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:47.353508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33518c1a-d944-4151-9fca-a7320c08e7c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:47.353989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33518c1a-d944-4151-9fca-a7320c08e7c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:47.354423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33518c1a-d944-4151-9fca-a7320c08e7c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:47.355103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33518c1a-d944-4151-9fca-a7320c08e7c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:47.355554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33518c1a-d944-4151-9fca-a7320c08e7c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:47.355981 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33518c1a-d944-4151-9fca-a7320c08e7c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:47.419313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-33518c1a-d944-4151-9fca-a7320c08e7c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:47.426738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-33518c1a-d944-4151-9fca-a7320c08e7c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084766 Aug 08 08:56:47.427293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 776/1538] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:47 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:47.432804 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-203410fe-8835-40d0-869b-e448c6e16045 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:47.434921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-203410fe-8835-40d0-869b-e448c6e16045 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:47.440551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-203410fe-8835-40d0-869b-e448c6e16045 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:47.441038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-203410fe-8835-40d0-869b-e448c6e16045 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:47.441589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-203410fe-8835-40d0-869b-e448c6e16045 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:47.442279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-203410fe-8835-40d0-869b-e448c6e16045 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:47.442754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-203410fe-8835-40d0-869b-e448c6e16045 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:47.443168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-203410fe-8835-40d0-869b-e448c6e16045 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:47.472368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-203410fe-8835-40d0-869b-e448c6e16045 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Aug 08 08:56:47.472905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 777/1539] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:48.447595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a5d679ee-9436-4980-ba1f-c51a7cd3981f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:48.448183 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a5d679ee-9436-4980-ba1f-c51a7cd3981f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:48.454540 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5d679ee-9436-4980-ba1f-c51a7cd3981f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:48.455016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5d679ee-9436-4980-ba1f-c51a7cd3981f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:48.455449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5d679ee-9436-4980-ba1f-c51a7cd3981f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:48.456127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5d679ee-9436-4980-ba1f-c51a7cd3981f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:48.456575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5d679ee-9436-4980-ba1f-c51a7cd3981f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:48.457000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5d679ee-9436-4980-ba1f-c51a7cd3981f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:48.517627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a5d679ee-9436-4980-ba1f-c51a7cd3981f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:48.525654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a5d679ee-9436-4980-ba1f-c51a7cd3981f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081896 Aug 08 08:56:48.526207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 778/1540] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:48 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:48.530663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a5c2ce64-c898-4abd-a348-6a89f0438ebb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:48.532746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a5c2ce64-c898-4abd-a348-6a89f0438ebb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:48.538211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c2ce64-c898-4abd-a348-6a89f0438ebb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:48.539369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c2ce64-c898-4abd-a348-6a89f0438ebb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:48.539782 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c2ce64-c898-4abd-a348-6a89f0438ebb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:48.540462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c2ce64-c898-4abd-a348-6a89f0438ebb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:48.540911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c2ce64-c898-4abd-a348-6a89f0438ebb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:48.541360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a5c2ce64-c898-4abd-a348-6a89f0438ebb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:48.568053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a5c2ce64-c898-4abd-a348-6a89f0438ebb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040834 Aug 08 08:56:48.568583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 779/1541] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:48.570521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 08:56:48.570747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 08:56:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 08:56:49.546898 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5ea1d660-7c17-4808-81e5-276132a22f26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:49.547518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5ea1d660-7c17-4808-81e5-276132a22f26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:49.553986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ea1d660-7c17-4808-81e5-276132a22f26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:49.555224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ea1d660-7c17-4808-81e5-276132a22f26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:49.555672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ea1d660-7c17-4808-81e5-276132a22f26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:49.556371 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ea1d660-7c17-4808-81e5-276132a22f26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:49.556831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ea1d660-7c17-4808-81e5-276132a22f26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:49.557292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ea1d660-7c17-4808-81e5-276132a22f26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:49.619025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5ea1d660-7c17-4808-81e5-276132a22f26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:49.626431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5ea1d660-7c17-4808-81e5-276132a22f26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083463 Aug 08 08:56:49.626987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 780/1542] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:49 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:49.631390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8aba78a5-058d-4eab-82e5-56e92e8fc171 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:49.633581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8aba78a5-058d-4eab-82e5-56e92e8fc171 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:49.639083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8aba78a5-058d-4eab-82e5-56e92e8fc171 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:49.639563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8aba78a5-058d-4eab-82e5-56e92e8fc171 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:49.640004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8aba78a5-058d-4eab-82e5-56e92e8fc171 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:49.640686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8aba78a5-058d-4eab-82e5-56e92e8fc171 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:49.641159 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8aba78a5-058d-4eab-82e5-56e92e8fc171 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:49.641589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8aba78a5-058d-4eab-82e5-56e92e8fc171 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:49.670204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8aba78a5-058d-4eab-82e5-56e92e8fc171 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042205 Aug 08 08:56:49.670752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 781/1543] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:50.646994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ad1a87be-d016-454e-b035-478012555e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:50.647669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ad1a87be-d016-454e-b035-478012555e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:50.654029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad1a87be-d016-454e-b035-478012555e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:50.654512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad1a87be-d016-454e-b035-478012555e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:50.654954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad1a87be-d016-454e-b035-478012555e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:50.655642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad1a87be-d016-454e-b035-478012555e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:50.656116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad1a87be-d016-454e-b035-478012555e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:50.656524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad1a87be-d016-454e-b035-478012555e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:50.716657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ad1a87be-d016-454e-b035-478012555e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:50.724087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ad1a87be-d016-454e-b035-478012555e95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.080895 Aug 08 08:56:50.724650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 782/1544] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:50 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:50.729209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9ea918a1-2dc8-4c8f-9744-55ef23633c07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:50.731322 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9ea918a1-2dc8-4c8f-9744-55ef23633c07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:50.737059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea918a1-2dc8-4c8f-9744-55ef23633c07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:50.737590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea918a1-2dc8-4c8f-9744-55ef23633c07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:50.738029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea918a1-2dc8-4c8f-9744-55ef23633c07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:50.738717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea918a1-2dc8-4c8f-9744-55ef23633c07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:50.739172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea918a1-2dc8-4c8f-9744-55ef23633c07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:50.739599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ea918a1-2dc8-4c8f-9744-55ef23633c07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:50.753275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:56:50.768400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9ea918a1-2dc8-4c8f-9744-55ef23633c07 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042798 Aug 08 08:56:50.768941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 783/1545] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:50 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:51.746052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f7bbb306-f078-4ec2-9fa1-cd2d121c1c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:51.746722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f7bbb306-f078-4ec2-9fa1-cd2d121c1c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:51.753315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7bbb306-f078-4ec2-9fa1-cd2d121c1c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:51.753793 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7bbb306-f078-4ec2-9fa1-cd2d121c1c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:51.754230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7bbb306-f078-4ec2-9fa1-cd2d121c1c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:51.754906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7bbb306-f078-4ec2-9fa1-cd2d121c1c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:51.755356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7bbb306-f078-4ec2-9fa1-cd2d121c1c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:51.755777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7bbb306-f078-4ec2-9fa1-cd2d121c1c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:51.819597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f7bbb306-f078-4ec2-9fa1-cd2d121c1c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:51.827259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f7bbb306-f078-4ec2-9fa1-cd2d121c1c4e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085915 Aug 08 08:56:51.827812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 784/1546] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:51 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:51.832289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c72a8243-bb4d-4575-823f-d91067c85165 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:51.834389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c72a8243-bb4d-4575-823f-d91067c85165 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:51.840970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c72a8243-bb4d-4575-823f-d91067c85165 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:51.841518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c72a8243-bb4d-4575-823f-d91067c85165 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:51.841988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c72a8243-bb4d-4575-823f-d91067c85165 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:51.842692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c72a8243-bb4d-4575-823f-d91067c85165 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:51.843149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c72a8243-bb4d-4575-823f-d91067c85165 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:51.843604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c72a8243-bb4d-4575-823f-d91067c85165 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:51.873090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c72a8243-bb4d-4575-823f-d91067c85165 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Aug 08 08:56:51.873665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 785/1547] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:51 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:52.848323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0739d8e2-cd98-4003-b78f-8bbfb7c60352 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:52.848994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0739d8e2-cd98-4003-b78f-8bbfb7c60352 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:52.855676 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0739d8e2-cd98-4003-b78f-8bbfb7c60352 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:52.856194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0739d8e2-cd98-4003-b78f-8bbfb7c60352 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:52.856633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0739d8e2-cd98-4003-b78f-8bbfb7c60352 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:52.857362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0739d8e2-cd98-4003-b78f-8bbfb7c60352 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:52.857822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0739d8e2-cd98-4003-b78f-8bbfb7c60352 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:52.858255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0739d8e2-cd98-4003-b78f-8bbfb7c60352 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:52.928634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0739d8e2-cd98-4003-b78f-8bbfb7c60352 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:52.936732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0739d8e2-cd98-4003-b78f-8bbfb7c60352 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.092201 Aug 08 08:56:52.937321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 786/1548] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:52 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:52.941912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ec7fa458-836b-4a66-9e2b-5ddcff939bfb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:52.944070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ec7fa458-836b-4a66-9e2b-5ddcff939bfb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:52.950476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec7fa458-836b-4a66-9e2b-5ddcff939bfb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:52.950973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec7fa458-836b-4a66-9e2b-5ddcff939bfb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:52.951410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec7fa458-836b-4a66-9e2b-5ddcff939bfb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:52.952112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec7fa458-836b-4a66-9e2b-5ddcff939bfb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:52.952566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec7fa458-836b-4a66-9e2b-5ddcff939bfb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:52.952995 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec7fa458-836b-4a66-9e2b-5ddcff939bfb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:52.981583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ec7fa458-836b-4a66-9e2b-5ddcff939bfb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043181 Aug 08 08:56:52.982141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 787/1549] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:52 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:53.957983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e605b937-cb09-4516-98c8-83524a7fbd07 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:53.958695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e605b937-cb09-4516-98c8-83524a7fbd07 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:53.965214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e605b937-cb09-4516-98c8-83524a7fbd07 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:53.965697 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e605b937-cb09-4516-98c8-83524a7fbd07 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:53.966131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e605b937-cb09-4516-98c8-83524a7fbd07 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:53.966818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e605b937-cb09-4516-98c8-83524a7fbd07 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:53.967266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e605b937-cb09-4516-98c8-83524a7fbd07 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:53.967764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e605b937-cb09-4516-98c8-83524a7fbd07 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:54.029513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e605b937-cb09-4516-98c8-83524a7fbd07 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:54.037020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e605b937-cb09-4516-98c8-83524a7fbd07 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082982 Aug 08 08:56:54.037615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 788/1550] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:53 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:54.042738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-64eb897e-5235-465f-8aa8-3119856c16fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:54.044855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-64eb897e-5235-465f-8aa8-3119856c16fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:54.050824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64eb897e-5235-465f-8aa8-3119856c16fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:54.051308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64eb897e-5235-465f-8aa8-3119856c16fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:54.051746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64eb897e-5235-465f-8aa8-3119856c16fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:54.052435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64eb897e-5235-465f-8aa8-3119856c16fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:54.052891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64eb897e-5235-465f-8aa8-3119856c16fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:54.053363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-64eb897e-5235-465f-8aa8-3119856c16fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:54.082349 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-64eb897e-5235-465f-8aa8-3119856c16fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043736 Aug 08 08:56:54.082901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 789/1551] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:54 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:55.058876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4cce8635-76b6-467d-8ff0-e4b74e57a87f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:55.059559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4cce8635-76b6-467d-8ff0-e4b74e57a87f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:55.065808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cce8635-76b6-467d-8ff0-e4b74e57a87f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:55.066287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cce8635-76b6-467d-8ff0-e4b74e57a87f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:55.066725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cce8635-76b6-467d-8ff0-e4b74e57a87f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:55.067404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cce8635-76b6-467d-8ff0-e4b74e57a87f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:55.067855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cce8635-76b6-467d-8ff0-e4b74e57a87f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:55.068275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cce8635-76b6-467d-8ff0-e4b74e57a87f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:55.130639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4cce8635-76b6-467d-8ff0-e4b74e57a87f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:55.138194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4cce8635-76b6-467d-8ff0-e4b74e57a87f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083259 Aug 08 08:56:55.138751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 790/1552] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:55 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:55.143547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d773a37d-abf9-497f-887e-5cc2bc9725fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:55.145679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d773a37d-abf9-497f-887e-5cc2bc9725fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:55.151961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773a37d-abf9-497f-887e-5cc2bc9725fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:55.152440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773a37d-abf9-497f-887e-5cc2bc9725fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:55.152876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773a37d-abf9-497f-887e-5cc2bc9725fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:55.153593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773a37d-abf9-497f-887e-5cc2bc9725fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:55.154049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773a37d-abf9-497f-887e-5cc2bc9725fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:55.154471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d773a37d-abf9-497f-887e-5cc2bc9725fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:55.182901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d773a37d-abf9-497f-887e-5cc2bc9725fa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043116 Aug 08 08:56:55.183529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 791/1553] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:56.159151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-519cd099-e535-43fb-8bcb-7c5c2dd82b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:56.159829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-519cd099-e535-43fb-8bcb-7c5c2dd82b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:56.166254 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-519cd099-e535-43fb-8bcb-7c5c2dd82b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:56.166728 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-519cd099-e535-43fb-8bcb-7c5c2dd82b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:56.167159 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-519cd099-e535-43fb-8bcb-7c5c2dd82b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:56.167838 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-519cd099-e535-43fb-8bcb-7c5c2dd82b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:56.168287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-519cd099-e535-43fb-8bcb-7c5c2dd82b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:56.168715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-519cd099-e535-43fb-8bcb-7c5c2dd82b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:56.234519 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-519cd099-e535-43fb-8bcb-7c5c2dd82b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:56.243016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-519cd099-e535-43fb-8bcb-7c5c2dd82b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.087683 Aug 08 08:56:56.243590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 792/1554] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:56 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:56.248102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-11e221d4-1089-4e74-8173-e327e16560fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:56.250236 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-11e221d4-1089-4e74-8173-e327e16560fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:56.255749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11e221d4-1089-4e74-8173-e327e16560fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:56.256225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11e221d4-1089-4e74-8173-e327e16560fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:56.256660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11e221d4-1089-4e74-8173-e327e16560fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:56.258031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11e221d4-1089-4e74-8173-e327e16560fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:56.258494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11e221d4-1089-4e74-8173-e327e16560fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:56.258897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11e221d4-1089-4e74-8173-e327e16560fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:56.286279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-11e221d4-1089-4e74-8173-e327e16560fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041732 Aug 08 08:56:56.286806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 793/1555] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:57.264234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e7a1ce5b-0c7a-4963-90a1-d3309a11bf0c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:57.264929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e7a1ce5b-0c7a-4963-90a1-d3309a11bf0c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:57.271308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a1ce5b-0c7a-4963-90a1-d3309a11bf0c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:57.271786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a1ce5b-0c7a-4963-90a1-d3309a11bf0c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:57.272218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a1ce5b-0c7a-4963-90a1-d3309a11bf0c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:57.273688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a1ce5b-0c7a-4963-90a1-d3309a11bf0c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:57.274141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a1ce5b-0c7a-4963-90a1-d3309a11bf0c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:57.274566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a1ce5b-0c7a-4963-90a1-d3309a11bf0c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:57.339921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e7a1ce5b-0c7a-4963-90a1-d3309a11bf0c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:57.347277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e7a1ce5b-0c7a-4963-90a1-d3309a11bf0c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.087039 Aug 08 08:56:57.350042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 794/1556] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:57 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:57.352380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-09ff5eff-5f01-4cc5-b065-895548599fe8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:57.354490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-09ff5eff-5f01-4cc5-b065-895548599fe8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:57.360029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09ff5eff-5f01-4cc5-b065-895548599fe8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:57.360760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09ff5eff-5f01-4cc5-b065-895548599fe8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:57.361278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09ff5eff-5f01-4cc5-b065-895548599fe8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:57.362020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09ff5eff-5f01-4cc5-b065-895548599fe8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:57.362469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09ff5eff-5f01-4cc5-b065-895548599fe8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:57.362895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-09ff5eff-5f01-4cc5-b065-895548599fe8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:57.392303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-09ff5eff-5f01-4cc5-b065-895548599fe8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Aug 08 08:56:57.392835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 795/1557] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:57 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:58.368113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4f2b36e3-1a78-489e-bb86-7d2e35020545 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:58.368811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4f2b36e3-1a78-489e-bb86-7d2e35020545 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:58.375041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f2b36e3-1a78-489e-bb86-7d2e35020545 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:58.375524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f2b36e3-1a78-489e-bb86-7d2e35020545 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:58.375988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f2b36e3-1a78-489e-bb86-7d2e35020545 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:58.376672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f2b36e3-1a78-489e-bb86-7d2e35020545 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:58.377128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f2b36e3-1a78-489e-bb86-7d2e35020545 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:58.377582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4f2b36e3-1a78-489e-bb86-7d2e35020545 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:58.438122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4f2b36e3-1a78-489e-bb86-7d2e35020545 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:58.446305 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4f2b36e3-1a78-489e-bb86-7d2e35020545 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082538 Aug 08 08:56:58.446863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 796/1558] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:58 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:58.451358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-90bbce43-5852-4df2-9b56-c307ea1b67cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:58.453482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-90bbce43-5852-4df2-9b56-c307ea1b67cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:58.458996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90bbce43-5852-4df2-9b56-c307ea1b67cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:58.459482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90bbce43-5852-4df2-9b56-c307ea1b67cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:58.459931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90bbce43-5852-4df2-9b56-c307ea1b67cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:58.460620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90bbce43-5852-4df2-9b56-c307ea1b67cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:58.461077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90bbce43-5852-4df2-9b56-c307ea1b67cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:58.461528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-90bbce43-5852-4df2-9b56-c307ea1b67cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:58.488692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-90bbce43-5852-4df2-9b56-c307ea1b67cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040844 Aug 08 08:56:58.489253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 797/1559] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:56:59.466642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-48d685ce-e3b6-42eb-8a6b-7a7731e81bbc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:59.467244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-48d685ce-e3b6-42eb-8a6b-7a7731e81bbc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:59.473690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d685ce-e3b6-42eb-8a6b-7a7731e81bbc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:59.474172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d685ce-e3b6-42eb-8a6b-7a7731e81bbc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:59.474608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d685ce-e3b6-42eb-8a6b-7a7731e81bbc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:59.475296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d685ce-e3b6-42eb-8a6b-7a7731e81bbc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:59.476325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d685ce-e3b6-42eb-8a6b-7a7731e81bbc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:59.476950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d685ce-e3b6-42eb-8a6b-7a7731e81bbc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:59.537315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-48d685ce-e3b6-42eb-8a6b-7a7731e81bbc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:56:59.545370 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-48d685ce-e3b6-42eb-8a6b-7a7731e81bbc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082570 Aug 08 08:56:59.545923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 798/1560] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:56:59 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:56:59.550374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-85bd1309-fcc0-4058-8f2a-e6b364befc5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:56:59.552481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-85bd1309-fcc0-4058-8f2a-e6b364befc5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:56:59.558676 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85bd1309-fcc0-4058-8f2a-e6b364befc5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:59.559157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85bd1309-fcc0-4058-8f2a-e6b364befc5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:59.559592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85bd1309-fcc0-4058-8f2a-e6b364befc5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:59.560280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85bd1309-fcc0-4058-8f2a-e6b364befc5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:56:59.560738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85bd1309-fcc0-4058-8f2a-e6b364befc5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:56:59.561181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85bd1309-fcc0-4058-8f2a-e6b364befc5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:56:59.588219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-85bd1309-fcc0-4058-8f2a-e6b364befc5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041306 Aug 08 08:56:59.588772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 799/1561] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:56:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:00.566271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-da708f32-49df-4db1-a266-b336f61dabf2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:00.566910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-da708f32-49df-4db1-a266-b336f61dabf2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:00.573878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da708f32-49df-4db1-a266-b336f61dabf2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:00.574359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da708f32-49df-4db1-a266-b336f61dabf2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:00.574795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da708f32-49df-4db1-a266-b336f61dabf2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:00.575482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da708f32-49df-4db1-a266-b336f61dabf2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:00.575936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da708f32-49df-4db1-a266-b336f61dabf2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:00.576361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da708f32-49df-4db1-a266-b336f61dabf2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:00.578866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:57:00.640641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-da708f32-49df-4db1-a266-b336f61dabf2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:00.648099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-da708f32-49df-4db1-a266-b336f61dabf2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085756 Aug 08 08:57:00.648658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 800/1562] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:00 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:00.653093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ebe92ffe-d213-4a57-ae38-8da7e12963d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:00.655206 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ebe92ffe-d213-4a57-ae38-8da7e12963d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:00.660751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe92ffe-d213-4a57-ae38-8da7e12963d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:00.661274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe92ffe-d213-4a57-ae38-8da7e12963d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:00.661711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe92ffe-d213-4a57-ae38-8da7e12963d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:00.662399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe92ffe-d213-4a57-ae38-8da7e12963d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:00.662859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe92ffe-d213-4a57-ae38-8da7e12963d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:00.663310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe92ffe-d213-4a57-ae38-8da7e12963d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:00.691029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ebe92ffe-d213-4a57-ae38-8da7e12963d5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 Aug 08 08:57:00.691505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 801/1563] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:00 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:01.668558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-53ea8840-47db-422e-b6c2-038c90a369c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:01.669214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-53ea8840-47db-422e-b6c2-038c90a369c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:01.675434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ea8840-47db-422e-b6c2-038c90a369c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:01.675915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ea8840-47db-422e-b6c2-038c90a369c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:01.676353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ea8840-47db-422e-b6c2-038c90a369c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:01.677039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ea8840-47db-422e-b6c2-038c90a369c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:01.677520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ea8840-47db-422e-b6c2-038c90a369c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:01.677943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ea8840-47db-422e-b6c2-038c90a369c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:01.738598 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-53ea8840-47db-422e-b6c2-038c90a369c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:01.746727 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-53ea8840-47db-422e-b6c2-038c90a369c7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082082 Aug 08 08:57:01.747288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 802/1564] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:01 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:01.751747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a36c11a3-278b-4d95-9613-dd657093aa83 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:01.753867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a36c11a3-278b-4d95-9613-dd657093aa83 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:01.760022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36c11a3-278b-4d95-9613-dd657093aa83 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:01.760507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36c11a3-278b-4d95-9613-dd657093aa83 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:01.760948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36c11a3-278b-4d95-9613-dd657093aa83 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:01.761670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36c11a3-278b-4d95-9613-dd657093aa83 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:01.762126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36c11a3-278b-4d95-9613-dd657093aa83 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:01.762552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36c11a3-278b-4d95-9613-dd657093aa83 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:01.791942 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a36c11a3-278b-4d95-9613-dd657093aa83 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Aug 08 08:57:01.792476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 803/1565] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:01 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:02.767929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fbe64042-9c66-40b6-aaa2-054a3ee86899 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:02.768562 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fbe64042-9c66-40b6-aaa2-054a3ee86899 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:02.776220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbe64042-9c66-40b6-aaa2-054a3ee86899 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:02.776711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbe64042-9c66-40b6-aaa2-054a3ee86899 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:02.777178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbe64042-9c66-40b6-aaa2-054a3ee86899 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:02.777871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbe64042-9c66-40b6-aaa2-054a3ee86899 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:02.778330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbe64042-9c66-40b6-aaa2-054a3ee86899 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:02.778760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbe64042-9c66-40b6-aaa2-054a3ee86899 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:02.802301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 08:57:02.804510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 08:57:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d (ip 10.222.0.33) !!! Aug 08 08:57:02.840451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fbe64042-9c66-40b6-aaa2-054a3ee86899 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:02.847887 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fbe64042-9c66-40b6-aaa2-054a3ee86899 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083997 Aug 08 08:57:02.848443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 804/1566] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:02 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:02.853468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6da1bdea-db04-4257-8741-3c4d5649033c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:02.855563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6da1bdea-db04-4257-8741-3c4d5649033c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:02.861347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6da1bdea-db04-4257-8741-3c4d5649033c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:02.861828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6da1bdea-db04-4257-8741-3c4d5649033c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:02.862256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6da1bdea-db04-4257-8741-3c4d5649033c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:02.862931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6da1bdea-db04-4257-8741-3c4d5649033c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:02.863378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6da1bdea-db04-4257-8741-3c4d5649033c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:02.863799 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6da1bdea-db04-4257-8741-3c4d5649033c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:02.891273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6da1bdea-db04-4257-8741-3c4d5649033c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041877 Aug 08 08:57:02.891809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 805/1567] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:02 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:03.869659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-02da4d6f-1458-4634-8af7-fc73b7b7ae4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:03.870266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-02da4d6f-1458-4634-8af7-fc73b7b7ae4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:03.876659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02da4d6f-1458-4634-8af7-fc73b7b7ae4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:03.877135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02da4d6f-1458-4634-8af7-fc73b7b7ae4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:03.877597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02da4d6f-1458-4634-8af7-fc73b7b7ae4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:03.878278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02da4d6f-1458-4634-8af7-fc73b7b7ae4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:03.878839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02da4d6f-1458-4634-8af7-fc73b7b7ae4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:03.879260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02da4d6f-1458-4634-8af7-fc73b7b7ae4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:03.941014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-02da4d6f-1458-4634-8af7-fc73b7b7ae4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:03.948856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-02da4d6f-1458-4634-8af7-fc73b7b7ae4b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083637 Aug 08 08:57:03.949450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 806/1568] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:03 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:03.953948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3c82bfc0-143b-47e8-994d-7e738cefa638 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:03.956029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3c82bfc0-143b-47e8-994d-7e738cefa638 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:03.961919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c82bfc0-143b-47e8-994d-7e738cefa638 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:03.962403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c82bfc0-143b-47e8-994d-7e738cefa638 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:03.962832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c82bfc0-143b-47e8-994d-7e738cefa638 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:03.963515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c82bfc0-143b-47e8-994d-7e738cefa638 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:03.963963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c82bfc0-143b-47e8-994d-7e738cefa638 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:03.964387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c82bfc0-143b-47e8-994d-7e738cefa638 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:03.994123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3c82bfc0-143b-47e8-994d-7e738cefa638 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 Aug 08 08:57:03.994668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 807/1569] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:04.968771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1e3ce91f-eade-4986-b2e9-e20653db7243 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:04.969463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1e3ce91f-eade-4986-b2e9-e20653db7243 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:04.975941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e3ce91f-eade-4986-b2e9-e20653db7243 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:04.976448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e3ce91f-eade-4986-b2e9-e20653db7243 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:04.976883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e3ce91f-eade-4986-b2e9-e20653db7243 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:04.977657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e3ce91f-eade-4986-b2e9-e20653db7243 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:04.978112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e3ce91f-eade-4986-b2e9-e20653db7243 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:04.978533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e3ce91f-eade-4986-b2e9-e20653db7243 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:05.043462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1e3ce91f-eade-4986-b2e9-e20653db7243 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:05.050864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1e3ce91f-eade-4986-b2e9-e20653db7243 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.085857 Aug 08 08:57:05.051586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 808/1570] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:04 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:05.056750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-84bc0dc0-c082-4ded-aff6-8a150847a176 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:05.059034 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-84bc0dc0-c082-4ded-aff6-8a150847a176 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:05.060652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:57:05.065298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84bc0dc0-c082-4ded-aff6-8a150847a176 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:05.065775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84bc0dc0-c082-4ded-aff6-8a150847a176 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:05.066207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84bc0dc0-c082-4ded-aff6-8a150847a176 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:05.066886 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84bc0dc0-c082-4ded-aff6-8a150847a176 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:05.067405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84bc0dc0-c082-4ded-aff6-8a150847a176 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:05.067821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84bc0dc0-c082-4ded-aff6-8a150847a176 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:05.096397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-84bc0dc0-c082-4ded-aff6-8a150847a176 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043692 Aug 08 08:57:05.096937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 809/1571] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:05 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:06.072385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7ad75623-2174-4227-a905-06f13768e72c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:06.073033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7ad75623-2174-4227-a905-06f13768e72c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:06.079237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ad75623-2174-4227-a905-06f13768e72c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:06.079715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ad75623-2174-4227-a905-06f13768e72c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:06.080150 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ad75623-2174-4227-a905-06f13768e72c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:06.080836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ad75623-2174-4227-a905-06f13768e72c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:06.081320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ad75623-2174-4227-a905-06f13768e72c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:06.081742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ad75623-2174-4227-a905-06f13768e72c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:06.144313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7ad75623-2174-4227-a905-06f13768e72c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:06.152387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7ad75623-2174-4227-a905-06f13768e72c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084435 Aug 08 08:57:06.153210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 810/1572] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:06 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:06.157841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-477936c5-406b-48e0-a439-a9f36ffb81be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:06.160610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-477936c5-406b-48e0-a439-a9f36ffb81be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:06.167871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-477936c5-406b-48e0-a439-a9f36ffb81be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:06.168346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-477936c5-406b-48e0-a439-a9f36ffb81be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:06.168776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-477936c5-406b-48e0-a439-a9f36ffb81be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:06.169482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-477936c5-406b-48e0-a439-a9f36ffb81be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:06.169936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-477936c5-406b-48e0-a439-a9f36ffb81be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:06.170356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-477936c5-406b-48e0-a439-a9f36ffb81be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:06.199689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-477936c5-406b-48e0-a439-a9f36ffb81be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Aug 08 08:57:06.200226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 811/1573] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:06 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:07.172960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-de026f24-eae0-4a20-8073-aec61780db20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:07.173684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-de026f24-eae0-4a20-8073-aec61780db20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:07.180316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de026f24-eae0-4a20-8073-aec61780db20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:07.180790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de026f24-eae0-4a20-8073-aec61780db20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:07.181250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de026f24-eae0-4a20-8073-aec61780db20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:07.181935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de026f24-eae0-4a20-8073-aec61780db20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:07.182424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de026f24-eae0-4a20-8073-aec61780db20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:07.182845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de026f24-eae0-4a20-8073-aec61780db20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:07.244073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-de026f24-eae0-4a20-8073-aec61780db20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:07.251733 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-de026f24-eae0-4a20-8073-aec61780db20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082787 Aug 08 08:57:07.252294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 812/1574] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:07 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:07.256827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b601c9dc-0c1d-4614-ac07-8d00524e2568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:07.259082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b601c9dc-0c1d-4614-ac07-8d00524e2568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:07.264890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b601c9dc-0c1d-4614-ac07-8d00524e2568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:07.265413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b601c9dc-0c1d-4614-ac07-8d00524e2568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:07.265852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b601c9dc-0c1d-4614-ac07-8d00524e2568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:07.266540 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b601c9dc-0c1d-4614-ac07-8d00524e2568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:07.267023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b601c9dc-0c1d-4614-ac07-8d00524e2568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:07.267452 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b601c9dc-0c1d-4614-ac07-8d00524e2568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:07.296267 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b601c9dc-0c1d-4614-ac07-8d00524e2568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042994 Aug 08 08:57:07.296809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 813/1575] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:07 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:08.272874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-00dfc3a3-d4a5-4814-bf17-7a9015ca4055 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:08.273610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-00dfc3a3-d4a5-4814-bf17-7a9015ca4055 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:08.279878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-00dfc3a3-d4a5-4814-bf17-7a9015ca4055 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:08.280360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-00dfc3a3-d4a5-4814-bf17-7a9015ca4055 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:08.280798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-00dfc3a3-d4a5-4814-bf17-7a9015ca4055 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:08.281521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-00dfc3a3-d4a5-4814-bf17-7a9015ca4055 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:08.281977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-00dfc3a3-d4a5-4814-bf17-7a9015ca4055 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:08.282401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-00dfc3a3-d4a5-4814-bf17-7a9015ca4055 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:08.342500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-00dfc3a3-d4a5-4814-bf17-7a9015ca4055 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:08.349936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-00dfc3a3-d4a5-4814-bf17-7a9015ca4055 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081581 Aug 08 08:57:08.350525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 814/1576] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:08 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:08.354939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3c4852ba-04a3-4f16-949b-fb67a8d85f0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:08.357026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3c4852ba-04a3-4f16-949b-fb67a8d85f0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:08.362745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4852ba-04a3-4f16-949b-fb67a8d85f0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:08.363229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4852ba-04a3-4f16-949b-fb67a8d85f0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:08.363661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4852ba-04a3-4f16-949b-fb67a8d85f0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:08.364348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4852ba-04a3-4f16-949b-fb67a8d85f0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:08.364801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4852ba-04a3-4f16-949b-fb67a8d85f0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:08.365252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c4852ba-04a3-4f16-949b-fb67a8d85f0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:08.392864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3c4852ba-04a3-4f16-949b-fb67a8d85f0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041379 Aug 08 08:57:08.393436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 815/1577] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:08 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:09.371199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2dc61425-ea0a-46df-8e8a-22dd78d79a73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:09.371900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2dc61425-ea0a-46df-8e8a-22dd78d79a73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:09.378128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2dc61425-ea0a-46df-8e8a-22dd78d79a73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:09.378603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2dc61425-ea0a-46df-8e8a-22dd78d79a73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:09.379034 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2dc61425-ea0a-46df-8e8a-22dd78d79a73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:09.379712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2dc61425-ea0a-46df-8e8a-22dd78d79a73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:09.380163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2dc61425-ea0a-46df-8e8a-22dd78d79a73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:09.380591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2dc61425-ea0a-46df-8e8a-22dd78d79a73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:09.444785 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2dc61425-ea0a-46df-8e8a-22dd78d79a73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:09.446960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:57:09.453584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2dc61425-ea0a-46df-8e8a-22dd78d79a73 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086156 Aug 08 08:57:09.454398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 816/1578] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:09 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:09.459065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f5670810-2139-418a-81e2-044fed443689 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:09.461227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f5670810-2139-418a-81e2-044fed443689 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:09.467214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5670810-2139-418a-81e2-044fed443689 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:09.467732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5670810-2139-418a-81e2-044fed443689 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:09.468171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5670810-2139-418a-81e2-044fed443689 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:09.468864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5670810-2139-418a-81e2-044fed443689 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:09.469352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5670810-2139-418a-81e2-044fed443689 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:09.469778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5670810-2139-418a-81e2-044fed443689 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:09.498604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f5670810-2139-418a-81e2-044fed443689 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043197 Aug 08 08:57:09.499144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 817/1579] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:10.474864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f9e78945-4df8-4f50-ad1c-6bc9ccdd3b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:10.475504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f9e78945-4df8-4f50-ad1c-6bc9ccdd3b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:10.482143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9e78945-4df8-4f50-ad1c-6bc9ccdd3b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:10.482627 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9e78945-4df8-4f50-ad1c-6bc9ccdd3b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:10.483065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9e78945-4df8-4f50-ad1c-6bc9ccdd3b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:10.483761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9e78945-4df8-4f50-ad1c-6bc9ccdd3b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:10.484213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9e78945-4df8-4f50-ad1c-6bc9ccdd3b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:10.484637 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9e78945-4df8-4f50-ad1c-6bc9ccdd3b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:10.548688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f9e78945-4df8-4f50-ad1c-6bc9ccdd3b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:10.557013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f9e78945-4df8-4f50-ad1c-6bc9ccdd3b40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086145 Aug 08 08:57:10.557600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 818/1580] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:10 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:10.562237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cd950901-c6b0-46cc-8d41-6e14ead4131f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:10.564329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cd950901-c6b0-46cc-8d41-6e14ead4131f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:10.571299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cd950901-c6b0-46cc-8d41-6e14ead4131f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:10.571783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cd950901-c6b0-46cc-8d41-6e14ead4131f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:10.572216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cd950901-c6b0-46cc-8d41-6e14ead4131f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:10.572906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cd950901-c6b0-46cc-8d41-6e14ead4131f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:10.573383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cd950901-c6b0-46cc-8d41-6e14ead4131f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:10.573805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cd950901-c6b0-46cc-8d41-6e14ead4131f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:10.606942 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cd950901-c6b0-46cc-8d41-6e14ead4131f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048090 Aug 08 08:57:10.607418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 819/1581] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:10 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:11.577864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-707766e7-3a57-40ec-ad2e-39f558e10728 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:11.578528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-707766e7-3a57-40ec-ad2e-39f558e10728 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:11.584934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707766e7-3a57-40ec-ad2e-39f558e10728 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:11.586187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707766e7-3a57-40ec-ad2e-39f558e10728 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:11.586187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707766e7-3a57-40ec-ad2e-39f558e10728 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:11.586587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707766e7-3a57-40ec-ad2e-39f558e10728 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:11.587037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707766e7-3a57-40ec-ad2e-39f558e10728 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:11.587460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707766e7-3a57-40ec-ad2e-39f558e10728 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:11.649321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-707766e7-3a57-40ec-ad2e-39f558e10728 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:11.656899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-707766e7-3a57-40ec-ad2e-39f558e10728 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082898 Aug 08 08:57:11.660796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 820/1582] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:11 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:11.662104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-37de6fde-c47b-4aca-a2c2-5b779f647a0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:11.664819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-37de6fde-c47b-4aca-a2c2-5b779f647a0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:11.670543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37de6fde-c47b-4aca-a2c2-5b779f647a0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:11.670966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37de6fde-c47b-4aca-a2c2-5b779f647a0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:11.671398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37de6fde-c47b-4aca-a2c2-5b779f647a0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:11.672083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37de6fde-c47b-4aca-a2c2-5b779f647a0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:11.672535 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37de6fde-c47b-4aca-a2c2-5b779f647a0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:11.672960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37de6fde-c47b-4aca-a2c2-5b779f647a0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:11.700393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-37de6fde-c47b-4aca-a2c2-5b779f647a0c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041871 Aug 08 08:57:11.700925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 821/1583] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:11 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:12.678200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f4da6bda-e536-4723-a676-169461a1a940 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:12.679372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f4da6bda-e536-4723-a676-169461a1a940 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:12.685682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4da6bda-e536-4723-a676-169461a1a940 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:12.686157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4da6bda-e536-4723-a676-169461a1a940 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:12.686586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4da6bda-e536-4723-a676-169461a1a940 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:12.687263 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4da6bda-e536-4723-a676-169461a1a940 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:12.687710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4da6bda-e536-4723-a676-169461a1a940 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:12.688134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4da6bda-e536-4723-a676-169461a1a940 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:12.749229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f4da6bda-e536-4723-a676-169461a1a940 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:12.757397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f4da6bda-e536-4723-a676-169461a1a940 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082358 Aug 08 08:57:12.757944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 822/1584] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:12 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:12.762355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-63188f2c-c0ee-4ac8-9de0-9add9e900822 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:12.764447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-63188f2c-c0ee-4ac8-9de0-9add9e900822 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:12.769955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63188f2c-c0ee-4ac8-9de0-9add9e900822 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:12.770438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63188f2c-c0ee-4ac8-9de0-9add9e900822 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:12.770875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63188f2c-c0ee-4ac8-9de0-9add9e900822 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:12.771550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63188f2c-c0ee-4ac8-9de0-9add9e900822 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:12.772001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63188f2c-c0ee-4ac8-9de0-9add9e900822 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:12.772419 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-63188f2c-c0ee-4ac8-9de0-9add9e900822 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:12.801079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-63188f2c-c0ee-4ac8-9de0-9add9e900822 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042111 Aug 08 08:57:12.801660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 823/1585] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:12 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:13.778421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-139ed463-6476-4d59-9f84-a8cca259618b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:13.779101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-139ed463-6476-4d59-9f84-a8cca259618b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:13.785334 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-139ed463-6476-4d59-9f84-a8cca259618b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:13.785814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-139ed463-6476-4d59-9f84-a8cca259618b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:13.786247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-139ed463-6476-4d59-9f84-a8cca259618b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:13.786929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-139ed463-6476-4d59-9f84-a8cca259618b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:13.787381 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-139ed463-6476-4d59-9f84-a8cca259618b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:13.788327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-139ed463-6476-4d59-9f84-a8cca259618b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:13.851235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-139ed463-6476-4d59-9f84-a8cca259618b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:13.858554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-139ed463-6476-4d59-9f84-a8cca259618b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.084059 Aug 08 08:57:13.859113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 824/1586] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:13 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:13.863789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a6bc7102-1907-4490-a8ca-8aa7103fe70f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:13.866511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a6bc7102-1907-4490-a8ca-8aa7103fe70f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:13.871991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a6bc7102-1907-4490-a8ca-8aa7103fe70f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:13.872477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a6bc7102-1907-4490-a8ca-8aa7103fe70f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:13.872910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a6bc7102-1907-4490-a8ca-8aa7103fe70f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:13.873631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a6bc7102-1907-4490-a8ca-8aa7103fe70f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:13.874083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a6bc7102-1907-4490-a8ca-8aa7103fe70f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:13.874505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a6bc7102-1907-4490-a8ca-8aa7103fe70f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:13.902578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a6bc7102-1907-4490-a8ca-8aa7103fe70f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042462 Aug 08 08:57:13.903130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 825/1587] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:14.879907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5d067060-2733-4aa7-b76a-d5abccc12c72 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:14.880555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5d067060-2733-4aa7-b76a-d5abccc12c72 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:14.887781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5d067060-2733-4aa7-b76a-d5abccc12c72 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:14.888266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5d067060-2733-4aa7-b76a-d5abccc12c72 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:14.888707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5d067060-2733-4aa7-b76a-d5abccc12c72 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:14.889423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5d067060-2733-4aa7-b76a-d5abccc12c72 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:14.889880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5d067060-2733-4aa7-b76a-d5abccc12c72 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:14.890308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5d067060-2733-4aa7-b76a-d5abccc12c72 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:14.951047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5d067060-2733-4aa7-b76a-d5abccc12c72 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:14.958421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5d067060-2733-4aa7-b76a-d5abccc12c72 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082355 Aug 08 08:57:14.958978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 826/1588] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:14 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:14.965018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b9e52504-ca02-4eb9-9138-22f91c5f7c3e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:14.968231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b9e52504-ca02-4eb9-9138-22f91c5f7c3e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:14.974362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b9e52504-ca02-4eb9-9138-22f91c5f7c3e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:14.974841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b9e52504-ca02-4eb9-9138-22f91c5f7c3e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:14.975281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b9e52504-ca02-4eb9-9138-22f91c5f7c3e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:14.975965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b9e52504-ca02-4eb9-9138-22f91c5f7c3e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:14.976415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b9e52504-ca02-4eb9-9138-22f91c5f7c3e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:14.976840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b9e52504-ca02-4eb9-9138-22f91c5f7c3e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:15.006483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b9e52504-ca02-4eb9-9138-22f91c5f7c3e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046482 Aug 08 08:57:15.007577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 827/1589] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:15.979052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ed91948c-9a68-4561-aeb8-5439c7240279 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:15.979694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ed91948c-9a68-4561-aeb8-5439c7240279 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:15.987901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed91948c-9a68-4561-aeb8-5439c7240279 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:15.988403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed91948c-9a68-4561-aeb8-5439c7240279 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:15.988850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed91948c-9a68-4561-aeb8-5439c7240279 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:15.989588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed91948c-9a68-4561-aeb8-5439c7240279 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:15.990164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed91948c-9a68-4561-aeb8-5439c7240279 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:15.990643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed91948c-9a68-4561-aeb8-5439c7240279 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:16.051234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ed91948c-9a68-4561-aeb8-5439c7240279 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:16.058708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ed91948c-9a68-4561-aeb8-5439c7240279 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083730 Aug 08 08:57:16.059208 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 828/1590] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:15 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:16.063613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-baa83d7f-c116-48ff-9e00-96d0fdf9bfb4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:16.065735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-baa83d7f-c116-48ff-9e00-96d0fdf9bfb4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:16.071798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baa83d7f-c116-48ff-9e00-96d0fdf9bfb4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:16.072283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baa83d7f-c116-48ff-9e00-96d0fdf9bfb4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:16.072718 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baa83d7f-c116-48ff-9e00-96d0fdf9bfb4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:16.073434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baa83d7f-c116-48ff-9e00-96d0fdf9bfb4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:16.073918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baa83d7f-c116-48ff-9e00-96d0fdf9bfb4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:16.074346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baa83d7f-c116-48ff-9e00-96d0fdf9bfb4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:16.102201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-baa83d7f-c116-48ff-9e00-96d0fdf9bfb4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042016 Aug 08 08:57:16.102742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 829/1591] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:17.079010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ffdad228-3d70-4585-89fe-c1687ec6cc8f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:17.079620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ffdad228-3d70-4585-89fe-c1687ec6cc8f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:17.086521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffdad228-3d70-4585-89fe-c1687ec6cc8f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:17.087006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffdad228-3d70-4585-89fe-c1687ec6cc8f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:17.087448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffdad228-3d70-4585-89fe-c1687ec6cc8f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:17.088137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffdad228-3d70-4585-89fe-c1687ec6cc8f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:17.088592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffdad228-3d70-4585-89fe-c1687ec6cc8f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:17.089021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffdad228-3d70-4585-89fe-c1687ec6cc8f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:17.150856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ffdad228-3d70-4585-89fe-c1687ec6cc8f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:17.158198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ffdad228-3d70-4585-89fe-c1687ec6cc8f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083087 Aug 08 08:57:17.158759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 830/1592] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:17 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:17.163714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2ede0561-0ee0-472d-bbc9-ef114e59bed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:17.165849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2ede0561-0ee0-472d-bbc9-ef114e59bed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:17.171512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ede0561-0ee0-472d-bbc9-ef114e59bed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:17.171994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ede0561-0ee0-472d-bbc9-ef114e59bed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:17.172427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ede0561-0ee0-472d-bbc9-ef114e59bed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:17.173113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ede0561-0ee0-472d-bbc9-ef114e59bed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:17.173592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ede0561-0ee0-472d-bbc9-ef114e59bed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:17.174021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2ede0561-0ee0-472d-bbc9-ef114e59bed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:17.201437 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2ede0561-0ee0-472d-bbc9-ef114e59bed6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041651 Aug 08 08:57:17.201973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 831/1593] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:17 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:18.179471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a49d79b2-7ab3-4685-bc18-4e42164b12f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:18.180326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a49d79b2-7ab3-4685-bc18-4e42164b12f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:18.186674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a49d79b2-7ab3-4685-bc18-4e42164b12f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:18.187149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a49d79b2-7ab3-4685-bc18-4e42164b12f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:18.187580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a49d79b2-7ab3-4685-bc18-4e42164b12f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:18.188264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a49d79b2-7ab3-4685-bc18-4e42164b12f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:18.188746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a49d79b2-7ab3-4685-bc18-4e42164b12f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:18.189225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a49d79b2-7ab3-4685-bc18-4e42164b12f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:18.253763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a49d79b2-7ab3-4685-bc18-4e42164b12f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:18.261847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a49d79b2-7ab3-4685-bc18-4e42164b12f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086324 Aug 08 08:57:18.262489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 832/1594] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:18 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:18.267097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-37e22156-1a66-4d6c-8498-b3c9745713d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:18.269271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-37e22156-1a66-4d6c-8498-b3c9745713d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:18.275657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37e22156-1a66-4d6c-8498-b3c9745713d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:18.276147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37e22156-1a66-4d6c-8498-b3c9745713d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:18.276596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37e22156-1a66-4d6c-8498-b3c9745713d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:18.277319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37e22156-1a66-4d6c-8498-b3c9745713d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:18.277780 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37e22156-1a66-4d6c-8498-b3c9745713d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:18.278213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-37e22156-1a66-4d6c-8498-b3c9745713d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:18.291594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:57:18.306334 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-37e22156-1a66-4d6c-8498-b3c9745713d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042891 Aug 08 08:57:18.306882 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 833/1595] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:18 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:19.283860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-900332bb-f847-460f-ab8b-983b28f86cbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:19.284547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-900332bb-f847-460f-ab8b-983b28f86cbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:19.291333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-900332bb-f847-460f-ab8b-983b28f86cbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:19.291807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-900332bb-f847-460f-ab8b-983b28f86cbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:19.292236 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-900332bb-f847-460f-ab8b-983b28f86cbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:19.292910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-900332bb-f847-460f-ab8b-983b28f86cbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:19.293383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-900332bb-f847-460f-ab8b-983b28f86cbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:19.293807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-900332bb-f847-460f-ab8b-983b28f86cbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:19.353614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-900332bb-f847-460f-ab8b-983b28f86cbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:19.361192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-900332bb-f847-460f-ab8b-983b28f86cbf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.081277 Aug 08 08:57:19.361755 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 834/1596] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:19 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:19.366291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ff5b919e-c45c-4f72-89ac-0dfdcedfbab1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:19.368556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ff5b919e-c45c-4f72-89ac-0dfdcedfbab1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:19.374238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff5b919e-c45c-4f72-89ac-0dfdcedfbab1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:19.374736 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff5b919e-c45c-4f72-89ac-0dfdcedfbab1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:19.375173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff5b919e-c45c-4f72-89ac-0dfdcedfbab1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:19.375868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff5b919e-c45c-4f72-89ac-0dfdcedfbab1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:19.376323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff5b919e-c45c-4f72-89ac-0dfdcedfbab1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:19.376752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff5b919e-c45c-4f72-89ac-0dfdcedfbab1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:19.405101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ff5b919e-c45c-4f72-89ac-0dfdcedfbab1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Aug 08 08:57:19.405668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 835/1597] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:20.381118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fadcf49f-bc3f-483b-81f7-54b9a9eb54ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:20.382377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fadcf49f-bc3f-483b-81f7-54b9a9eb54ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:20.388575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fadcf49f-bc3f-483b-81f7-54b9a9eb54ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:20.389052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fadcf49f-bc3f-483b-81f7-54b9a9eb54ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:20.389513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fadcf49f-bc3f-483b-81f7-54b9a9eb54ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:20.390195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fadcf49f-bc3f-483b-81f7-54b9a9eb54ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:20.390646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fadcf49f-bc3f-483b-81f7-54b9a9eb54ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:20.391068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fadcf49f-bc3f-483b-81f7-54b9a9eb54ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:20.453065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fadcf49f-bc3f-483b-81f7-54b9a9eb54ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:20.461327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fadcf49f-bc3f-483b-81f7-54b9a9eb54ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083961 Aug 08 08:57:20.461837 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 836/1598] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:20 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:20.466401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-382dd928-a98b-4c45-92e3-6f09db4af7e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:20.468481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-382dd928-a98b-4c45-92e3-6f09db4af7e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:20.473923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382dd928-a98b-4c45-92e3-6f09db4af7e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:20.474400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382dd928-a98b-4c45-92e3-6f09db4af7e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:20.474832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382dd928-a98b-4c45-92e3-6f09db4af7e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:20.475510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382dd928-a98b-4c45-92e3-6f09db4af7e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:20.475958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382dd928-a98b-4c45-92e3-6f09db4af7e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:20.476377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382dd928-a98b-4c45-92e3-6f09db4af7e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:20.663520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-382dd928-a98b-4c45-92e3-6f09db4af7e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200639 Aug 08 08:57:20.664054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 837/1599] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:20 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:21.482240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1a84a850-9626-46c9-ad65-d3ba33773762 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:21.482894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1a84a850-9626-46c9-ad65-d3ba33773762 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:21.489454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a84a850-9626-46c9-ad65-d3ba33773762 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:21.489932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a84a850-9626-46c9-ad65-d3ba33773762 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:21.490390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a84a850-9626-46c9-ad65-d3ba33773762 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:21.491234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a84a850-9626-46c9-ad65-d3ba33773762 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:21.491790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a84a850-9626-46c9-ad65-d3ba33773762 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:21.492216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a84a850-9626-46c9-ad65-d3ba33773762 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:21.552919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1a84a850-9626-46c9-ad65-d3ba33773762 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:21.560795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1a84a850-9626-46c9-ad65-d3ba33773762 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082489 Aug 08 08:57:21.561368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 838/1600] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:21 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:21.674886 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e8376692-76c7-4f40-b11b-db221970010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:21.676987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e8376692-76c7-4f40-b11b-db221970010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:21.683021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8376692-76c7-4f40-b11b-db221970010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:21.683498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8376692-76c7-4f40-b11b-db221970010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:21.683931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8376692-76c7-4f40-b11b-db221970010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:21.684610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8376692-76c7-4f40-b11b-db221970010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:21.685063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8376692-76c7-4f40-b11b-db221970010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:21.685513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e8376692-76c7-4f40-b11b-db221970010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:21.713323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e8376692-76c7-4f40-b11b-db221970010c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042348 Aug 08 08:57:21.713859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 839/1601] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:21 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:57:22.581530 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-19cfda8b-2f9a-4583-a6e9-7121eeb17eb0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:22.582187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-19cfda8b-2f9a-4583-a6e9-7121eeb17eb0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:22.588272 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19cfda8b-2f9a-4583-a6e9-7121eeb17eb0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:22.588745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19cfda8b-2f9a-4583-a6e9-7121eeb17eb0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:22.589195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19cfda8b-2f9a-4583-a6e9-7121eeb17eb0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:22.589875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19cfda8b-2f9a-4583-a6e9-7121eeb17eb0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:22.590321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19cfda8b-2f9a-4583-a6e9-7121eeb17eb0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:22.590744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19cfda8b-2f9a-4583-a6e9-7121eeb17eb0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:22.653805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-19cfda8b-2f9a-4583-a6e9-7121eeb17eb0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:22.661059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-19cfda8b-2f9a-4583-a6e9-7121eeb17eb0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083566 Aug 08 08:57:22.661740 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 840/1602] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:22 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:22.725590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fcb1c676-7e64-4690-a1e2-87fb969c1bc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:22.727694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fcb1c676-7e64-4690-a1e2-87fb969c1bc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:22.733689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcb1c676-7e64-4690-a1e2-87fb969c1bc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:22.734181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcb1c676-7e64-4690-a1e2-87fb969c1bc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:22.734624 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcb1c676-7e64-4690-a1e2-87fb969c1bc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:22.735325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcb1c676-7e64-4690-a1e2-87fb969c1bc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:22.735788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcb1c676-7e64-4690-a1e2-87fb969c1bc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:22.736477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcb1c676-7e64-4690-a1e2-87fb969c1bc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:22.765011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fcb1c676-7e64-4690-a1e2-87fb969c1bc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Aug 08 08:57:22.765583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 841/1603] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:57:23.682584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fd66ddff-6571-4b8d-97ed-b1ef40bd1244 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:23.683239 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fd66ddff-6571-4b8d-97ed-b1ef40bd1244 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:23.689722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd66ddff-6571-4b8d-97ed-b1ef40bd1244 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:23.690198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd66ddff-6571-4b8d-97ed-b1ef40bd1244 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:23.690639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd66ddff-6571-4b8d-97ed-b1ef40bd1244 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:23.691320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd66ddff-6571-4b8d-97ed-b1ef40bd1244 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:23.691772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd66ddff-6571-4b8d-97ed-b1ef40bd1244 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:23.692189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd66ddff-6571-4b8d-97ed-b1ef40bd1244 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:23.753459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fd66ddff-6571-4b8d-97ed-b1ef40bd1244 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:23.760945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fd66ddff-6571-4b8d-97ed-b1ef40bd1244 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082664 Aug 08 08:57:23.761992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 842/1604] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:23 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:23.776924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-951f3b77-5e73-4e40-b253-6db6d84870c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:23.779079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-951f3b77-5e73-4e40-b253-6db6d84870c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:23.784807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-951f3b77-5e73-4e40-b253-6db6d84870c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:23.785333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-951f3b77-5e73-4e40-b253-6db6d84870c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:23.785775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-951f3b77-5e73-4e40-b253-6db6d84870c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:23.786462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-951f3b77-5e73-4e40-b253-6db6d84870c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:23.786917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-951f3b77-5e73-4e40-b253-6db6d84870c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:23.787344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-951f3b77-5e73-4e40-b253-6db6d84870c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:23.815848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-951f3b77-5e73-4e40-b253-6db6d84870c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042958 Aug 08 08:57:23.816403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 843/1605] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 08:57:24.782352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-99637ff1-2381-4671-b40c-b6568c2adcbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:24.783018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-99637ff1-2381-4671-b40c-b6568c2adcbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:24.790146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99637ff1-2381-4671-b40c-b6568c2adcbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:24.790865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99637ff1-2381-4671-b40c-b6568c2adcbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:24.791307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99637ff1-2381-4671-b40c-b6568c2adcbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:24.791988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99637ff1-2381-4671-b40c-b6568c2adcbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:24.792437 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99637ff1-2381-4671-b40c-b6568c2adcbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:24.792857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99637ff1-2381-4671-b40c-b6568c2adcbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:24.854734 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-99637ff1-2381-4671-b40c-b6568c2adcbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:24.862376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-99637ff1-2381-4671-b40c-b6568c2adcbd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.083984 Aug 08 08:57:24.862927 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 844/1606] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:24 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:24.867989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fe172e29-ae1c-46de-80b2-874b322101f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:24.870092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fe172e29-ae1c-46de-80b2-874b322101f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:24.875519 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe172e29-ae1c-46de-80b2-874b322101f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:24.876060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe172e29-ae1c-46de-80b2-874b322101f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:24.876499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe172e29-ae1c-46de-80b2-874b322101f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:24.877201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe172e29-ae1c-46de-80b2-874b322101f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:24.877658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe172e29-ae1c-46de-80b2-874b322101f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:24.878079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe172e29-ae1c-46de-80b2-874b322101f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:24.904923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fe172e29-ae1c-46de-80b2-874b322101f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041042 Aug 08 08:57:24.905488 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 845/1607] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:24 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:25.883632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3dcb0c3a-ca41-4935-be5b-df9c966b170c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:25.884242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3dcb0c3a-ca41-4935-be5b-df9c966b170c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:25.890551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dcb0c3a-ca41-4935-be5b-df9c966b170c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:25.891028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dcb0c3a-ca41-4935-be5b-df9c966b170c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:25.891460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dcb0c3a-ca41-4935-be5b-df9c966b170c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:25.892137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dcb0c3a-ca41-4935-be5b-df9c966b170c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:25.892583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dcb0c3a-ca41-4935-be5b-df9c966b170c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:25.893021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dcb0c3a-ca41-4935-be5b-df9c966b170c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:25.954051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3dcb0c3a-ca41-4935-be5b-df9c966b170c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:57:25.962211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3dcb0c3a-ca41-4935-be5b-df9c966b170c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.082630 Aug 08 08:57:25.962774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 846/1608] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:57:25 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 08:57:25.967294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9d08fd48-1cfe-40b2-a81e-011b9cd598fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:25.969478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9d08fd48-1cfe-40b2-a81e-011b9cd598fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:25.974921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9d08fd48-1cfe-40b2-a81e-011b9cd598fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:25.976008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9d08fd48-1cfe-40b2-a81e-011b9cd598fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:25.976446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9d08fd48-1cfe-40b2-a81e-011b9cd598fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:25.977133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9d08fd48-1cfe-40b2-a81e-011b9cd598fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:25.977635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9d08fd48-1cfe-40b2-a81e-011b9cd598fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:25.978064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9d08fd48-1cfe-40b2-a81e-011b9cd598fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:26.007312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9d08fd48-1cfe-40b2-a81e-011b9cd598fb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043541 Aug 08 08:57:26.007834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 847/1609] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:57:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:57:26.231242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:57:26.231745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:57:26.238045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:26.238545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:26.238989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:26.239714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:57:26.240208 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:57:26.240688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:57:36.235652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=79 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:57:36.258995 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=91 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:58:02.826607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lazy-loading 'services' on Instance uuid a22a3234-6e6a-4901-a390-8e621ef8134f {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:58:02.908045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lazy-loading 'services' on Instance uuid a22a3234-6e6a-4901-a390-8e621ef8134f {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 08:58:12.830808 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=4 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:58:12.911739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=4 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:58:18.755492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 08:58:18.756041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 08:58:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 (ip 10.222.0.33) !!! Aug 08 08:58:26.344770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c6fc771e-5957-4396-8a72-42f550d58a89) Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Request method failure captured: Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 HTTP/1.1 Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8M4MfiyksAf7GEvx8OylzmSOEOLAvLCLP3asAqHbCSx5nNngBdDt7hcJb7KEP4TioUAEgDWDQbep1fsyOCAPmOCs6JyQ38HqCC7XaWqNOc8_9HvMqK0wJMnqLjjCBP_RZ47V6Q76nZ6Oat8d36pXpulw9ueZhAbd99qOyIZCDbG5omU Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 08:58:26.350813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 08:58:26.352938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 08:58:26.352938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 08:58:26.352938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 08:58:26.352938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 08:58:26.352938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 08:58:26.352938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 08:58:26.352938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 08:58:26.352938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: d89b729776114f7ab97c7a99f5a777c2 Aug 08 08:58:26.352938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 08:58:26.352938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c6fc771e-5957-4396-8a72-42f550d58a89) Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'server_id': 'a22a3234-6e6a-4901-a390-8e621ef8134f', 'id': '23b64078-0d9c-43d6-8b79-5fc49693ad42'} Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 08:58:26.353817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c6fc771e-5957-4396-8a72-42f550d58a89) Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 08:58:26.355076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c6fc771e-5957-4396-8a72-42f550d58a89) Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:58:26.356592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c6fc771e-5957-4396-8a72-42f550d58a89) Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:58:26.357992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c6fc771e-5957-4396-8a72-42f550d58a89) Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c6fc771e-5957-4396-8a72-42f550d58a89) Aug 08 08:58:26.359722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 08:58:26.361258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c6fc771e-5957-4396-8a72-42f550d58a89) {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 08:58:26.361258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f2df2057-4c6c-441d-ba3f-99a32ded90ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42" status: 400 len: 269 microversion: 2.1 time: 60.121347 Aug 08 08:58:26.361258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 848/1610] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:57:26 2022] DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 => generated 269 bytes in 60122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 08:58:26.361258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2acf7ff3-c41a-4d5e-965e-3c97326f615d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:58:26.361778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2acf7ff3-c41a-4d5e-965e-3c97326f615d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: e4ee0e71-bef8-4c22-ac1f-1b08e564b14d] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:58:26.363244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2acf7ff3-c41a-4d5e-965e-3c97326f615d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:58:26.363767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2acf7ff3-c41a-4d5e-965e-3c97326f615d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:58:26.364203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2acf7ff3-c41a-4d5e-965e-3c97326f615d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:58:26.364895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2acf7ff3-c41a-4d5e-965e-3c97326f615d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:58:26.365370 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2acf7ff3-c41a-4d5e-965e-3c97326f615d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:58:26.365797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2acf7ff3-c41a-4d5e-965e-3c97326f615d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:58:26.374446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR oslo.messaging._drivers.impl_rabbit [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [904c6702-acdb-4911-ac20-a788d703e973] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 08:58:26.429462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2acf7ff3-c41a-4d5e-965e-3c97326f615d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 08:58:26.436898 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2acf7ff3-c41a-4d5e-965e-3c97326f615d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d" status: 200 len: 1224 microversion: 2.1 time: 0.086758 Aug 08 08:58:26.437493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 849/1611] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 08:58:26 2022] GET /compute/v2.1/servers/e4ee0e71-bef8-4c22-ac1f-1b08e564b14d => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 08:58:26.442020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-99fd2f04-7d7a-4d4e-90ca-e61727bf8802 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:58:26.444122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-99fd2f04-7d7a-4d4e-90ca-e61727bf8802 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:58:26.450240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99fd2f04-7d7a-4d4e-90ca-e61727bf8802 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:58:26.450717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99fd2f04-7d7a-4d4e-90ca-e61727bf8802 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:58:26.451151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99fd2f04-7d7a-4d4e-90ca-e61727bf8802 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:58:26.451832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99fd2f04-7d7a-4d4e-90ca-e61727bf8802 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:58:26.452283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99fd2f04-7d7a-4d4e-90ca-e61727bf8802 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:58:26.452708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99fd2f04-7d7a-4d4e-90ca-e61727bf8802 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:58:26.481120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-99fd2f04-7d7a-4d4e-90ca-e61727bf8802 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042650 Aug 08 08:58:26.481677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 850/1612] 10.222.0.33 () {58 vars in 1302 bytes} [Mon Aug 8 08:58:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 08:58:26.486065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:58:26.486544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:58:26.492104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:58:26.492581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:58:26.493664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:58:26.494347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:58:26.494818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:58:26.495217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:58:27.381495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [904c6702-acdb-4911-ac20-a788d703e973] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54474. Aug 08 08:58:27.385274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-af608eec-2352-4c9e-80d8-ed03cde3657b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42" status: 202 len: 0 microversion: 2.1 time: 121.214864 Aug 08 08:58:27.385863 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 763/1613] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:56:26 2022] DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 => generated 0 bytes in 121216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 08:58:27.495437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-35e5c9a5-106b-4538-bf00-449eac269447 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 08:58:27.497818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-35e5c9a5-106b-4538-bf00-449eac269447 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:58:27.505582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35e5c9a5-106b-4538-bf00-449eac269447 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:58:27.506070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35e5c9a5-106b-4538-bf00-449eac269447 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:58:27.506504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35e5c9a5-106b-4538-bf00-449eac269447 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:58:27.507199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35e5c9a5-106b-4538-bf00-449eac269447 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:58:27.507649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35e5c9a5-106b-4538-bf00-449eac269447 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:58:27.508190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35e5c9a5-106b-4538-bf00-449eac269447 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:58:27.598713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-35e5c9a5-106b-4538-bf00-449eac269447 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "POST /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/action" status: 200 len: 84090 microversion: 2.1 time: 0.108287 Aug 08 08:58:27.599398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 764/1614] 10.222.0.33 () {60 vars in 1278 bytes} [Mon Aug 8 08:58:27 2022] POST /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/action => generated 84090 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 08:58:27.614098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 08:58:27.614685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 08:58:27.621884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:58:27.622376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:58:27.622820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:58:27.623554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 08:58:27.624018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 08:58:27.624451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 08:58:31.996356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 08:58:31.996848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 08:58:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 (ip 10.222.0.33) !!! Aug 08 08:58:36.489582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=6 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:58:36.512814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=16 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:58:37.618701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=4 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 08:58:37.642996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:00:03.410712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lazy-loading 'services' on Instance uuid a22a3234-6e6a-4901-a390-8e621ef8134f {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 09:00:03.577602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lazy-loading 'services' on Instance uuid 83365b2d-9f2c-4966-bdb6-789059348c37 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 09:00:04.994527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:00:04.995213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f (ip 10.222.0.33) !!! Aug 08 09:00:08.578314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:00:08.578815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 (ip 10.222.0.33) !!! Aug 08 09:00:13.424027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=4 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:00:13.581957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=4 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:00:22.817735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:00:22.818365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:00:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 (ip 10.222.0.33) !!! Aug 08 09:00:26.452139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0661e77-710f-4223-ba52-5bda2782225c) Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Request method failure captured: Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 HTTP/1.1 Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8M4MfiyksAf7GEvx8OylzmSOEOLAvLCLP3asAqHbCSx5nNngBdDt7hcJb7KEP4TioUAEgDWDQbep1fsyOCAPmOCs6JyQ38HqCC7XaWqNOc8_9HvMqK0wJMnqLjjCBP_RZ47V6Q76nZ6Oat8d36pXpulw9ueZhAbd99qOyIZCDbG5omU Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 09:00:26.454344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 09:00:26.456274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 09:00:26.456274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:00:26.456274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 09:00:26.456274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:00:26.456274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 09:00:26.456274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 09:00:26.456274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 09:00:26.456274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: d89b729776114f7ab97c7a99f5a777c2 Aug 08 09:00:26.456274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 09:00:26.456274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0661e77-710f-4223-ba52-5bda2782225c) Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'server_id': 'a22a3234-6e6a-4901-a390-8e621ef8134f', 'id': '23b64078-0d9c-43d6-8b79-5fc49693ad42'} Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:00:26.457830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0661e77-710f-4223-ba52-5bda2782225c) Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:00:26.459548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0661e77-710f-4223-ba52-5bda2782225c) Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:00:26.461256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0661e77-710f-4223-ba52-5bda2782225c) Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:00:26.463543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0661e77-710f-4223-ba52-5bda2782225c) Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0661e77-710f-4223-ba52-5bda2782225c) Aug 08 09:00:26.465046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.466548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0661e77-710f-4223-ba52-5bda2782225c) {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 09:00:26.466548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1ec32aaa-2661-4e15-ab21-d0b8613bb6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42" status: 400 len: 269 microversion: 2.1 time: 119.973186 Aug 08 09:00:26.466548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 851/1615] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:58:26 2022] DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 => generated 269 bytes in 119974 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 09:00:26.466548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:00:26.467281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:00:26.471594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:00:26.472090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:00:26.472531 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:00:26.473292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:00:26.473753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:00:26.474213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:00:26.487709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e086468f-a071-4a25-8734-57157c12559c) Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Request method failure captured: Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f HTTP/1.1 Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M4ZT6HUh80dqF6I4TWlWUS3rqPwn42roEFquUHmTeAZNrZjLypCgfH_D68pbRRohn3aq08NMwVvHQTi1yZXH0YVXDofoWkga7V97lEvOWxeVewnMISHpVLAmLx6_9ZHr9dp2yRve_Z3b1Uj94zmbr7CABuLC1Td387J3msGXdAYdNo Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 0bbf785f7de94ef7ad423568d41af122 Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 09:00:26.490071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 09:00:26.491935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 09:00:26.491935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:00:26.491935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 0bbf785f7de94ef7ad423568d41af122 Aug 08 09:00:26.491935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:00:26.491935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-TestMinimumBasicScenario-951900542-project Aug 08 09:00:26.491935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 09:00:26.491935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 09:00:26.491935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 891658773e7546c78c3213a3f5233fd4 Aug 08 09:00:26.491935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-TestMinimumBasicScenario-951900542-project Aug 08 09:00:26.491935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e086468f-a071-4a25-8734-57157c12559c) Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'server_id': '83365b2d-9f2c-4966-bdb6-789059348c37', 'id': '56631e1f-8b5f-49b6-91fc-c60b82e5951f'} Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:00:26.492925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e086468f-a071-4a25-8734-57157c12559c) Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:00:26.495019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e086468f-a071-4a25-8734-57157c12559c) Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:00:26.496285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e086468f-a071-4a25-8734-57157c12559c) Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:00:26.499217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e086468f-a071-4a25-8734-57157c12559c) Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e086468f-a071-4a25-8734-57157c12559c) Aug 08 09:00:26.502732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:00:26.504324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e086468f-a071-4a25-8734-57157c12559c) {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 09:00:26.504324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dafc909e-2663-4403-a6ae-a3ef6fe28084 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f" status: 400 len: 269 microversion: 2.1 time: 118.891801 Aug 08 09:00:26.504324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 765/1616] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 08:58:27 2022] DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f => generated 269 bytes in 118893 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 09:00:26.510898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:00:26.511446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:00:26.521939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:00:26.521939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:00:26.521939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:00:26.521939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:00:26.522353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:00:26.522353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:00:36.468717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:00:36.492336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=4 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:00:36.515780 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:00:36.540382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=4 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:01:38.763358 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:01:38.764034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f (ip 10.222.0.33) !!! Aug 08 09:01:52.004273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:01:52.004802 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 (ip 10.222.0.33) !!! Aug 08 09:02:03.844270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lazy-loading 'services' on Instance uuid a22a3234-6e6a-4901-a390-8e621ef8134f {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 09:02:03.883614 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lazy-loading 'services' on Instance uuid 83365b2d-9f2c-4966-bdb6-789059348c37 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 09:02:04.004344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40bb7b2f-29d8-4305-9312-65019fd38156) Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Request method failure captured: Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 HTTP/1.1 Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8M4MfiyksAf7GEvx8OylzmSOEOLAvLCLP3asAqHbCSx5nNngBdDt7hcJb7KEP4TioUAEgDWDQbep1fsyOCAPmOCs6JyQ38HqCC7XaWqNOc8_9HvMqK0wJMnqLjjCBP_RZ47V6Q76nZ6Oat8d36pXpulw9ueZhAbd99qOyIZCDbG5omU Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 09:02:04.006548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 09:02:04.008339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 09:02:04.008339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:02:04.008339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 09:02:04.008339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:02:04.008339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 09:02:04.008339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 09:02:04.008339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 09:02:04.008339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: d89b729776114f7ab97c7a99f5a777c2 Aug 08 09:02:04.008339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 09:02:04.008339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40bb7b2f-29d8-4305-9312-65019fd38156) Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'server_id': 'a22a3234-6e6a-4901-a390-8e621ef8134f', 'id': '23b64078-0d9c-43d6-8b79-5fc49693ad42'} Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.010310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40bb7b2f-29d8-4305-9312-65019fd38156) Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.012741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40bb7b2f-29d8-4305-9312-65019fd38156) Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.014700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40bb7b2f-29d8-4305-9312-65019fd38156) Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.016119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40bb7b2f-29d8-4305-9312-65019fd38156) Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40bb7b2f-29d8-4305-9312-65019fd38156) Aug 08 09:02:04.021617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.023142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40bb7b2f-29d8-4305-9312-65019fd38156) {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 09:02:04.023142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3c1c96a9-e8ac-4abe-948e-0e20291c4bd9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42" status: 400 len: 269 microversion: 2.1 time: 97.550627 Aug 08 09:02:04.023142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 852/1617] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 09:00:26 2022] DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 => generated 269 bytes in 97552 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 09:02:04.023142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:02:04.023522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:02:04.023522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:02:04.023716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:02:04.024029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:02:04.024867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:02:04.025263 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:02:04.025695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:02:04.039736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4f35ec8c-fe0d-4f20-9a65-eb147e9896a0) Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Request method failure captured: Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f HTTP/1.1 Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M4ZT6HUh80dqF6I4TWlWUS3rqPwn42roEFquUHmTeAZNrZjLypCgfH_D68pbRRohn3aq08NMwVvHQTi1yZXH0YVXDofoWkga7V97lEvOWxeVewnMISHpVLAmLx6_9ZHr9dp2yRve_Z3b1Uj94zmbr7CABuLC1Td387J3msGXdAYdNo Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 0bbf785f7de94ef7ad423568d41af122 Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 09:02:04.042724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 09:02:04.044442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 09:02:04.044442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:02:04.044442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 0bbf785f7de94ef7ad423568d41af122 Aug 08 09:02:04.044442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:02:04.044442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-TestMinimumBasicScenario-951900542-project Aug 08 09:02:04.044442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 09:02:04.044442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 09:02:04.044442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 891658773e7546c78c3213a3f5233fd4 Aug 08 09:02:04.044442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-TestMinimumBasicScenario-951900542-project Aug 08 09:02:04.044442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4f35ec8c-fe0d-4f20-9a65-eb147e9896a0) Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'server_id': '83365b2d-9f2c-4966-bdb6-789059348c37', 'id': '56631e1f-8b5f-49b6-91fc-c60b82e5951f'} Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.045247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4f35ec8c-fe0d-4f20-9a65-eb147e9896a0) Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.051293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4f35ec8c-fe0d-4f20-9a65-eb147e9896a0) Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.052870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4f35ec8c-fe0d-4f20-9a65-eb147e9896a0) Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.054329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4f35ec8c-fe0d-4f20-9a65-eb147e9896a0) Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4f35ec8c-fe0d-4f20-9a65-eb147e9896a0) Aug 08 09:02:04.056487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.058087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4f35ec8c-fe0d-4f20-9a65-eb147e9896a0) {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 09:02:04.058087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-eed9faaa-7634-4c22-a0c4-c275cfabf821 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f" status: 400 len: 269 microversion: 2.1 time: 97.538628 Aug 08 09:02:04.058087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 766/1618] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 09:00:26 2022] DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f => generated 269 bytes in 97542 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 09:02:04.058087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:02:04.058491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:02:04.061699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:02:04.062193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:02:04.062631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:02:04.063335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:02:04.063791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:02:04.064221 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:02:04.123024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lazy-loading 'services' on Instance uuid a22a3234-6e6a-4901-a390-8e621ef8134f {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 09:02:04.167156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lazy-loading 'services' on Instance uuid 83365b2d-9f2c-4966-bdb6-789059348c37 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 09:02:04.198014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0412f0c-d8a1-4b57-9036-94ad7f9774aa) Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Request method failure captured: Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 HTTP/1.1 Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8M4MfiyksAf7GEvx8OylzmSOEOLAvLCLP3asAqHbCSx5nNngBdDt7hcJb7KEP4TioUAEgDWDQbep1fsyOCAPmOCs6JyQ38HqCC7XaWqNOc8_9HvMqK0wJMnqLjjCBP_RZ47V6Q76nZ6Oat8d36pXpulw9ueZhAbd99qOyIZCDbG5omU Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 09:02:04.199040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 09:02:04.200779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 09:02:04.200779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:02:04.200779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 09:02:04.200779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:02:04.200779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 09:02:04.200779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 09:02:04.200779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 09:02:04.200779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: d89b729776114f7ab97c7a99f5a777c2 Aug 08 09:02:04.200779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 09:02:04.200779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0412f0c-d8a1-4b57-9036-94ad7f9774aa) Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'server_id': 'a22a3234-6e6a-4901-a390-8e621ef8134f', 'id': '23b64078-0d9c-43d6-8b79-5fc49693ad42'} Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.201920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0412f0c-d8a1-4b57-9036-94ad7f9774aa) Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.203803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0412f0c-d8a1-4b57-9036-94ad7f9774aa) Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.208111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0412f0c-d8a1-4b57-9036-94ad7f9774aa) Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.210091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0412f0c-d8a1-4b57-9036-94ad7f9774aa) Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0412f0c-d8a1-4b57-9036-94ad7f9774aa) Aug 08 09:02:04.211701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.214429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0412f0c-d8a1-4b57-9036-94ad7f9774aa) {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 09:02:04.214429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-262de0ea-3a27-496e-8a05-f71796bb92f0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42" status: 400 len: 269 microversion: 2.1 time: 0.191251 Aug 08 09:02:04.214429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 853/1619] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 09:02:04 2022] DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 => generated 269 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 09:02:04.214429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:02:04.214856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:02:04.214856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:02:04.214856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:02:04.215148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:02:04.215563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:02:04.216847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:02:04.216847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:02:04.234519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aaddb57c-fc34-49b7-b21a-dd0a990e6eb9) Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Request method failure captured: Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f HTTP/1.1 Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M4ZT6HUh80dqF6I4TWlWUS3rqPwn42roEFquUHmTeAZNrZjLypCgfH_D68pbRRohn3aq08NMwVvHQTi1yZXH0YVXDofoWkga7V97lEvOWxeVewnMISHpVLAmLx6_9ZHr9dp2yRve_Z3b1Uj94zmbr7CABuLC1Td387J3msGXdAYdNo Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 0bbf785f7de94ef7ad423568d41af122 Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 09:02:04.236644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 09:02:04.238799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 09:02:04.238799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:02:04.238799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 0bbf785f7de94ef7ad423568d41af122 Aug 08 09:02:04.238799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:02:04.238799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-TestMinimumBasicScenario-951900542-project Aug 08 09:02:04.238799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 09:02:04.238799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 09:02:04.238799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 891658773e7546c78c3213a3f5233fd4 Aug 08 09:02:04.238799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-TestMinimumBasicScenario-951900542-project Aug 08 09:02:04.238799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aaddb57c-fc34-49b7-b21a-dd0a990e6eb9) Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'server_id': '83365b2d-9f2c-4966-bdb6-789059348c37', 'id': '56631e1f-8b5f-49b6-91fc-c60b82e5951f'} Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.239788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aaddb57c-fc34-49b7-b21a-dd0a990e6eb9) Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.241349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aaddb57c-fc34-49b7-b21a-dd0a990e6eb9) Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.243033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aaddb57c-fc34-49b7-b21a-dd0a990e6eb9) Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.245300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aaddb57c-fc34-49b7-b21a-dd0a990e6eb9) Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aaddb57c-fc34-49b7-b21a-dd0a990e6eb9) Aug 08 09:02:04.249163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.250683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-aaddb57c-fc34-49b7-b21a-dd0a990e6eb9) {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 09:02:04.250683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c573ca78-1511-4d33-ae96-075df21dfe42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f" status: 400 len: 269 microversion: 2.1 time: 0.192573 Aug 08 09:02:04.250683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 767/1620] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 09:02:04 2022] DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f => generated 269 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 09:02:04.250683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:02:04.251088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:02:04.251088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:02:04.251088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:02:04.251380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:02:04.251991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:02:04.252446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:02:04.252871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:02:04.300711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lazy-loading 'services' on Instance uuid a22a3234-6e6a-4901-a390-8e621ef8134f {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 09:02:04.341873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.objects.instance [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lazy-loading 'services' on Instance uuid 83365b2d-9f2c-4966-bdb6-789059348c37 {{(pid=124672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-047f07db-b38b-45f1-8aa6-082f62887ab5) Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Request method failure captured: Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 HTTP/1.1 Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8M4MfiyksAf7GEvx8OylzmSOEOLAvLCLP3asAqHbCSx5nNngBdDt7hcJb7KEP4TioUAEgDWDQbep1fsyOCAPmOCs6JyQ38HqCC7XaWqNOc8_9HvMqK0wJMnqLjjCBP_RZ47V6Q76nZ6Oat8d36pXpulw9ueZhAbd99qOyIZCDbG5omU Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 09:02:04.379479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 09:02:04.381252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 09:02:04.381252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:02:04.381252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 09:02:04.381252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:02:04.381252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 09:02:04.381252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 09:02:04.381252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 09:02:04.381252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: d89b729776114f7ab97c7a99f5a777c2 Aug 08 09:02:04.381252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 09:02:04.381252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-047f07db-b38b-45f1-8aa6-082f62887ab5) Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'server_id': 'a22a3234-6e6a-4901-a390-8e621ef8134f', 'id': '23b64078-0d9c-43d6-8b79-5fc49693ad42'} Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.382965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-047f07db-b38b-45f1-8aa6-082f62887ab5) Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.384499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-047f07db-b38b-45f1-8aa6-082f62887ab5) Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.386015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-047f07db-b38b-45f1-8aa6-082f62887ab5) Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.388067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-047f07db-b38b-45f1-8aa6-082f62887ab5) Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-047f07db-b38b-45f1-8aa6-082f62887ab5) Aug 08 09:02:04.390001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.398788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-047f07db-b38b-45f1-8aa6-082f62887ab5) {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 09:02:04.398788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-239c1ea0-7686-42f6-bfce-319122c7c800 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42" status: 400 len: 269 microversion: 2.1 time: 0.171437 Aug 08 09:02:04.398788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 854/1621] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 09:02:04 2022] DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f/os-volume_attachments/23b64078-0d9c-43d6-8b79-5fc49693ad42 => generated 269 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 09:02:04.422489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40895045-fa38-4f46-99a6-3893bb9af408) Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Request method failure captured: Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f HTTP/1.1 Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8M4ZT6HUh80dqF6I4TWlWUS3rqPwn42roEFquUHmTeAZNrZjLypCgfH_D68pbRRohn3aq08NMwVvHQTi1yZXH0YVXDofoWkga7V97lEvOWxeVewnMISHpVLAmLx6_9ZHr9dp2yRve_Z3b1Uj94zmbr7CABuLC1Td387J3msGXdAYdNo Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: 0bbf785f7de94ef7ad423568d41af122 Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 09:02:04.424794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 09:02:04.426570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0bbf785f7de94ef7ad423568d41af122"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 09:02:04.426570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:02:04.426570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: 0bbf785f7de94ef7ad423568d41af122 Aug 08 09:02:04.426570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-TestMinimumBasicScenario-951900542 Aug 08 09:02:04.426570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-TestMinimumBasicScenario-951900542-project Aug 08 09:02:04.426570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 09:02:04.426570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 09:02:04.426570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: 891658773e7546c78c3213a3f5233fd4 Aug 08 09:02:04.426570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-TestMinimumBasicScenario-951900542-project Aug 08 09:02:04.426570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40895045-fa38-4f46-99a6-3893bb9af408) Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'server_id': '83365b2d-9f2c-4966-bdb6-789059348c37', 'id': '56631e1f-8b5f-49b6-91fc-c60b82e5951f'} Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.428710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40895045-fa38-4f46-99a6-3893bb9af408) Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 09:02:04.429921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40895045-fa38-4f46-99a6-3893bb9af408) Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.431904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40895045-fa38-4f46-99a6-3893bb9af408) Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.433515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40895045-fa38-4f46-99a6-3893bb9af408) Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40895045-fa38-4f46-99a6-3893bb9af408) Aug 08 09:02:04.438934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:02:04.440244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-40895045-fa38-4f46-99a6-3893bb9af408) {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 09:02:04.440244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7f327f3c-d690-416f-bf2b-9fa9b6b2a9ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f" status: 400 len: 269 microversion: 2.1 time: 0.186717 Aug 08 09:02:04.440244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 768/1622] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 09:02:04 2022] DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37/os-volume_attachments/56631e1f-8b5f-49b6-91fc-c60b82e5951f => generated 269 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 09:03:25.001844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:03:25.002605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:03:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:03:28.585877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:03:28.586381 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:03:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:03:42.826458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:03:42.827038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:03:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:03:44.991845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:03:44.992345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:03:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:04:58.772049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:04:58.772801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:04:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:05:12.014501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:05:12.015039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:06:45.009685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:06:45.019858 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:06:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:06:48.601546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:06:48.602056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:06:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:07:02.834130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:07:02.834811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:07:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:07:05.000611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:07:05.001023 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:07:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:08:04.291622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2a96b11-9f37-47d2-92cf-6f6e0744a816] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 09:08:04.292167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=4 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:04.293094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=20 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:04.297268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7fd8b696-2e49-4e1a-aa6a-669dd1bb8515 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:04.309776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7fd8b696-2e49-4e1a-aa6a-669dd1bb8515 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:04.309776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fd8b696-2e49-4e1a-aa6a-669dd1bb8515 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:04.309776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fd8b696-2e49-4e1a-aa6a-669dd1bb8515 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:04.309776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fd8b696-2e49-4e1a-aa6a-669dd1bb8515 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:04.310496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fd8b696-2e49-4e1a-aa6a-669dd1bb8515 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:04.310496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fd8b696-2e49-4e1a-aa6a-669dd1bb8515 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:04.310496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fd8b696-2e49-4e1a-aa6a-669dd1bb8515 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:04.344154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR oslo.messaging._drivers.impl_rabbit [-] [39c83939-a7ca-4419-8906-18d3d34dd571] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 09:08:04.344791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=4 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:04.345751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=20 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:04.346643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7fd8b696-2e49-4e1a-aa6a-669dd1bb8515 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Going to try to terminate instance {{(pid=124673) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 09:08:04.351043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7ddcad31-d1db-4b99-b454-554f63e73eb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:04.351697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7ddcad31-d1db-4b99-b454-554f63e73eb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:04.357971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ddcad31-d1db-4b99-b454-554f63e73eb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:04.361502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ddcad31-d1db-4b99-b454-554f63e73eb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:04.361502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ddcad31-d1db-4b99-b454-554f63e73eb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:04.361502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ddcad31-d1db-4b99-b454-554f63e73eb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:04.361502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ddcad31-d1db-4b99-b454-554f63e73eb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:04.361895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7ddcad31-d1db-4b99-b454-554f63e73eb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:04.388848 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7ddcad31-d1db-4b99-b454-554f63e73eb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 09:08:04.608752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7fd8b696-2e49-4e1a-aa6a-669dd1bb8515 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 204 len: 0 microversion: 2.1 time: 0.318687 Aug 08 09:08:04.609383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 855/1623] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 09:08:04 2022] DELETE /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 09:08:04.618329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3375f74c-ade3-44a0-81d8-f0ad3f3748a5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:04.619033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3375f74c-ade3-44a0-81d8-f0ad3f3748a5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:04.624846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3375f74c-ade3-44a0-81d8-f0ad3f3748a5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:04.625376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3375f74c-ade3-44a0-81d8-f0ad3f3748a5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:04.625818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3375f74c-ade3-44a0-81d8-f0ad3f3748a5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:04.626515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3375f74c-ade3-44a0-81d8-f0ad3f3748a5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:04.626973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3375f74c-ade3-44a0-81d8-f0ad3f3748a5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:04.627401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3375f74c-ade3-44a0-81d8-f0ad3f3748a5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:04.637414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7ddcad31-d1db-4b99-b454-554f63e73eb9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 204 len: 0 microversion: 2.1 time: 0.294636 Aug 08 09:08:04.638041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 769/1624] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 09:08:04 2022] DELETE /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 09:08:04.646430 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2fa4162f-912e-4f64-9a8d-666b3294e26c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:04.652072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2fa4162f-912e-4f64-9a8d-666b3294e26c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:04.653675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fa4162f-912e-4f64-9a8d-666b3294e26c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:04.654166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fa4162f-912e-4f64-9a8d-666b3294e26c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:04.654605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fa4162f-912e-4f64-9a8d-666b3294e26c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:04.655304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fa4162f-912e-4f64-9a8d-666b3294e26c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:04.655764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fa4162f-912e-4f64-9a8d-666b3294e26c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:04.656193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2fa4162f-912e-4f64-9a8d-666b3294e26c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:04.892696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3375f74c-ade3-44a0-81d8-f0ad3f3748a5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:04.900242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2fa4162f-912e-4f64-9a8d-666b3294e26c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:04.900930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3375f74c-ade3-44a0-81d8-f0ad3f3748a5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.287099 Aug 08 09:08:04.901533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 856/1625] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:04 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:08:04.908295 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2fa4162f-912e-4f64-9a8d-666b3294e26c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1600 microversion: 2.1 time: 0.265914 Aug 08 09:08:04.908848 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 770/1626] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1600 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:08:05.861640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2a96b11-9f37-47d2-92cf-6f6e0744a816] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56760. Aug 08 09:08:05.915552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-d3e0a403-dbbf-478c-b26e-fa600aea3c51 req-843f7cc7-0db9-4d63-954a-b62fef04be32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83365b2d-9f2c-4966-bdb6-789059348c37", "name": "network-vif-deleted", "tag": "19d95122-9b77-4b3d-adf8-fcfd43a61168"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 09:08:05.922723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ccf83ad1-5cb8-4410-8dbf-32c7a2dd672a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:05.925246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ccf83ad1-5cb8-4410-8dbf-32c7a2dd672a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:05.931483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf83ad1-5cb8-4410-8dbf-32c7a2dd672a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:05.931979 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf83ad1-5cb8-4410-8dbf-32c7a2dd672a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:05.932284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-d3e0a403-dbbf-478c-b26e-fa600aea3c51 req-843f7cc7-0db9-4d63-954a-b62fef04be32 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:05.932434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf83ad1-5cb8-4410-8dbf-32c7a2dd672a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:05.932768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-d3e0a403-dbbf-478c-b26e-fa600aea3c51 req-843f7cc7-0db9-4d63-954a-b62fef04be32 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:05.933107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf83ad1-5cb8-4410-8dbf-32c7a2dd672a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:05.933248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-d3e0a403-dbbf-478c-b26e-fa600aea3c51 req-843f7cc7-0db9-4d63-954a-b62fef04be32 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:05.933593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf83ad1-5cb8-4410-8dbf-32c7a2dd672a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:05.934044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf83ad1-5cb8-4410-8dbf-32c7a2dd672a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:05.948050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-d3e0a403-dbbf-478c-b26e-fa600aea3c51 req-843f7cc7-0db9-4d63-954a-b62fef04be32 service nova] Creating event network-vif-deleted:19d95122-9b77-4b3d-adf8-fcfd43a61168 for instance 83365b2d-9f2c-4966-bdb6-789059348c37 on hv-cinder-83697 Aug 08 09:08:05.951143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] [39c83939-a7ca-4419-8906-18d3d34dd571] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56766. Aug 08 09:08:05.953283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-d3e0a403-dbbf-478c-b26e-fa600aea3c51 req-843f7cc7-0db9-4d63-954a-b62fef04be32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105286 Aug 08 09:08:05.953872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 857/1627] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 09:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 09:08:05.959148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-348f06c1-0513-4be6-8874-4ec1badb5cd7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:05.960449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-348f06c1-0513-4be6-8874-4ec1badb5cd7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:05.967373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-348f06c1-0513-4be6-8874-4ec1badb5cd7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:05.967868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-348f06c1-0513-4be6-8874-4ec1badb5cd7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:05.968310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-348f06c1-0513-4be6-8874-4ec1badb5cd7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:05.969010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-348f06c1-0513-4be6-8874-4ec1badb5cd7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:05.969568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-348f06c1-0513-4be6-8874-4ec1badb5cd7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:05.970001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-348f06c1-0513-4be6-8874-4ec1badb5cd7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:06.040122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-348f06c1-0513-4be6-8874-4ec1badb5cd7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:06.048234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-348f06c1-0513-4be6-8874-4ec1badb5cd7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1558 microversion: 2.1 time: 0.093017 Aug 08 09:08:06.048732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 858/1628] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:05 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1558 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:06.102709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ccf83ad1-5cb8-4410-8dbf-32c7a2dd672a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:06.111002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ccf83ad1-5cb8-4410-8dbf-32c7a2dd672a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.192088 Aug 08 09:08:06.111548 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 771/1629] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:05 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:08:07.070020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4a8c2a90-69ad-4937-a2e6-02a954735c30 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:07.070641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4a8c2a90-69ad-4937-a2e6-02a954735c30 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:07.077025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a8c2a90-69ad-4937-a2e6-02a954735c30 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:07.077538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a8c2a90-69ad-4937-a2e6-02a954735c30 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:07.077976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a8c2a90-69ad-4937-a2e6-02a954735c30 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:07.078660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a8c2a90-69ad-4937-a2e6-02a954735c30 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:07.079114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a8c2a90-69ad-4937-a2e6-02a954735c30 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:07.079540 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4a8c2a90-69ad-4937-a2e6-02a954735c30 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:07.132584 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-24ac7dfe-a63f-4a33-9413-4f917fe96899 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:07.133217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-24ac7dfe-a63f-4a33-9413-4f917fe96899 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:07.139683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24ac7dfe-a63f-4a33-9413-4f917fe96899 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:07.140169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24ac7dfe-a63f-4a33-9413-4f917fe96899 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:07.140607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24ac7dfe-a63f-4a33-9413-4f917fe96899 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:07.141466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24ac7dfe-a63f-4a33-9413-4f917fe96899 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:07.141779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24ac7dfe-a63f-4a33-9413-4f917fe96899 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:07.142208 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24ac7dfe-a63f-4a33-9413-4f917fe96899 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:07.143459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4a8c2a90-69ad-4937-a2e6-02a954735c30 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:07.152520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4a8c2a90-69ad-4937-a2e6-02a954735c30 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087062 Aug 08 09:08:07.153086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 859/1630] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:07 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:07.272886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-24ac7dfe-a63f-4a33-9413-4f917fe96899 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:07.280698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-24ac7dfe-a63f-4a33-9413-4f917fe96899 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152725 Aug 08 09:08:07.281278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 772/1631] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:07 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:08:08.173290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e0c7cc80-cfc0-404f-982e-a3c3ebef0d81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:08.173943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e0c7cc80-cfc0-404f-982e-a3c3ebef0d81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:08.180863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc80-cfc0-404f-982e-a3c3ebef0d81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:08.180994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc80-cfc0-404f-982e-a3c3ebef0d81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:08.181406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc80-cfc0-404f-982e-a3c3ebef0d81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:08.182102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc80-cfc0-404f-982e-a3c3ebef0d81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:08.182562 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc80-cfc0-404f-982e-a3c3ebef0d81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:08.182996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0c7cc80-cfc0-404f-982e-a3c3ebef0d81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:08.244369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e0c7cc80-cfc0-404f-982e-a3c3ebef0d81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:08.252307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e0c7cc80-cfc0-404f-982e-a3c3ebef0d81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083014 Aug 08 09:08:08.252861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 860/1632] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:08 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:08.300750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-267bea11-af55-4e8c-b614-dcfb3cfca901 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:08.301382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-267bea11-af55-4e8c-b614-dcfb3cfca901 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:08.308289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267bea11-af55-4e8c-b614-dcfb3cfca901 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:08.308748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267bea11-af55-4e8c-b614-dcfb3cfca901 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:08.309203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267bea11-af55-4e8c-b614-dcfb3cfca901 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:08.309890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267bea11-af55-4e8c-b614-dcfb3cfca901 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:08.310341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267bea11-af55-4e8c-b614-dcfb3cfca901 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:08.310763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267bea11-af55-4e8c-b614-dcfb3cfca901 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:08.440698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-267bea11-af55-4e8c-b614-dcfb3cfca901 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:08.449165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-267bea11-af55-4e8c-b614-dcfb3cfca901 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152246 Aug 08 09:08:08.449722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 773/1633] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:08 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:09.274189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-35444fca-b2c4-4a53-9496-94cb73db1e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:09.274805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-35444fca-b2c4-4a53-9496-94cb73db1e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:09.281129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35444fca-b2c4-4a53-9496-94cb73db1e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:09.281647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35444fca-b2c4-4a53-9496-94cb73db1e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:09.282082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35444fca-b2c4-4a53-9496-94cb73db1e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:09.282775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35444fca-b2c4-4a53-9496-94cb73db1e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:09.283235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35444fca-b2c4-4a53-9496-94cb73db1e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:09.283670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35444fca-b2c4-4a53-9496-94cb73db1e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:09.344571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-35444fca-b2c4-4a53-9496-94cb73db1e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:09.352536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-35444fca-b2c4-4a53-9496-94cb73db1e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082722 Aug 08 09:08:09.353099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 861/1634] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:09.470410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-897056d0-7da1-4794-9f1d-32bf89c8b600 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:09.471018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-897056d0-7da1-4794-9f1d-32bf89c8b600 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:09.477365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-897056d0-7da1-4794-9f1d-32bf89c8b600 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:09.477855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-897056d0-7da1-4794-9f1d-32bf89c8b600 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:09.478289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-897056d0-7da1-4794-9f1d-32bf89c8b600 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:09.478970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-897056d0-7da1-4794-9f1d-32bf89c8b600 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:09.479418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-897056d0-7da1-4794-9f1d-32bf89c8b600 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:09.479837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-897056d0-7da1-4794-9f1d-32bf89c8b600 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:09.605889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-897056d0-7da1-4794-9f1d-32bf89c8b600 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:09.613766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-897056d0-7da1-4794-9f1d-32bf89c8b600 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.147205 Aug 08 09:08:09.614337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 774/1635] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:09 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:10.373284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5a18f7a1-eae3-4192-9e74-df07ce43e823 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:10.373891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5a18f7a1-eae3-4192-9e74-df07ce43e823 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:10.380424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a18f7a1-eae3-4192-9e74-df07ce43e823 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:10.380850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a18f7a1-eae3-4192-9e74-df07ce43e823 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:10.381349 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a18f7a1-eae3-4192-9e74-df07ce43e823 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:10.382034 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a18f7a1-eae3-4192-9e74-df07ce43e823 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:10.382480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a18f7a1-eae3-4192-9e74-df07ce43e823 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:10.382900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5a18f7a1-eae3-4192-9e74-df07ce43e823 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:10.445843 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5a18f7a1-eae3-4192-9e74-df07ce43e823 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:10.453707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5a18f7a1-eae3-4192-9e74-df07ce43e823 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084297 Aug 08 09:08:10.454267 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 862/1636] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:10 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:10.634566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f6e1d0af-ac33-485a-98c6-6bb150454c29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:10.635113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f6e1d0af-ac33-485a-98c6-6bb150454c29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:10.641534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6e1d0af-ac33-485a-98c6-6bb150454c29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:10.642018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6e1d0af-ac33-485a-98c6-6bb150454c29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:10.642453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6e1d0af-ac33-485a-98c6-6bb150454c29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:10.643137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6e1d0af-ac33-485a-98c6-6bb150454c29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:10.643593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6e1d0af-ac33-485a-98c6-6bb150454c29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:10.644016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6e1d0af-ac33-485a-98c6-6bb150454c29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:10.773799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f6e1d0af-ac33-485a-98c6-6bb150454c29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:10.781721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f6e1d0af-ac33-485a-98c6-6bb150454c29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151692 Aug 08 09:08:10.782288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 775/1637] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:10 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:11.474456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c4c824e8-170b-4d15-96db-06fba2c8c7c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:11.475272 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c4c824e8-170b-4d15-96db-06fba2c8c7c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:11.481719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4c824e8-170b-4d15-96db-06fba2c8c7c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:11.482202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4c824e8-170b-4d15-96db-06fba2c8c7c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:11.482658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4c824e8-170b-4d15-96db-06fba2c8c7c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:11.483330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4c824e8-170b-4d15-96db-06fba2c8c7c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:11.483785 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4c824e8-170b-4d15-96db-06fba2c8c7c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:11.484211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c4c824e8-170b-4d15-96db-06fba2c8c7c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:11.546230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c4c824e8-170b-4d15-96db-06fba2c8c7c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:11.554648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c4c824e8-170b-4d15-96db-06fba2c8c7c8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084064 Aug 08 09:08:11.555202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 863/1638] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:11 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:11.803786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-564e94d5-7e29-4d20-9672-bb6120ba3abc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:11.804325 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-564e94d5-7e29-4d20-9672-bb6120ba3abc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:11.810703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-564e94d5-7e29-4d20-9672-bb6120ba3abc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:11.811186 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-564e94d5-7e29-4d20-9672-bb6120ba3abc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:11.811620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-564e94d5-7e29-4d20-9672-bb6120ba3abc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:11.812309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-564e94d5-7e29-4d20-9672-bb6120ba3abc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:11.812761 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-564e94d5-7e29-4d20-9672-bb6120ba3abc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:11.813215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-564e94d5-7e29-4d20-9672-bb6120ba3abc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:11.941917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-564e94d5-7e29-4d20-9672-bb6120ba3abc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:11.949965 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-564e94d5-7e29-4d20-9672-bb6120ba3abc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150701 Aug 08 09:08:11.950529 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 776/1639] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:11 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:12.575619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-89999183-c02b-4cd4-928f-045275be3337 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:12.576226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-89999183-c02b-4cd4-928f-045275be3337 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:12.582524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89999183-c02b-4cd4-928f-045275be3337 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:12.583001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89999183-c02b-4cd4-928f-045275be3337 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:12.583432 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89999183-c02b-4cd4-928f-045275be3337 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:12.584209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89999183-c02b-4cd4-928f-045275be3337 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:12.585180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89999183-c02b-4cd4-928f-045275be3337 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:12.585595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89999183-c02b-4cd4-928f-045275be3337 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:12.646118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-89999183-c02b-4cd4-928f-045275be3337 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:12.654599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-89999183-c02b-4cd4-928f-045275be3337 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082835 Aug 08 09:08:12.655148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 864/1640] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:12 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:12.971553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f01a7cae-1f19-414f-bd04-9e361af769d2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:12.972165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f01a7cae-1f19-414f-bd04-9e361af769d2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:12.978537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f01a7cae-1f19-414f-bd04-9e361af769d2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:12.979015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f01a7cae-1f19-414f-bd04-9e361af769d2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:12.979444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f01a7cae-1f19-414f-bd04-9e361af769d2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:12.980123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f01a7cae-1f19-414f-bd04-9e361af769d2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:12.980571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f01a7cae-1f19-414f-bd04-9e361af769d2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:12.980990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f01a7cae-1f19-414f-bd04-9e361af769d2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:13.108263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f01a7cae-1f19-414f-bd04-9e361af769d2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:13.116719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f01a7cae-1f19-414f-bd04-9e361af769d2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148977 Aug 08 09:08:13.117306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 777/1641] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:12 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:13.675599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ae496b4d-d47b-428c-a322-30656c280e12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:13.676123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ae496b4d-d47b-428c-a322-30656c280e12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:13.683100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae496b4d-d47b-428c-a322-30656c280e12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:13.683589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae496b4d-d47b-428c-a322-30656c280e12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:13.684031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae496b4d-d47b-428c-a322-30656c280e12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:13.684748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae496b4d-d47b-428c-a322-30656c280e12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:13.685234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae496b4d-d47b-428c-a322-30656c280e12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:13.685666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae496b4d-d47b-428c-a322-30656c280e12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:13.749220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ae496b4d-d47b-428c-a322-30656c280e12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:13.757873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ae496b4d-d47b-428c-a322-30656c280e12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086247 Aug 08 09:08:13.758440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 865/1642] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:14.140490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fa70fb65-d84e-4d01-8b27-15adf45860cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:14.141091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fa70fb65-d84e-4d01-8b27-15adf45860cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:14.148156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa70fb65-d84e-4d01-8b27-15adf45860cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:14.148633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa70fb65-d84e-4d01-8b27-15adf45860cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:14.149064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa70fb65-d84e-4d01-8b27-15adf45860cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:14.149781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa70fb65-d84e-4d01-8b27-15adf45860cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:14.150234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa70fb65-d84e-4d01-8b27-15adf45860cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:14.150656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fa70fb65-d84e-4d01-8b27-15adf45860cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:14.279158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fa70fb65-d84e-4d01-8b27-15adf45860cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:14.286967 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fa70fb65-d84e-4d01-8b27-15adf45860cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150339 Aug 08 09:08:14.287581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 778/1643] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:14 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:08:14.778251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0742dfdd-5ac9-47a9-aef6-b71eceb9ee95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:14.778870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0742dfdd-5ac9-47a9-aef6-b71eceb9ee95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:14.785344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0742dfdd-5ac9-47a9-aef6-b71eceb9ee95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:14.785827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0742dfdd-5ac9-47a9-aef6-b71eceb9ee95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:14.786266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0742dfdd-5ac9-47a9-aef6-b71eceb9ee95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:14.786949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0742dfdd-5ac9-47a9-aef6-b71eceb9ee95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:14.788094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0742dfdd-5ac9-47a9-aef6-b71eceb9ee95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:14.788533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0742dfdd-5ac9-47a9-aef6-b71eceb9ee95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:14.848018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0742dfdd-5ac9-47a9-aef6-b71eceb9ee95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:14.856503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0742dfdd-5ac9-47a9-aef6-b71eceb9ee95 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082094 Aug 08 09:08:14.857208 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 866/1644] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:15.308400 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d299e9ab-9853-4c03-a904-4d0b06299840 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:15.308993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d299e9ab-9853-4c03-a904-4d0b06299840 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:15.315519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d299e9ab-9853-4c03-a904-4d0b06299840 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:15.316004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d299e9ab-9853-4c03-a904-4d0b06299840 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:15.316439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d299e9ab-9853-4c03-a904-4d0b06299840 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:15.317134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d299e9ab-9853-4c03-a904-4d0b06299840 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:15.317611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d299e9ab-9853-4c03-a904-4d0b06299840 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:15.318039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d299e9ab-9853-4c03-a904-4d0b06299840 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:15.450387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d299e9ab-9853-4c03-a904-4d0b06299840 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:15.458211 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d299e9ab-9853-4c03-a904-4d0b06299840 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153666 Aug 08 09:08:15.458803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 779/1645] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:15 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:15.877886 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-26c97f3d-2583-4417-ae08-4d5403f89e3c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:15.878512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-26c97f3d-2583-4417-ae08-4d5403f89e3c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:15.885880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26c97f3d-2583-4417-ae08-4d5403f89e3c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:15.886369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26c97f3d-2583-4417-ae08-4d5403f89e3c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:15.886814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26c97f3d-2583-4417-ae08-4d5403f89e3c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:15.887512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26c97f3d-2583-4417-ae08-4d5403f89e3c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:15.887972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26c97f3d-2583-4417-ae08-4d5403f89e3c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:15.888399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26c97f3d-2583-4417-ae08-4d5403f89e3c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:15.950227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-26c97f3d-2583-4417-ae08-4d5403f89e3c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:15.958188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-26c97f3d-2583-4417-ae08-4d5403f89e3c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084152 Aug 08 09:08:15.958784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 867/1646] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:15 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:16.480192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-07fca054-510f-42df-92fa-42c3e5520a29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:16.480805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-07fca054-510f-42df-92fa-42c3e5520a29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:16.487199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07fca054-510f-42df-92fa-42c3e5520a29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:16.487678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07fca054-510f-42df-92fa-42c3e5520a29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:16.488109 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07fca054-510f-42df-92fa-42c3e5520a29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:16.488791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07fca054-510f-42df-92fa-42c3e5520a29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:16.489272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07fca054-510f-42df-92fa-42c3e5520a29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:16.489696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-07fca054-510f-42df-92fa-42c3e5520a29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:16.616126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-07fca054-510f-42df-92fa-42c3e5520a29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:16.624051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-07fca054-510f-42df-92fa-42c3e5520a29 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.147739 Aug 08 09:08:16.624620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 780/1647] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:16 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:16.977955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-85f4ee27-b5aa-4a99-927e-fef8df386f66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:16.978568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-85f4ee27-b5aa-4a99-927e-fef8df386f66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:16.984891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85f4ee27-b5aa-4a99-927e-fef8df386f66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:16.985401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85f4ee27-b5aa-4a99-927e-fef8df386f66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:16.985841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85f4ee27-b5aa-4a99-927e-fef8df386f66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:16.986528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85f4ee27-b5aa-4a99-927e-fef8df386f66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:16.986982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85f4ee27-b5aa-4a99-927e-fef8df386f66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:16.987409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-85f4ee27-b5aa-4a99-927e-fef8df386f66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:17.050601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-85f4ee27-b5aa-4a99-927e-fef8df386f66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:17.058787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-85f4ee27-b5aa-4a99-927e-fef8df386f66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084679 Aug 08 09:08:17.059345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 868/1648] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:17.645164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5d27df44-9120-4097-ab1d-dab0f21980d4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:17.645805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5d27df44-9120-4097-ab1d-dab0f21980d4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:17.652761 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d27df44-9120-4097-ab1d-dab0f21980d4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:17.653284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d27df44-9120-4097-ab1d-dab0f21980d4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:17.653725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d27df44-9120-4097-ab1d-dab0f21980d4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:17.654417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d27df44-9120-4097-ab1d-dab0f21980d4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:17.654872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d27df44-9120-4097-ab1d-dab0f21980d4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:17.655296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d27df44-9120-4097-ab1d-dab0f21980d4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:17.784487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5d27df44-9120-4097-ab1d-dab0f21980d4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:17.792490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5d27df44-9120-4097-ab1d-dab0f21980d4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151198 Aug 08 09:08:17.793054 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 781/1649] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:17 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:18.079909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0b565539-57de-4512-ae4d-5689e31db42e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:18.080439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0b565539-57de-4512-ae4d-5689e31db42e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:18.087108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b565539-57de-4512-ae4d-5689e31db42e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:18.087587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b565539-57de-4512-ae4d-5689e31db42e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:18.088138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b565539-57de-4512-ae4d-5689e31db42e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:18.088869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b565539-57de-4512-ae4d-5689e31db42e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:18.089370 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b565539-57de-4512-ae4d-5689e31db42e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:18.089804 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b565539-57de-4512-ae4d-5689e31db42e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:18.150351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0b565539-57de-4512-ae4d-5689e31db42e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:18.158226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0b565539-57de-4512-ae4d-5689e31db42e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082194 Aug 08 09:08:18.158778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 869/1650] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:18 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:18.780413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:08:18.780882 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:08:18.813270 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0e7da89a-7d8e-4819-af7d-831d85b8fcd6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:18.813885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0e7da89a-7d8e-4819-af7d-831d85b8fcd6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:18.820282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e7da89a-7d8e-4819-af7d-831d85b8fcd6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:18.820806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e7da89a-7d8e-4819-af7d-831d85b8fcd6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:18.821267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e7da89a-7d8e-4819-af7d-831d85b8fcd6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:18.821961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e7da89a-7d8e-4819-af7d-831d85b8fcd6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:18.822417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e7da89a-7d8e-4819-af7d-831d85b8fcd6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:18.822843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e7da89a-7d8e-4819-af7d-831d85b8fcd6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:18.952980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0e7da89a-7d8e-4819-af7d-831d85b8fcd6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:18.961415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0e7da89a-7d8e-4819-af7d-831d85b8fcd6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151849 Aug 08 09:08:18.961978 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 782/1651] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:18 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:19.187803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7438a3d2-233a-46c2-a402-d5a02b71a922 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:19.188414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7438a3d2-233a-46c2-a402-d5a02b71a922 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:19.195233 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7438a3d2-233a-46c2-a402-d5a02b71a922 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:19.195706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7438a3d2-233a-46c2-a402-d5a02b71a922 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:19.196137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7438a3d2-233a-46c2-a402-d5a02b71a922 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:19.196819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7438a3d2-233a-46c2-a402-d5a02b71a922 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:19.197294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7438a3d2-233a-46c2-a402-d5a02b71a922 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:19.197718 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7438a3d2-233a-46c2-a402-d5a02b71a922 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:19.215671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:19.259754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7438a3d2-233a-46c2-a402-d5a02b71a922 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:19.268426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7438a3d2-233a-46c2-a402-d5a02b71a922 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084436 Aug 08 09:08:19.268981 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 870/1652] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:19.981837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ef132a88-2b81-4fdd-9417-af3d1daa3665 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:19.982443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ef132a88-2b81-4fdd-9417-af3d1daa3665 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:19.988804 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef132a88-2b81-4fdd-9417-af3d1daa3665 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:19.989315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef132a88-2b81-4fdd-9417-af3d1daa3665 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:19.989747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef132a88-2b81-4fdd-9417-af3d1daa3665 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:19.990471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef132a88-2b81-4fdd-9417-af3d1daa3665 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:19.991028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef132a88-2b81-4fdd-9417-af3d1daa3665 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:19.991450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef132a88-2b81-4fdd-9417-af3d1daa3665 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:20.118871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ef132a88-2b81-4fdd-9417-af3d1daa3665 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:20.122313 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:20.127062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ef132a88-2b81-4fdd-9417-af3d1daa3665 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149130 Aug 08 09:08:20.129329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 783/1653] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:19 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:20.288670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cc8f1773-6c33-4e87-811f-fb0f713cfbe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:20.289240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cc8f1773-6c33-4e87-811f-fb0f713cfbe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:20.295968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8f1773-6c33-4e87-811f-fb0f713cfbe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:20.296443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8f1773-6c33-4e87-811f-fb0f713cfbe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:20.296873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8f1773-6c33-4e87-811f-fb0f713cfbe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:20.297579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8f1773-6c33-4e87-811f-fb0f713cfbe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:20.298024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8f1773-6c33-4e87-811f-fb0f713cfbe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:20.298443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8f1773-6c33-4e87-811f-fb0f713cfbe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:20.361128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cc8f1773-6c33-4e87-811f-fb0f713cfbe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:20.371654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cc8f1773-6c33-4e87-811f-fb0f713cfbe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087123 Aug 08 09:08:20.372218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 871/1654] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:20 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:21.149735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3e12c1d1-564a-4478-aa93-3ccf19b8d7cf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:21.150358 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3e12c1d1-564a-4478-aa93-3ccf19b8d7cf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:21.157381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e12c1d1-564a-4478-aa93-3ccf19b8d7cf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:21.161540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e12c1d1-564a-4478-aa93-3ccf19b8d7cf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:21.161540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e12c1d1-564a-4478-aa93-3ccf19b8d7cf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:21.161540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e12c1d1-564a-4478-aa93-3ccf19b8d7cf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:21.161540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e12c1d1-564a-4478-aa93-3ccf19b8d7cf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:21.162015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e12c1d1-564a-4478-aa93-3ccf19b8d7cf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:21.293855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3e12c1d1-564a-4478-aa93-3ccf19b8d7cf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:21.301885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3e12c1d1-564a-4478-aa93-3ccf19b8d7cf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.156634 Aug 08 09:08:21.302443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 784/1655] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:21 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:21.393403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cba9c17d-c55d-49f0-9cbb-5d19ab7da596 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:21.394046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cba9c17d-c55d-49f0-9cbb-5d19ab7da596 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:21.403066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cba9c17d-c55d-49f0-9cbb-5d19ab7da596 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:21.403778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cba9c17d-c55d-49f0-9cbb-5d19ab7da596 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:21.404526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cba9c17d-c55d-49f0-9cbb-5d19ab7da596 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:21.405705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cba9c17d-c55d-49f0-9cbb-5d19ab7da596 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:21.406481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cba9c17d-c55d-49f0-9cbb-5d19ab7da596 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:21.407211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cba9c17d-c55d-49f0-9cbb-5d19ab7da596 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:21.479984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cba9c17d-c55d-49f0-9cbb-5d19ab7da596 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:21.488674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cba9c17d-c55d-49f0-9cbb-5d19ab7da596 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.099182 Aug 08 09:08:21.489263 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 872/1656] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:21 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:22.322091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3f4597f8-576d-42b9-a8c9-64076f7e6781 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:22.322768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3f4597f8-576d-42b9-a8c9-64076f7e6781 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:22.329191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f4597f8-576d-42b9-a8c9-64076f7e6781 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:22.329682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f4597f8-576d-42b9-a8c9-64076f7e6781 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:22.330123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f4597f8-576d-42b9-a8c9-64076f7e6781 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:22.330817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f4597f8-576d-42b9-a8c9-64076f7e6781 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:22.331273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f4597f8-576d-42b9-a8c9-64076f7e6781 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:22.331700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f4597f8-576d-42b9-a8c9-64076f7e6781 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:22.463692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3f4597f8-576d-42b9-a8c9-64076f7e6781 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:22.471595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3f4597f8-576d-42b9-a8c9-64076f7e6781 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153580 Aug 08 09:08:22.472155 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 785/1657] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:22 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:22.508946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-add82fef-670c-472c-af24-d38dfe594730 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:22.509595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-add82fef-670c-472c-af24-d38dfe594730 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:22.516068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-add82fef-670c-472c-af24-d38dfe594730 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:22.516551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-add82fef-670c-472c-af24-d38dfe594730 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:22.516993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-add82fef-670c-472c-af24-d38dfe594730 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:22.517729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-add82fef-670c-472c-af24-d38dfe594730 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:22.518187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-add82fef-670c-472c-af24-d38dfe594730 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:22.518614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-add82fef-670c-472c-af24-d38dfe594730 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:22.578884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-add82fef-670c-472c-af24-d38dfe594730 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:22.587441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-add82fef-670c-472c-af24-d38dfe594730 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082804 Aug 08 09:08:22.588000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 873/1658] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:23.494020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-df1bd8db-06e9-41fa-8a50-e7b9ea30416b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:23.494638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-df1bd8db-06e9-41fa-8a50-e7b9ea30416b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:23.501263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df1bd8db-06e9-41fa-8a50-e7b9ea30416b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:23.501751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df1bd8db-06e9-41fa-8a50-e7b9ea30416b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:23.502210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df1bd8db-06e9-41fa-8a50-e7b9ea30416b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:23.502889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df1bd8db-06e9-41fa-8a50-e7b9ea30416b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:23.503349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df1bd8db-06e9-41fa-8a50-e7b9ea30416b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:23.503779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df1bd8db-06e9-41fa-8a50-e7b9ea30416b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:23.607799 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e7c9f4ce-6eb5-4b43-9471-b8ce1613672c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:23.608411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e7c9f4ce-6eb5-4b43-9471-b8ce1613672c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:23.614641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c9f4ce-6eb5-4b43-9471-b8ce1613672c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:23.615124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c9f4ce-6eb5-4b43-9471-b8ce1613672c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:23.615571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c9f4ce-6eb5-4b43-9471-b8ce1613672c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:23.616252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c9f4ce-6eb5-4b43-9471-b8ce1613672c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:23.616704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c9f4ce-6eb5-4b43-9471-b8ce1613672c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:23.617127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7c9f4ce-6eb5-4b43-9471-b8ce1613672c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:23.633371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-df1bd8db-06e9-41fa-8a50-e7b9ea30416b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:23.641651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-df1bd8db-06e9-41fa-8a50-e7b9ea30416b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151528 Aug 08 09:08:23.642453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 786/1659] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:23 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:23.684842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e7c9f4ce-6eb5-4b43-9471-b8ce1613672c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:23.692848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e7c9f4ce-6eb5-4b43-9471-b8ce1613672c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.088811 Aug 08 09:08:23.694023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 874/1660] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:08:24.663914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1e4001f3-d8cf-42de-9cd1-744e0e6a71cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:24.664532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1e4001f3-d8cf-42de-9cd1-744e0e6a71cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:24.671014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e4001f3-d8cf-42de-9cd1-744e0e6a71cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:24.671450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e4001f3-d8cf-42de-9cd1-744e0e6a71cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:24.671892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e4001f3-d8cf-42de-9cd1-744e0e6a71cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:24.672586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e4001f3-d8cf-42de-9cd1-744e0e6a71cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:24.673045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e4001f3-d8cf-42de-9cd1-744e0e6a71cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:24.673500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e4001f3-d8cf-42de-9cd1-744e0e6a71cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:24.714892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fb3f549e-72d6-401e-9834-c1f5be2a20a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:24.715504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fb3f549e-72d6-401e-9834-c1f5be2a20a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:24.722092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb3f549e-72d6-401e-9834-c1f5be2a20a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:24.722580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb3f549e-72d6-401e-9834-c1f5be2a20a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:24.723041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb3f549e-72d6-401e-9834-c1f5be2a20a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:24.723744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb3f549e-72d6-401e-9834-c1f5be2a20a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:24.724199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb3f549e-72d6-401e-9834-c1f5be2a20a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:24.724682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb3f549e-72d6-401e-9834-c1f5be2a20a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:24.795229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fb3f549e-72d6-401e-9834-c1f5be2a20a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:24.803562 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fb3f549e-72d6-401e-9834-c1f5be2a20a4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.091882 Aug 08 09:08:24.804133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 875/1661] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:24 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:08:24.824869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1e4001f3-d8cf-42de-9cd1-744e0e6a71cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:24.832809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1e4001f3-d8cf-42de-9cd1-744e0e6a71cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.172889 Aug 08 09:08:24.833417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 787/1662] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:24 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:25.823741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1a371686-6a93-47a1-b61d-5ea1f1d1b0b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:25.824361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1a371686-6a93-47a1-b61d-5ea1f1d1b0b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:25.830756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a371686-6a93-47a1-b61d-5ea1f1d1b0b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:25.831246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a371686-6a93-47a1-b61d-5ea1f1d1b0b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:25.831686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a371686-6a93-47a1-b61d-5ea1f1d1b0b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:25.832406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a371686-6a93-47a1-b61d-5ea1f1d1b0b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:25.832842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a371686-6a93-47a1-b61d-5ea1f1d1b0b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:25.833307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a371686-6a93-47a1-b61d-5ea1f1d1b0b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:25.853823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ba1b387a-001f-4307-8bde-79e85e2b2827 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:25.854444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ba1b387a-001f-4307-8bde-79e85e2b2827 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:25.860876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba1b387a-001f-4307-8bde-79e85e2b2827 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:25.861409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba1b387a-001f-4307-8bde-79e85e2b2827 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:25.861852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba1b387a-001f-4307-8bde-79e85e2b2827 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:25.862546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba1b387a-001f-4307-8bde-79e85e2b2827 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:25.863003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba1b387a-001f-4307-8bde-79e85e2b2827 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:25.863434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ba1b387a-001f-4307-8bde-79e85e2b2827 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:25.894916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1a371686-6a93-47a1-b61d-5ea1f1d1b0b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:25.903745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1a371686-6a93-47a1-b61d-5ea1f1d1b0b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083891 Aug 08 09:08:25.905025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 876/1663] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:25.994037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ba1b387a-001f-4307-8bde-79e85e2b2827 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:26.002082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ba1b387a-001f-4307-8bde-79e85e2b2827 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152291 Aug 08 09:08:26.002654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 788/1664] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:25 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:26.923772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-30c9b20e-5c9d-4551-901d-e9e3c5bee99f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:26.924393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-30c9b20e-5c9d-4551-901d-e9e3c5bee99f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:26.931676 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30c9b20e-5c9d-4551-901d-e9e3c5bee99f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:26.932188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30c9b20e-5c9d-4551-901d-e9e3c5bee99f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:26.932620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30c9b20e-5c9d-4551-901d-e9e3c5bee99f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:26.933351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30c9b20e-5c9d-4551-901d-e9e3c5bee99f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:26.933807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30c9b20e-5c9d-4551-901d-e9e3c5bee99f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:26.934230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30c9b20e-5c9d-4551-901d-e9e3c5bee99f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:26.994329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-30c9b20e-5c9d-4551-901d-e9e3c5bee99f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:27.002091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-30c9b20e-5c9d-4551-901d-e9e3c5bee99f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082220 Aug 08 09:08:27.002641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 877/1665] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:27.024061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-35435aea-3a44-45d0-b5bd-e5f0cf90e7a1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:27.024663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-35435aea-3a44-45d0-b5bd-e5f0cf90e7a1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:27.030976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35435aea-3a44-45d0-b5bd-e5f0cf90e7a1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:27.031454 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35435aea-3a44-45d0-b5bd-e5f0cf90e7a1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:27.031887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35435aea-3a44-45d0-b5bd-e5f0cf90e7a1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:27.032572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35435aea-3a44-45d0-b5bd-e5f0cf90e7a1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:27.033024 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35435aea-3a44-45d0-b5bd-e5f0cf90e7a1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:27.033472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35435aea-3a44-45d0-b5bd-e5f0cf90e7a1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:27.160985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-35435aea-3a44-45d0-b5bd-e5f0cf90e7a1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:27.169648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-35435aea-3a44-45d0-b5bd-e5f0cf90e7a1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149836 Aug 08 09:08:27.170221 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 789/1666] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:27 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:28.022864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-719e5f95-115f-4f81-ab38-759d5cb3a583 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:28.023506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-719e5f95-115f-4f81-ab38-759d5cb3a583 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:28.029914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-719e5f95-115f-4f81-ab38-759d5cb3a583 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:28.030396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-719e5f95-115f-4f81-ab38-759d5cb3a583 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:28.030836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-719e5f95-115f-4f81-ab38-759d5cb3a583 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:28.031517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-719e5f95-115f-4f81-ab38-759d5cb3a583 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:28.031974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-719e5f95-115f-4f81-ab38-759d5cb3a583 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:28.032398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-719e5f95-115f-4f81-ab38-759d5cb3a583 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:28.096748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-719e5f95-115f-4f81-ab38-759d5cb3a583 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:28.105195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-719e5f95-115f-4f81-ab38-759d5cb3a583 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086238 Aug 08 09:08:28.105757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 878/1667] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:28 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:28.191680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b852d2fb-413e-4d3e-b53b-c3e46038c405 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:28.192300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b852d2fb-413e-4d3e-b53b-c3e46038c405 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:28.198906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b852d2fb-413e-4d3e-b53b-c3e46038c405 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:28.201652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b852d2fb-413e-4d3e-b53b-c3e46038c405 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:28.201652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b852d2fb-413e-4d3e-b53b-c3e46038c405 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:28.201652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b852d2fb-413e-4d3e-b53b-c3e46038c405 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:28.201652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b852d2fb-413e-4d3e-b53b-c3e46038c405 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:28.202117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b852d2fb-413e-4d3e-b53b-c3e46038c405 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:28.328359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b852d2fb-413e-4d3e-b53b-c3e46038c405 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:28.336301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b852d2fb-413e-4d3e-b53b-c3e46038c405 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148877 Aug 08 09:08:28.336866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 790/1668] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:28 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:29.126113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5eec27cf-468e-46da-af39-41eeffe33e01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:29.126796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5eec27cf-468e-46da-af39-41eeffe33e01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:29.133433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5eec27cf-468e-46da-af39-41eeffe33e01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:29.133918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5eec27cf-468e-46da-af39-41eeffe33e01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:29.134357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5eec27cf-468e-46da-af39-41eeffe33e01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:29.135077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5eec27cf-468e-46da-af39-41eeffe33e01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:29.135566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5eec27cf-468e-46da-af39-41eeffe33e01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:29.135992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5eec27cf-468e-46da-af39-41eeffe33e01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:29.196713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5eec27cf-468e-46da-af39-41eeffe33e01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:29.204529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5eec27cf-468e-46da-af39-41eeffe33e01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082273 Aug 08 09:08:29.205083 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 879/1669] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:29 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:29.357029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9d7a07d0-8044-4f60-a8cf-81bb5fed74dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:29.357671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9d7a07d0-8044-4f60-a8cf-81bb5fed74dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:29.364250 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d7a07d0-8044-4f60-a8cf-81bb5fed74dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:29.364732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d7a07d0-8044-4f60-a8cf-81bb5fed74dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:29.365192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d7a07d0-8044-4f60-a8cf-81bb5fed74dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:29.365886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d7a07d0-8044-4f60-a8cf-81bb5fed74dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:29.366397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d7a07d0-8044-4f60-a8cf-81bb5fed74dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:29.366840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d7a07d0-8044-4f60-a8cf-81bb5fed74dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:29.497373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9d7a07d0-8044-4f60-a8cf-81bb5fed74dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:29.505864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9d7a07d0-8044-4f60-a8cf-81bb5fed74dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152357 Aug 08 09:08:29.506422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 791/1670] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:29 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:30.225804 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-522a850b-46d0-4a54-9e2b-16b273448883 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:30.226415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-522a850b-46d0-4a54-9e2b-16b273448883 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:30.232718 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-522a850b-46d0-4a54-9e2b-16b273448883 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:30.233225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-522a850b-46d0-4a54-9e2b-16b273448883 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:30.233660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-522a850b-46d0-4a54-9e2b-16b273448883 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:30.234343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-522a850b-46d0-4a54-9e2b-16b273448883 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:30.234792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-522a850b-46d0-4a54-9e2b-16b273448883 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:30.235214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-522a850b-46d0-4a54-9e2b-16b273448883 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:30.296826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-522a850b-46d0-4a54-9e2b-16b273448883 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:30.306533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-522a850b-46d0-4a54-9e2b-16b273448883 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084580 Aug 08 09:08:30.307107 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 880/1671] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:30 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:30.527190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f2aa2cad-c84c-4db5-9bea-5ff8470981df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:30.527806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f2aa2cad-c84c-4db5-9bea-5ff8470981df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:30.534212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2aa2cad-c84c-4db5-9bea-5ff8470981df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:30.534705 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2aa2cad-c84c-4db5-9bea-5ff8470981df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:30.535147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2aa2cad-c84c-4db5-9bea-5ff8470981df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:30.535845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2aa2cad-c84c-4db5-9bea-5ff8470981df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:30.536304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2aa2cad-c84c-4db5-9bea-5ff8470981df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:30.536735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f2aa2cad-c84c-4db5-9bea-5ff8470981df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:30.666062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f2aa2cad-c84c-4db5-9bea-5ff8470981df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:30.674013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f2aa2cad-c84c-4db5-9bea-5ff8470981df tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150687 Aug 08 09:08:30.674509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 792/1672] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:30 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:31.327185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-13384745-b983-4b66-851c-6c4c6306cdb5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:31.327791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-13384745-b983-4b66-851c-6c4c6306cdb5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:31.334121 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13384745-b983-4b66-851c-6c4c6306cdb5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:31.334594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13384745-b983-4b66-851c-6c4c6306cdb5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:31.335103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13384745-b983-4b66-851c-6c4c6306cdb5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:31.335777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13384745-b983-4b66-851c-6c4c6306cdb5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:31.336226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13384745-b983-4b66-851c-6c4c6306cdb5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:31.336646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13384745-b983-4b66-851c-6c4c6306cdb5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:31.401647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-13384745-b983-4b66-851c-6c4c6306cdb5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:31.409446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-13384745-b983-4b66-851c-6c4c6306cdb5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086039 Aug 08 09:08:31.410004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 881/1673] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:31 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:31.695341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-68a411e0-c2fa-47f1-a5f5-d25247daf0e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:31.695948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-68a411e0-c2fa-47f1-a5f5-d25247daf0e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:31.702325 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a411e0-c2fa-47f1-a5f5-d25247daf0e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:31.702804 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a411e0-c2fa-47f1-a5f5-d25247daf0e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:31.703236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a411e0-c2fa-47f1-a5f5-d25247daf0e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:31.703919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a411e0-c2fa-47f1-a5f5-d25247daf0e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:31.704372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a411e0-c2fa-47f1-a5f5-d25247daf0e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:31.704795 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-68a411e0-c2fa-47f1-a5f5-d25247daf0e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:31.831236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-68a411e0-c2fa-47f1-a5f5-d25247daf0e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:31.839817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-68a411e0-c2fa-47f1-a5f5-d25247daf0e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148370 Aug 08 09:08:31.840373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 793/1674] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:31 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:32.022210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:08:32.022970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:08:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:08:32.431404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-22a5b278-5ba8-4ebd-9f64-7561655adf0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:32.432011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-22a5b278-5ba8-4ebd-9f64-7561655adf0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:32.438523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a5b278-5ba8-4ebd-9f64-7561655adf0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:32.439008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a5b278-5ba8-4ebd-9f64-7561655adf0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:32.439450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a5b278-5ba8-4ebd-9f64-7561655adf0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:32.440145 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a5b278-5ba8-4ebd-9f64-7561655adf0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:32.440598 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a5b278-5ba8-4ebd-9f64-7561655adf0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:32.441026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-22a5b278-5ba8-4ebd-9f64-7561655adf0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:32.502714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-22a5b278-5ba8-4ebd-9f64-7561655adf0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:32.510730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-22a5b278-5ba8-4ebd-9f64-7561655adf0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083294 Aug 08 09:08:32.511278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 882/1675] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:32.859901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-19141d94-0c86-40d9-951c-f3bc135beb7c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:32.860476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-19141d94-0c86-40d9-951c-f3bc135beb7c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:32.866901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19141d94-0c86-40d9-951c-f3bc135beb7c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:32.867391 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19141d94-0c86-40d9-951c-f3bc135beb7c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:32.867831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19141d94-0c86-40d9-951c-f3bc135beb7c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:32.868526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19141d94-0c86-40d9-951c-f3bc135beb7c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:32.868982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19141d94-0c86-40d9-951c-f3bc135beb7c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:32.869435 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19141d94-0c86-40d9-951c-f3bc135beb7c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:33.001243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-19141d94-0c86-40d9-951c-f3bc135beb7c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:33.010157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-19141d94-0c86-40d9-951c-f3bc135beb7c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154200 Aug 08 09:08:33.010722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 794/1676] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:32 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:33.531645 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a3cdd427-7dd1-47c5-b860-d60da434ab0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:33.532263 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a3cdd427-7dd1-47c5-b860-d60da434ab0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:33.539286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdd427-7dd1-47c5-b860-d60da434ab0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:33.540086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdd427-7dd1-47c5-b860-d60da434ab0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:33.540539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdd427-7dd1-47c5-b860-d60da434ab0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:33.541264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdd427-7dd1-47c5-b860-d60da434ab0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:33.541754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdd427-7dd1-47c5-b860-d60da434ab0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:33.542185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3cdd427-7dd1-47c5-b860-d60da434ab0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:33.603126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a3cdd427-7dd1-47c5-b860-d60da434ab0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:33.611050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a3cdd427-7dd1-47c5-b860-d60da434ab0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083322 Aug 08 09:08:33.611618 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 883/1677] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:33 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:34.031935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-641ba586-94a5-4359-9775-4df243ee1316 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:34.032549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-641ba586-94a5-4359-9775-4df243ee1316 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:34.039627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-641ba586-94a5-4359-9775-4df243ee1316 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:34.040122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-641ba586-94a5-4359-9775-4df243ee1316 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:34.040557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-641ba586-94a5-4359-9775-4df243ee1316 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:34.041283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-641ba586-94a5-4359-9775-4df243ee1316 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:34.041747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-641ba586-94a5-4359-9775-4df243ee1316 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:34.042194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-641ba586-94a5-4359-9775-4df243ee1316 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:34.169626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-641ba586-94a5-4359-9775-4df243ee1316 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:34.177563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-641ba586-94a5-4359-9775-4df243ee1316 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149506 Aug 08 09:08:34.178124 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 795/1678] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:34 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:34.633175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-96ec42f3-8034-4a7f-9a2c-3e74b0d18ac3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:34.633943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-96ec42f3-8034-4a7f-9a2c-3e74b0d18ac3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:34.636213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:34.640826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96ec42f3-8034-4a7f-9a2c-3e74b0d18ac3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:34.641346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96ec42f3-8034-4a7f-9a2c-3e74b0d18ac3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:34.641783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96ec42f3-8034-4a7f-9a2c-3e74b0d18ac3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:34.642474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96ec42f3-8034-4a7f-9a2c-3e74b0d18ac3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:34.642925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96ec42f3-8034-4a7f-9a2c-3e74b0d18ac3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:34.643344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-96ec42f3-8034-4a7f-9a2c-3e74b0d18ac3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:34.707719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-96ec42f3-8034-4a7f-9a2c-3e74b0d18ac3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:34.715770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-96ec42f3-8034-4a7f-9a2c-3e74b0d18ac3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087267 Aug 08 09:08:34.716324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 884/1679] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:35.198623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-76f264a2-351f-4b7e-8a88-15443ed84205 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:35.199244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-76f264a2-351f-4b7e-8a88-15443ed84205 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:35.201566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:35.206218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76f264a2-351f-4b7e-8a88-15443ed84205 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:35.216307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76f264a2-351f-4b7e-8a88-15443ed84205 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:35.216307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76f264a2-351f-4b7e-8a88-15443ed84205 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:35.216307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76f264a2-351f-4b7e-8a88-15443ed84205 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:35.216307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76f264a2-351f-4b7e-8a88-15443ed84205 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:35.216694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76f264a2-351f-4b7e-8a88-15443ed84205 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:35.336509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-76f264a2-351f-4b7e-8a88-15443ed84205 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:35.344440 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-76f264a2-351f-4b7e-8a88-15443ed84205 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149905 Aug 08 09:08:35.344999 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 796/1680] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:35 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:35.738179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-33e9dc44-230e-4ef0-b92c-ee226ad3762f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:35.738772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-33e9dc44-230e-4ef0-b92c-ee226ad3762f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:35.745549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33e9dc44-230e-4ef0-b92c-ee226ad3762f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:35.746057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33e9dc44-230e-4ef0-b92c-ee226ad3762f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:35.746494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33e9dc44-230e-4ef0-b92c-ee226ad3762f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:35.747175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33e9dc44-230e-4ef0-b92c-ee226ad3762f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:35.747629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33e9dc44-230e-4ef0-b92c-ee226ad3762f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:35.748056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-33e9dc44-230e-4ef0-b92c-ee226ad3762f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:35.809069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-33e9dc44-230e-4ef0-b92c-ee226ad3762f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:35.816883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-33e9dc44-230e-4ef0-b92c-ee226ad3762f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082550 Aug 08 09:08:35.817473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 885/1681] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:35 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:36.366292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-095390c7-fcbf-498f-af0a-6e4ba37faaec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:36.367483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-095390c7-fcbf-498f-af0a-6e4ba37faaec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:36.373580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-095390c7-fcbf-498f-af0a-6e4ba37faaec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:36.374068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-095390c7-fcbf-498f-af0a-6e4ba37faaec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:36.374506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-095390c7-fcbf-498f-af0a-6e4ba37faaec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:36.375194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-095390c7-fcbf-498f-af0a-6e4ba37faaec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:36.375651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-095390c7-fcbf-498f-af0a-6e4ba37faaec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:36.376100 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-095390c7-fcbf-498f-af0a-6e4ba37faaec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:36.509149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-095390c7-fcbf-498f-af0a-6e4ba37faaec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:36.517062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-095390c7-fcbf-498f-af0a-6e4ba37faaec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154860 Aug 08 09:08:36.517651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 797/1682] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:36 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:36.838715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ebe5745e-d98e-40da-966f-b85a658a8284 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:36.839267 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ebe5745e-d98e-40da-966f-b85a658a8284 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:36.845206 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe5745e-d98e-40da-966f-b85a658a8284 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:36.845694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe5745e-d98e-40da-966f-b85a658a8284 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:36.846135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe5745e-d98e-40da-966f-b85a658a8284 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:36.846823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe5745e-d98e-40da-966f-b85a658a8284 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:36.847280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe5745e-d98e-40da-966f-b85a658a8284 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:36.847706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ebe5745e-d98e-40da-966f-b85a658a8284 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:36.908655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ebe5745e-d98e-40da-966f-b85a658a8284 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:36.917341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ebe5745e-d98e-40da-966f-b85a658a8284 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083098 Aug 08 09:08:36.917904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 886/1683] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:37.537442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9d6d831c-ed3e-4657-82e9-b0fbadf9dca9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:37.538060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9d6d831c-ed3e-4657-82e9-b0fbadf9dca9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:37.545115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d6d831c-ed3e-4657-82e9-b0fbadf9dca9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:37.545630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d6d831c-ed3e-4657-82e9-b0fbadf9dca9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:37.546067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d6d831c-ed3e-4657-82e9-b0fbadf9dca9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:37.546755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d6d831c-ed3e-4657-82e9-b0fbadf9dca9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:37.547213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d6d831c-ed3e-4657-82e9-b0fbadf9dca9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:37.547641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d6d831c-ed3e-4657-82e9-b0fbadf9dca9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:37.676248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9d6d831c-ed3e-4657-82e9-b0fbadf9dca9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:37.684315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9d6d831c-ed3e-4657-82e9-b0fbadf9dca9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150718 Aug 08 09:08:37.684880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 798/1684] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:37 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:37.937956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-148914ea-dcc0-4a34-b7ef-3df8ff36096c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:37.938497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-148914ea-dcc0-4a34-b7ef-3df8ff36096c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:37.944790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-148914ea-dcc0-4a34-b7ef-3df8ff36096c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:37.945907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-148914ea-dcc0-4a34-b7ef-3df8ff36096c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:37.946347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-148914ea-dcc0-4a34-b7ef-3df8ff36096c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:37.947035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-148914ea-dcc0-4a34-b7ef-3df8ff36096c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:37.947489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-148914ea-dcc0-4a34-b7ef-3df8ff36096c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:37.947914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-148914ea-dcc0-4a34-b7ef-3df8ff36096c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:37.951854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:38.015023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-148914ea-dcc0-4a34-b7ef-3df8ff36096c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:38.022861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-148914ea-dcc0-4a34-b7ef-3df8ff36096c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.088826 Aug 08 09:08:38.024131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 887/1685] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:37 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:38.704943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0a87203e-fac5-4a4c-93be-d0131e1d7071 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:38.705534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0a87203e-fac5-4a4c-93be-d0131e1d7071 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:38.712172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a87203e-fac5-4a4c-93be-d0131e1d7071 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:38.712666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a87203e-fac5-4a4c-93be-d0131e1d7071 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:38.713107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a87203e-fac5-4a4c-93be-d0131e1d7071 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:38.713831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a87203e-fac5-4a4c-93be-d0131e1d7071 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:38.714292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a87203e-fac5-4a4c-93be-d0131e1d7071 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:38.714723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0a87203e-fac5-4a4c-93be-d0131e1d7071 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:38.845468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0a87203e-fac5-4a4c-93be-d0131e1d7071 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:38.853954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0a87203e-fac5-4a4c-93be-d0131e1d7071 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152964 Aug 08 09:08:38.854517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 799/1686] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:38 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:39.044589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1271faf0-7b7d-4f90-aca5-0aebdec372e2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:39.045171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1271faf0-7b7d-4f90-aca5-0aebdec372e2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:39.051539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1271faf0-7b7d-4f90-aca5-0aebdec372e2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:39.052017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1271faf0-7b7d-4f90-aca5-0aebdec372e2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:39.052453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1271faf0-7b7d-4f90-aca5-0aebdec372e2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:39.053137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1271faf0-7b7d-4f90-aca5-0aebdec372e2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:39.053641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1271faf0-7b7d-4f90-aca5-0aebdec372e2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:39.054069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1271faf0-7b7d-4f90-aca5-0aebdec372e2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:39.113724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1271faf0-7b7d-4f90-aca5-0aebdec372e2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:39.121695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1271faf0-7b7d-4f90-aca5-0aebdec372e2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081030 Aug 08 09:08:39.122253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 888/1687] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:39 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:39.875581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2a23101e-2836-40d4-bd87-c4020d0b0e8d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:39.876183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2a23101e-2836-40d4-bd87-c4020d0b0e8d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:39.883695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a23101e-2836-40d4-bd87-c4020d0b0e8d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:39.884198 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a23101e-2836-40d4-bd87-c4020d0b0e8d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:39.884639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a23101e-2836-40d4-bd87-c4020d0b0e8d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:39.885367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a23101e-2836-40d4-bd87-c4020d0b0e8d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:39.885834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a23101e-2836-40d4-bd87-c4020d0b0e8d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:39.886284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a23101e-2836-40d4-bd87-c4020d0b0e8d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:39.904249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:40.017676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2a23101e-2836-40d4-bd87-c4020d0b0e8d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:40.025610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2a23101e-2836-40d4-bd87-c4020d0b0e8d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153901 Aug 08 09:08:40.026178 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 800/1688] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:39 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:40.142579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8178e8fa-a09d-4fa9-a011-bc87a380fcdf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:40.143190 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8178e8fa-a09d-4fa9-a011-bc87a380fcdf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:40.149557 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8178e8fa-a09d-4fa9-a011-bc87a380fcdf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:40.150039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8178e8fa-a09d-4fa9-a011-bc87a380fcdf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:40.150500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8178e8fa-a09d-4fa9-a011-bc87a380fcdf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:40.151189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8178e8fa-a09d-4fa9-a011-bc87a380fcdf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:40.151640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8178e8fa-a09d-4fa9-a011-bc87a380fcdf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:40.152129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8178e8fa-a09d-4fa9-a011-bc87a380fcdf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:40.212132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8178e8fa-a09d-4fa9-a011-bc87a380fcdf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:40.219985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8178e8fa-a09d-4fa9-a011-bc87a380fcdf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081183 Aug 08 09:08:40.220546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 889/1689] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:40 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:41.047098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2854424d-bddb-4c08-8cd1-25cf70f4e014 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:41.047719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2854424d-bddb-4c08-8cd1-25cf70f4e014 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:41.054155 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2854424d-bddb-4c08-8cd1-25cf70f4e014 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:41.054652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2854424d-bddb-4c08-8cd1-25cf70f4e014 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:41.055183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2854424d-bddb-4c08-8cd1-25cf70f4e014 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:41.055887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2854424d-bddb-4c08-8cd1-25cf70f4e014 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:41.056347 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2854424d-bddb-4c08-8cd1-25cf70f4e014 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:41.056777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2854424d-bddb-4c08-8cd1-25cf70f4e014 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:41.185284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2854424d-bddb-4c08-8cd1-25cf70f4e014 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:41.193289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2854424d-bddb-4c08-8cd1-25cf70f4e014 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150071 Aug 08 09:08:41.193857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 801/1690] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:41 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:41.240964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c71ffcd0-2b2f-4b17-9a27-2fbd347040aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:41.241626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c71ffcd0-2b2f-4b17-9a27-2fbd347040aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:41.248517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c71ffcd0-2b2f-4b17-9a27-2fbd347040aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:41.249000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c71ffcd0-2b2f-4b17-9a27-2fbd347040aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:41.249476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c71ffcd0-2b2f-4b17-9a27-2fbd347040aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:41.250168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c71ffcd0-2b2f-4b17-9a27-2fbd347040aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:41.250624 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c71ffcd0-2b2f-4b17-9a27-2fbd347040aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:41.251052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c71ffcd0-2b2f-4b17-9a27-2fbd347040aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:41.313790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c71ffcd0-2b2f-4b17-9a27-2fbd347040aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:41.322392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c71ffcd0-2b2f-4b17-9a27-2fbd347040aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085263 Aug 08 09:08:41.322952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 890/1691] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:41 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:42.214879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-55914a88-a6b0-4fb9-af19-e022a3eb2147 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:42.215484 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-55914a88-a6b0-4fb9-af19-e022a3eb2147 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:42.221829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55914a88-a6b0-4fb9-af19-e022a3eb2147 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:42.230768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55914a88-a6b0-4fb9-af19-e022a3eb2147 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:42.230768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55914a88-a6b0-4fb9-af19-e022a3eb2147 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:42.230768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55914a88-a6b0-4fb9-af19-e022a3eb2147 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:42.230768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55914a88-a6b0-4fb9-af19-e022a3eb2147 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:42.231189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55914a88-a6b0-4fb9-af19-e022a3eb2147 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:42.343152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c7d3675c-3d52-4e5c-a11c-bb878c32fb34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:42.344030 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c7d3675c-3d52-4e5c-a11c-bb878c32fb34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:42.350410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7d3675c-3d52-4e5c-a11c-bb878c32fb34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:42.351723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7d3675c-3d52-4e5c-a11c-bb878c32fb34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:42.352001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7d3675c-3d52-4e5c-a11c-bb878c32fb34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:42.352694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7d3675c-3d52-4e5c-a11c-bb878c32fb34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:42.353231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7d3675c-3d52-4e5c-a11c-bb878c32fb34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:42.357073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7d3675c-3d52-4e5c-a11c-bb878c32fb34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:42.357387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-55914a88-a6b0-4fb9-af19-e022a3eb2147 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:42.362803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-55914a88-a6b0-4fb9-af19-e022a3eb2147 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151971 Aug 08 09:08:42.363373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 802/1692] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:42 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:42.415895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c7d3675c-3d52-4e5c-a11c-bb878c32fb34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:42.423861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c7d3675c-3d52-4e5c-a11c-bb878c32fb34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084657 Aug 08 09:08:42.424423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 891/1693] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:42 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:08:43.384704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a5da277b-ca39-4575-bbc9-dce95c35bcd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:43.385357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a5da277b-ca39-4575-bbc9-dce95c35bcd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:43.391643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5da277b-ca39-4575-bbc9-dce95c35bcd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:43.392120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5da277b-ca39-4575-bbc9-dce95c35bcd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:43.392553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5da277b-ca39-4575-bbc9-dce95c35bcd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:43.393269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5da277b-ca39-4575-bbc9-dce95c35bcd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:43.393724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5da277b-ca39-4575-bbc9-dce95c35bcd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:43.394145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a5da277b-ca39-4575-bbc9-dce95c35bcd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:43.446232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-be75fdc9-ba38-4e55-bdef-2a65abc82355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:43.447136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-be75fdc9-ba38-4e55-bdef-2a65abc82355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:43.453769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be75fdc9-ba38-4e55-bdef-2a65abc82355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:43.454257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be75fdc9-ba38-4e55-bdef-2a65abc82355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:43.454701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be75fdc9-ba38-4e55-bdef-2a65abc82355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:43.455400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be75fdc9-ba38-4e55-bdef-2a65abc82355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:43.455863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be75fdc9-ba38-4e55-bdef-2a65abc82355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:43.456291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be75fdc9-ba38-4e55-bdef-2a65abc82355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:43.533445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-be75fdc9-ba38-4e55-bdef-2a65abc82355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:43.541899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-be75fdc9-ba38-4e55-bdef-2a65abc82355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.100188 Aug 08 09:08:43.542478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 892/1694] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:08:43.550158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a5da277b-ca39-4575-bbc9-dce95c35bcd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:43.558749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a5da277b-ca39-4575-bbc9-dce95c35bcd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.178860 Aug 08 09:08:43.559300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 803/1695] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:43 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:44.564045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-da9aeb2b-1517-4b2a-b317-a64488b46050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:44.564754 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-da9aeb2b-1517-4b2a-b317-a64488b46050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:44.571873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da9aeb2b-1517-4b2a-b317-a64488b46050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:44.572354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da9aeb2b-1517-4b2a-b317-a64488b46050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:44.572787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da9aeb2b-1517-4b2a-b317-a64488b46050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:44.573564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da9aeb2b-1517-4b2a-b317-a64488b46050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:44.574050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da9aeb2b-1517-4b2a-b317-a64488b46050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:44.574574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-da9aeb2b-1517-4b2a-b317-a64488b46050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:44.580251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e2f4400f-9c42-4d00-9431-aee7a39d3953 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:44.581587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e2f4400f-9c42-4d00-9431-aee7a39d3953 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:44.589396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2f4400f-9c42-4d00-9431-aee7a39d3953 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:44.590107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2f4400f-9c42-4d00-9431-aee7a39d3953 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:44.590553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2f4400f-9c42-4d00-9431-aee7a39d3953 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:44.591385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2f4400f-9c42-4d00-9431-aee7a39d3953 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:44.591851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2f4400f-9c42-4d00-9431-aee7a39d3953 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:44.592537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e2f4400f-9c42-4d00-9431-aee7a39d3953 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:44.650061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-da9aeb2b-1517-4b2a-b317-a64488b46050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:44.658993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-da9aeb2b-1517-4b2a-b317-a64488b46050 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.100161 Aug 08 09:08:44.665405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 893/1696] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:44.743438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e2f4400f-9c42-4d00-9431-aee7a39d3953 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:44.751480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e2f4400f-9c42-4d00-9431-aee7a39d3953 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.175129 Aug 08 09:08:44.752345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 804/1697] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:44 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:45.679526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-349c7fc0-ee46-44fe-a087-48ee2d2be0ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:45.680138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-349c7fc0-ee46-44fe-a087-48ee2d2be0ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:45.686505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-349c7fc0-ee46-44fe-a087-48ee2d2be0ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:45.686982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-349c7fc0-ee46-44fe-a087-48ee2d2be0ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:45.687411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-349c7fc0-ee46-44fe-a087-48ee2d2be0ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:45.688093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-349c7fc0-ee46-44fe-a087-48ee2d2be0ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:45.688541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-349c7fc0-ee46-44fe-a087-48ee2d2be0ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:45.688962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-349c7fc0-ee46-44fe-a087-48ee2d2be0ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:45.749041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-349c7fc0-ee46-44fe-a087-48ee2d2be0ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:45.757085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-349c7fc0-ee46-44fe-a087-48ee2d2be0ce tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081728 Aug 08 09:08:45.757730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 894/1698] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:45.774419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-40e81e4e-8317-4d94-ae28-b8684c0843b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:45.775020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-40e81e4e-8317-4d94-ae28-b8684c0843b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:45.781359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40e81e4e-8317-4d94-ae28-b8684c0843b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:45.781868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40e81e4e-8317-4d94-ae28-b8684c0843b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:45.782297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40e81e4e-8317-4d94-ae28-b8684c0843b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:45.782981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40e81e4e-8317-4d94-ae28-b8684c0843b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:45.783431 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40e81e4e-8317-4d94-ae28-b8684c0843b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:45.783852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40e81e4e-8317-4d94-ae28-b8684c0843b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:45.911535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-40e81e4e-8317-4d94-ae28-b8684c0843b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:45.920117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-40e81e4e-8317-4d94-ae28-b8684c0843b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149939 Aug 08 09:08:45.920671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 805/1699] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:45 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:46.778313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7cb2e6d0-1307-4372-91b6-984139f22a6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:46.778889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7cb2e6d0-1307-4372-91b6-984139f22a6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:46.785236 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7cb2e6d0-1307-4372-91b6-984139f22a6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:46.785722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7cb2e6d0-1307-4372-91b6-984139f22a6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:46.786160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7cb2e6d0-1307-4372-91b6-984139f22a6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:46.786857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7cb2e6d0-1307-4372-91b6-984139f22a6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:46.787309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7cb2e6d0-1307-4372-91b6-984139f22a6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:46.787737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7cb2e6d0-1307-4372-91b6-984139f22a6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:46.853848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7cb2e6d0-1307-4372-91b6-984139f22a6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:46.861760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7cb2e6d0-1307-4372-91b6-984139f22a6c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087472 Aug 08 09:08:46.862323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 895/1700] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:46 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:46.941426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0c5b3471-cbe1-49ec-8fba-1f51897ccd9d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:46.942037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0c5b3471-cbe1-49ec-8fba-1f51897ccd9d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:46.948509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c5b3471-cbe1-49ec-8fba-1f51897ccd9d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:46.948994 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c5b3471-cbe1-49ec-8fba-1f51897ccd9d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:46.949473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c5b3471-cbe1-49ec-8fba-1f51897ccd9d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:46.950168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c5b3471-cbe1-49ec-8fba-1f51897ccd9d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:46.950627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c5b3471-cbe1-49ec-8fba-1f51897ccd9d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:46.951056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0c5b3471-cbe1-49ec-8fba-1f51897ccd9d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:47.078434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0c5b3471-cbe1-49ec-8fba-1f51897ccd9d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:47.086341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0c5b3471-cbe1-49ec-8fba-1f51897ccd9d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148782 Aug 08 09:08:47.086898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 806/1701] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:46 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:47.884128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-331fd417-2fdb-4f4b-8f97-9629ea378899 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:47.884742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-331fd417-2fdb-4f4b-8f97-9629ea378899 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:47.891065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-331fd417-2fdb-4f4b-8f97-9629ea378899 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:47.891541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-331fd417-2fdb-4f4b-8f97-9629ea378899 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:47.891974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-331fd417-2fdb-4f4b-8f97-9629ea378899 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:47.892653 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-331fd417-2fdb-4f4b-8f97-9629ea378899 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:47.893104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-331fd417-2fdb-4f4b-8f97-9629ea378899 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:47.893552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-331fd417-2fdb-4f4b-8f97-9629ea378899 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:47.954645 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-331fd417-2fdb-4f4b-8f97-9629ea378899 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:47.962909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-331fd417-2fdb-4f4b-8f97-9629ea378899 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082987 Aug 08 09:08:47.963462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 896/1702] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:48.107719 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9ccb2a9c-9378-49a2-8bfd-37c7c8378438 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:48.108360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9ccb2a9c-9378-49a2-8bfd-37c7c8378438 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:48.114826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9ccb2a9c-9378-49a2-8bfd-37c7c8378438 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:48.115304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9ccb2a9c-9378-49a2-8bfd-37c7c8378438 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:48.115739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9ccb2a9c-9378-49a2-8bfd-37c7c8378438 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:48.116425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9ccb2a9c-9378-49a2-8bfd-37c7c8378438 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:48.116910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9ccb2a9c-9378-49a2-8bfd-37c7c8378438 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:48.117385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9ccb2a9c-9378-49a2-8bfd-37c7c8378438 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:48.249946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9ccb2a9c-9378-49a2-8bfd-37c7c8378438 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:48.258228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9ccb2a9c-9378-49a2-8bfd-37c7c8378438 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154276 Aug 08 09:08:48.258788 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 807/1703] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:48 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:48.984001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9c754c78-c6c3-4d45-ae02-06e450128818 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:48.984581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9c754c78-c6c3-4d45-ae02-06e450128818 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:48.991498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c754c78-c6c3-4d45-ae02-06e450128818 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:48.992563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c754c78-c6c3-4d45-ae02-06e450128818 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:48.993031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c754c78-c6c3-4d45-ae02-06e450128818 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:48.993771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c754c78-c6c3-4d45-ae02-06e450128818 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:48.994228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c754c78-c6c3-4d45-ae02-06e450128818 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:48.994683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c754c78-c6c3-4d45-ae02-06e450128818 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:49.056255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9c754c78-c6c3-4d45-ae02-06e450128818 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:49.064041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9c754c78-c6c3-4d45-ae02-06e450128818 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084144 Aug 08 09:08:49.064606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 897/1704] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:49.278166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dfee36e1-513d-4a7f-a1f4-e383b4e59583 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:49.278716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dfee36e1-513d-4a7f-a1f4-e383b4e59583 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:49.285073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfee36e1-513d-4a7f-a1f4-e383b4e59583 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:49.285582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfee36e1-513d-4a7f-a1f4-e383b4e59583 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:49.286012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfee36e1-513d-4a7f-a1f4-e383b4e59583 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:49.286693 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfee36e1-513d-4a7f-a1f4-e383b4e59583 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:49.287145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfee36e1-513d-4a7f-a1f4-e383b4e59583 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:49.287564 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dfee36e1-513d-4a7f-a1f4-e383b4e59583 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:49.414822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dfee36e1-513d-4a7f-a1f4-e383b4e59583 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:49.422899 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dfee36e1-513d-4a7f-a1f4-e383b4e59583 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148655 Aug 08 09:08:49.432602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 808/1705] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:49 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:50.086216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a650b9b2-4ab8-4652-9f6c-c294294364c2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:50.086769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a650b9b2-4ab8-4652-9f6c-c294294364c2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:50.093359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a650b9b2-4ab8-4652-9f6c-c294294364c2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:50.093841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a650b9b2-4ab8-4652-9f6c-c294294364c2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:50.094272 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a650b9b2-4ab8-4652-9f6c-c294294364c2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:50.094959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a650b9b2-4ab8-4652-9f6c-c294294364c2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:50.095409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a650b9b2-4ab8-4652-9f6c-c294294364c2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:50.095831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a650b9b2-4ab8-4652-9f6c-c294294364c2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:50.160202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a650b9b2-4ab8-4652-9f6c-c294294364c2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:50.168216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a650b9b2-4ab8-4652-9f6c-c294294364c2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086714 Aug 08 09:08:50.168774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 898/1706] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:50 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:50.451985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f47e0e72-1819-4a9a-86c9-d69f01c7a6fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:50.452599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f47e0e72-1819-4a9a-86c9-d69f01c7a6fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:50.459036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f47e0e72-1819-4a9a-86c9-d69f01c7a6fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:50.459521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f47e0e72-1819-4a9a-86c9-d69f01c7a6fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:50.459961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f47e0e72-1819-4a9a-86c9-d69f01c7a6fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:50.461154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f47e0e72-1819-4a9a-86c9-d69f01c7a6fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:50.461621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f47e0e72-1819-4a9a-86c9-d69f01c7a6fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:50.462049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f47e0e72-1819-4a9a-86c9-d69f01c7a6fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:50.588983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f47e0e72-1819-4a9a-86c9-d69f01c7a6fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:50.596891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f47e0e72-1819-4a9a-86c9-d69f01c7a6fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148792 Aug 08 09:08:50.597487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 809/1707] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:50 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:51.189032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-07c9d6a9-32bc-4ed1-883d-283d9bb757c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:51.189652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-07c9d6a9-32bc-4ed1-883d-283d9bb757c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:51.196722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07c9d6a9-32bc-4ed1-883d-283d9bb757c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:51.197239 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07c9d6a9-32bc-4ed1-883d-283d9bb757c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:51.197683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07c9d6a9-32bc-4ed1-883d-283d9bb757c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:51.198374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07c9d6a9-32bc-4ed1-883d-283d9bb757c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:51.198841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07c9d6a9-32bc-4ed1-883d-283d9bb757c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:51.199297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-07c9d6a9-32bc-4ed1-883d-283d9bb757c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:51.261550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-07c9d6a9-32bc-4ed1-883d-283d9bb757c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:51.269648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-07c9d6a9-32bc-4ed1-883d-283d9bb757c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084570 Aug 08 09:08:51.270214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 899/1708] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:51 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:51.618630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5b3ba239-d687-41be-8d82-852ea7c3d0f3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:51.619247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5b3ba239-d687-41be-8d82-852ea7c3d0f3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:51.625656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b3ba239-d687-41be-8d82-852ea7c3d0f3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:51.626140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b3ba239-d687-41be-8d82-852ea7c3d0f3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:51.626580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b3ba239-d687-41be-8d82-852ea7c3d0f3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:51.627274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b3ba239-d687-41be-8d82-852ea7c3d0f3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:51.627733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b3ba239-d687-41be-8d82-852ea7c3d0f3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:51.628161 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b3ba239-d687-41be-8d82-852ea7c3d0f3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:51.759318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5b3ba239-d687-41be-8d82-852ea7c3d0f3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:51.767190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5b3ba239-d687-41be-8d82-852ea7c3d0f3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152491 Aug 08 09:08:51.767756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 810/1709] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:51 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:52.291674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c343c22e-38b0-4b8c-abf3-0fdbc93b775d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:52.292285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c343c22e-38b0-4b8c-abf3-0fdbc93b775d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:52.298890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c343c22e-38b0-4b8c-abf3-0fdbc93b775d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:52.299383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c343c22e-38b0-4b8c-abf3-0fdbc93b775d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:52.307442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c343c22e-38b0-4b8c-abf3-0fdbc93b775d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:52.307442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c343c22e-38b0-4b8c-abf3-0fdbc93b775d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:52.307442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c343c22e-38b0-4b8c-abf3-0fdbc93b775d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:52.307442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c343c22e-38b0-4b8c-abf3-0fdbc93b775d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:52.362594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c343c22e-38b0-4b8c-abf3-0fdbc93b775d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:52.370510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c343c22e-38b0-4b8c-abf3-0fdbc93b775d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083718 Aug 08 09:08:52.371067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 900/1710] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:52 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:52.788608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-04ef4195-3fa1-49aa-9dc8-c650d238c723 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:52.789451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-04ef4195-3fa1-49aa-9dc8-c650d238c723 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:52.795917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04ef4195-3fa1-49aa-9dc8-c650d238c723 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:52.796402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04ef4195-3fa1-49aa-9dc8-c650d238c723 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:52.796839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04ef4195-3fa1-49aa-9dc8-c650d238c723 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:52.797551 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04ef4195-3fa1-49aa-9dc8-c650d238c723 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:52.798008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04ef4195-3fa1-49aa-9dc8-c650d238c723 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:52.798434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04ef4195-3fa1-49aa-9dc8-c650d238c723 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:52.926021 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-04ef4195-3fa1-49aa-9dc8-c650d238c723 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:52.934724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-04ef4195-3fa1-49aa-9dc8-c650d238c723 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150267 Aug 08 09:08:52.935300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 811/1711] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:52 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:53.391893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-03e2d0a2-aedb-462e-8962-3bca74be0b05 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:53.392509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-03e2d0a2-aedb-462e-8962-3bca74be0b05 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:53.398948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03e2d0a2-aedb-462e-8962-3bca74be0b05 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:53.399427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03e2d0a2-aedb-462e-8962-3bca74be0b05 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:53.399867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03e2d0a2-aedb-462e-8962-3bca74be0b05 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:53.400555 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03e2d0a2-aedb-462e-8962-3bca74be0b05 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:53.401056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03e2d0a2-aedb-462e-8962-3bca74be0b05 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:53.401616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-03e2d0a2-aedb-462e-8962-3bca74be0b05 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:53.466567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-03e2d0a2-aedb-462e-8962-3bca74be0b05 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:53.474355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-03e2d0a2-aedb-462e-8962-3bca74be0b05 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086349 Aug 08 09:08:53.474911 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 901/1712] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:53 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:53.955958 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-74369045-1b5e-4068-a770-da68f40fd483 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:53.956513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-74369045-1b5e-4068-a770-da68f40fd483 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:53.963448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74369045-1b5e-4068-a770-da68f40fd483 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:53.963927 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74369045-1b5e-4068-a770-da68f40fd483 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:53.964358 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74369045-1b5e-4068-a770-da68f40fd483 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:53.965049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74369045-1b5e-4068-a770-da68f40fd483 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:53.965531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74369045-1b5e-4068-a770-da68f40fd483 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:53.965961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74369045-1b5e-4068-a770-da68f40fd483 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:54.093561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-74369045-1b5e-4068-a770-da68f40fd483 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:54.101677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-74369045-1b5e-4068-a770-da68f40fd483 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149721 Aug 08 09:08:54.102240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 812/1713] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:53 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:54.495347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-51b01baf-158d-444a-93c8-87358263cd12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:54.495966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-51b01baf-158d-444a-93c8-87358263cd12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:54.502481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51b01baf-158d-444a-93c8-87358263cd12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:54.502972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51b01baf-158d-444a-93c8-87358263cd12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:54.503415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51b01baf-158d-444a-93c8-87358263cd12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:54.504109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51b01baf-158d-444a-93c8-87358263cd12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:54.504571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51b01baf-158d-444a-93c8-87358263cd12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:54.505000 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-51b01baf-158d-444a-93c8-87358263cd12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:54.567871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-51b01baf-158d-444a-93c8-87358263cd12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:54.575882 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-51b01baf-158d-444a-93c8-87358263cd12 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084597 Aug 08 09:08:54.576446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 902/1714] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:54 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:55.122380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-926479c3-4fbf-41f5-acca-6df2730f1777 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:55.122987 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-926479c3-4fbf-41f5-acca-6df2730f1777 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:55.129406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-926479c3-4fbf-41f5-acca-6df2730f1777 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:55.129886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-926479c3-4fbf-41f5-acca-6df2730f1777 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:55.130323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-926479c3-4fbf-41f5-acca-6df2730f1777 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:55.131009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-926479c3-4fbf-41f5-acca-6df2730f1777 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:55.131718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-926479c3-4fbf-41f5-acca-6df2730f1777 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:55.132139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-926479c3-4fbf-41f5-acca-6df2730f1777 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:55.260476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-926479c3-4fbf-41f5-acca-6df2730f1777 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:55.268288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-926479c3-4fbf-41f5-acca-6df2730f1777 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149723 Aug 08 09:08:55.268849 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 813/1715] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:55 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:55.596987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1fc0b7bf-b61e-4aed-8000-06c8e4aaa69e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:55.597654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1fc0b7bf-b61e-4aed-8000-06c8e4aaa69e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:55.604764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1fc0b7bf-b61e-4aed-8000-06c8e4aaa69e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:55.605286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1fc0b7bf-b61e-4aed-8000-06c8e4aaa69e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:55.605730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1fc0b7bf-b61e-4aed-8000-06c8e4aaa69e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:55.606428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1fc0b7bf-b61e-4aed-8000-06c8e4aaa69e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:55.606889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1fc0b7bf-b61e-4aed-8000-06c8e4aaa69e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:55.607322 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1fc0b7bf-b61e-4aed-8000-06c8e4aaa69e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:55.668949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1fc0b7bf-b61e-4aed-8000-06c8e4aaa69e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:55.672297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:55.677102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1fc0b7bf-b61e-4aed-8000-06c8e4aaa69e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083963 Aug 08 09:08:55.677695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 903/1716] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:56.289243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6027ebcb-1d7c-4820-b7f3-a51411f79a56 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:56.289865 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6027ebcb-1d7c-4820-b7f3-a51411f79a56 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:56.296276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6027ebcb-1d7c-4820-b7f3-a51411f79a56 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:56.296763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6027ebcb-1d7c-4820-b7f3-a51411f79a56 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:56.297225 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6027ebcb-1d7c-4820-b7f3-a51411f79a56 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:56.297925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6027ebcb-1d7c-4820-b7f3-a51411f79a56 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:56.298385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6027ebcb-1d7c-4820-b7f3-a51411f79a56 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:56.298814 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6027ebcb-1d7c-4820-b7f3-a51411f79a56 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:56.426308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6027ebcb-1d7c-4820-b7f3-a51411f79a56 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:56.434733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6027ebcb-1d7c-4820-b7f3-a51411f79a56 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149359 Aug 08 09:08:56.435293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 814/1717] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:56 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:56.697569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c7a8fb67-702a-4cea-b1ae-e9444bd848ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:56.698118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c7a8fb67-702a-4cea-b1ae-e9444bd848ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:56.704903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7a8fb67-702a-4cea-b1ae-e9444bd848ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:56.705431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7a8fb67-702a-4cea-b1ae-e9444bd848ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:56.705871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7a8fb67-702a-4cea-b1ae-e9444bd848ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:56.706563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7a8fb67-702a-4cea-b1ae-e9444bd848ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:56.707017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7a8fb67-702a-4cea-b1ae-e9444bd848ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:56.707444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c7a8fb67-702a-4cea-b1ae-e9444bd848ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:56.770608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c7a8fb67-702a-4cea-b1ae-e9444bd848ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:56.778445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c7a8fb67-702a-4cea-b1ae-e9444bd848ef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085037 Aug 08 09:08:56.779037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 904/1718] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:08:57.455825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-18478fb8-70ad-490f-bf54-07f447b4e65b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:57.456426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-18478fb8-70ad-490f-bf54-07f447b4e65b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:57.463661 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18478fb8-70ad-490f-bf54-07f447b4e65b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:57.464215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18478fb8-70ad-490f-bf54-07f447b4e65b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:57.464863 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18478fb8-70ad-490f-bf54-07f447b4e65b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:57.465608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18478fb8-70ad-490f-bf54-07f447b4e65b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:57.466070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18478fb8-70ad-490f-bf54-07f447b4e65b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:57.466495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18478fb8-70ad-490f-bf54-07f447b4e65b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:57.592622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-18478fb8-70ad-490f-bf54-07f447b4e65b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:57.600366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-18478fb8-70ad-490f-bf54-07f447b4e65b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148384 Aug 08 09:08:57.600939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 815/1719] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:57 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:57.800010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d27e720f-366d-4a8f-9467-bd2dfb8a20c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:57.800540 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d27e720f-366d-4a8f-9467-bd2dfb8a20c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:57.807502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d27e720f-366d-4a8f-9467-bd2dfb8a20c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:57.807989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d27e720f-366d-4a8f-9467-bd2dfb8a20c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:57.808436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d27e720f-366d-4a8f-9467-bd2dfb8a20c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:57.809132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d27e720f-366d-4a8f-9467-bd2dfb8a20c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:57.809640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d27e720f-366d-4a8f-9467-bd2dfb8a20c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:57.810072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d27e720f-366d-4a8f-9467-bd2dfb8a20c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:57.870971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d27e720f-366d-4a8f-9467-bd2dfb8a20c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:57.878801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d27e720f-366d-4a8f-9467-bd2dfb8a20c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082716 Aug 08 09:08:57.879369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 905/1720] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:57 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:08:58.621938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-56dffeaf-3102-4d2e-bc54-aacaff4e3279 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:58.622553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-56dffeaf-3102-4d2e-bc54-aacaff4e3279 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:58.628879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56dffeaf-3102-4d2e-bc54-aacaff4e3279 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:58.629394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56dffeaf-3102-4d2e-bc54-aacaff4e3279 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:58.629836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56dffeaf-3102-4d2e-bc54-aacaff4e3279 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:58.630528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56dffeaf-3102-4d2e-bc54-aacaff4e3279 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:58.630983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56dffeaf-3102-4d2e-bc54-aacaff4e3279 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:58.631409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56dffeaf-3102-4d2e-bc54-aacaff4e3279 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:58.762868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-56dffeaf-3102-4d2e-bc54-aacaff4e3279 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:58.770815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-56dffeaf-3102-4d2e-bc54-aacaff4e3279 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152756 Aug 08 09:08:58.771380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 816/1721] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:58 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:58.900247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b5cf1a21-ecc8-4bdb-8c5f-f850adccd9cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:58.900859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b5cf1a21-ecc8-4bdb-8c5f-f850adccd9cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:58.907222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a21-ecc8-4bdb-8c5f-f850adccd9cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:58.907703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a21-ecc8-4bdb-8c5f-f850adccd9cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:58.908142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a21-ecc8-4bdb-8c5f-f850adccd9cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:58.908827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a21-ecc8-4bdb-8c5f-f850adccd9cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:58.909328 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a21-ecc8-4bdb-8c5f-f850adccd9cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:58.909755 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5cf1a21-ecc8-4bdb-8c5f-f850adccd9cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:58.969517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b5cf1a21-ecc8-4bdb-8c5f-f850adccd9cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:58.978128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b5cf1a21-ecc8-4bdb-8c5f-f850adccd9cc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082247 Aug 08 09:08:58.978690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 906/1722] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:59.791983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8c45770c-2290-4d83-87c6-0c45ea86012b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:59.792590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8c45770c-2290-4d83-87c6-0c45ea86012b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:08:59.798897 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c45770c-2290-4d83-87c6-0c45ea86012b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:59.799375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c45770c-2290-4d83-87c6-0c45ea86012b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:59.799805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c45770c-2290-4d83-87c6-0c45ea86012b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:59.800487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c45770c-2290-4d83-87c6-0c45ea86012b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:08:59.800937 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c45770c-2290-4d83-87c6-0c45ea86012b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:08:59.801390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8c45770c-2290-4d83-87c6-0c45ea86012b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:08:59.805914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:08:59.933945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8c45770c-2290-4d83-87c6-0c45ea86012b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:08:59.941956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8c45770c-2290-4d83-87c6-0c45ea86012b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154017 Aug 08 09:08:59.942515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 817/1723] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:59 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:08:59.998898 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-02697cd4-5f4a-48f7-be4b-73a23e493722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:08:59.999517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-02697cd4-5f4a-48f7-be4b-73a23e493722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:00.005852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02697cd4-5f4a-48f7-be4b-73a23e493722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:00.006337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02697cd4-5f4a-48f7-be4b-73a23e493722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:00.007026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02697cd4-5f4a-48f7-be4b-73a23e493722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:00.007969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02697cd4-5f4a-48f7-be4b-73a23e493722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:00.008428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02697cd4-5f4a-48f7-be4b-73a23e493722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:00.008855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02697cd4-5f4a-48f7-be4b-73a23e493722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:00.072511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-02697cd4-5f4a-48f7-be4b-73a23e493722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:00.080396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-02697cd4-5f4a-48f7-be4b-73a23e493722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085308 Aug 08 09:09:00.080961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 907/1724] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:08:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:00.964153 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ea48d882-7ed0-4f86-9186-e61f79ece62a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:00.964769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ea48d882-7ed0-4f86-9186-e61f79ece62a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:00.971162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ea48d882-7ed0-4f86-9186-e61f79ece62a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:00.971632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ea48d882-7ed0-4f86-9186-e61f79ece62a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:00.972069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ea48d882-7ed0-4f86-9186-e61f79ece62a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:00.972758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ea48d882-7ed0-4f86-9186-e61f79ece62a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:00.973243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ea48d882-7ed0-4f86-9186-e61f79ece62a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:00.973691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ea48d882-7ed0-4f86-9186-e61f79ece62a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:01.099665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ea48d882-7ed0-4f86-9186-e61f79ece62a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:01.101044 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-819de634-9dd1-4cfd-b505-cd54c5ede8ea tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:01.101741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-819de634-9dd1-4cfd-b505-cd54c5ede8ea tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:01.107726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ea48d882-7ed0-4f86-9186-e61f79ece62a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148016 Aug 08 09:09:01.107906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-819de634-9dd1-4cfd-b505-cd54c5ede8ea tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:01.108235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-819de634-9dd1-4cfd-b505-cd54c5ede8ea tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:01.108409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 818/1725] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:00 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:01.108672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-819de634-9dd1-4cfd-b505-cd54c5ede8ea tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:01.109401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-819de634-9dd1-4cfd-b505-cd54c5ede8ea tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:01.109858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-819de634-9dd1-4cfd-b505-cd54c5ede8ea tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:01.110289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-819de634-9dd1-4cfd-b505-cd54c5ede8ea tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:01.171457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-819de634-9dd1-4cfd-b505-cd54c5ede8ea tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:01.179726 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-819de634-9dd1-4cfd-b505-cd54c5ede8ea tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081939 Aug 08 09:09:01.180289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 908/1726] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:01 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:02.130095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f451de18-93db-45a3-8c73-52c91449796b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:02.130721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f451de18-93db-45a3-8c73-52c91449796b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:02.137433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f451de18-93db-45a3-8c73-52c91449796b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:02.137915 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f451de18-93db-45a3-8c73-52c91449796b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:02.138346 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f451de18-93db-45a3-8c73-52c91449796b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:02.139056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f451de18-93db-45a3-8c73-52c91449796b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:02.139534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f451de18-93db-45a3-8c73-52c91449796b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:02.139961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f451de18-93db-45a3-8c73-52c91449796b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:02.200036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-26323826-d58e-49b4-b0f6-2af8973a380d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:02.200651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-26323826-d58e-49b4-b0f6-2af8973a380d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:02.207413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26323826-d58e-49b4-b0f6-2af8973a380d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:02.207900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26323826-d58e-49b4-b0f6-2af8973a380d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:02.208540 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26323826-d58e-49b4-b0f6-2af8973a380d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:02.209259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26323826-d58e-49b4-b0f6-2af8973a380d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:02.209717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26323826-d58e-49b4-b0f6-2af8973a380d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:02.210639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-26323826-d58e-49b4-b0f6-2af8973a380d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:02.535848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-26323826-d58e-49b4-b0f6-2af8973a380d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:02.543854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-26323826-d58e-49b4-b0f6-2af8973a380d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.347772 Aug 08 09:09:02.544442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 909/1727] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:02 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:02.552375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f451de18-93db-45a3-8c73-52c91449796b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:02.560870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f451de18-93db-45a3-8c73-52c91449796b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.434615 Aug 08 09:09:02.561457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 819/1728] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:02 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:03.565629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8cca273e-20d5-4026-80be-144282c865fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:03.566239 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8cca273e-20d5-4026-80be-144282c865fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:03.572993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cca273e-20d5-4026-80be-144282c865fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:03.573501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cca273e-20d5-4026-80be-144282c865fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:03.573938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cca273e-20d5-4026-80be-144282c865fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:03.574616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cca273e-20d5-4026-80be-144282c865fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:03.575066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cca273e-20d5-4026-80be-144282c865fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:03.575487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8cca273e-20d5-4026-80be-144282c865fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:03.582141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fe5a4d11-c706-4068-910b-86b215a78f6d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:03.582759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fe5a4d11-c706-4068-910b-86b215a78f6d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:03.589633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe5a4d11-c706-4068-910b-86b215a78f6d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:03.590121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe5a4d11-c706-4068-910b-86b215a78f6d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:03.590556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe5a4d11-c706-4068-910b-86b215a78f6d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:03.591253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe5a4d11-c706-4068-910b-86b215a78f6d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:03.591706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe5a4d11-c706-4068-910b-86b215a78f6d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:03.592135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe5a4d11-c706-4068-910b-86b215a78f6d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:03.638993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8cca273e-20d5-4026-80be-144282c865fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:03.647035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8cca273e-20d5-4026-80be-144282c865fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085484 Aug 08 09:09:03.647605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 910/1729] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:03.732424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fe5a4d11-c706-4068-910b-86b215a78f6d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:03.740341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fe5a4d11-c706-4068-910b-86b215a78f6d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.161969 Aug 08 09:09:03.740922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 820/1730] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:03 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:04.669313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-123473a4-3c59-4164-a4e4-83d865927adb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:04.669872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-123473a4-3c59-4164-a4e4-83d865927adb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:04.676392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-123473a4-3c59-4164-a4e4-83d865927adb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:04.676867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-123473a4-3c59-4164-a4e4-83d865927adb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:04.677336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-123473a4-3c59-4164-a4e4-83d865927adb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:04.678015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-123473a4-3c59-4164-a4e4-83d865927adb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:04.678465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-123473a4-3c59-4164-a4e4-83d865927adb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:04.679693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-123473a4-3c59-4164-a4e4-83d865927adb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:04.742974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-123473a4-3c59-4164-a4e4-83d865927adb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:04.750909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-123473a4-3c59-4164-a4e4-83d865927adb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085996 Aug 08 09:09:04.751463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 911/1731] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:04.767498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3de209c9-7b7a-4092-a239-2e545ad19039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:04.768113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3de209c9-7b7a-4092-a239-2e545ad19039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:04.774575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3de209c9-7b7a-4092-a239-2e545ad19039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:04.775061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3de209c9-7b7a-4092-a239-2e545ad19039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:04.775498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3de209c9-7b7a-4092-a239-2e545ad19039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:04.776193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3de209c9-7b7a-4092-a239-2e545ad19039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:04.776649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3de209c9-7b7a-4092-a239-2e545ad19039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:04.777079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3de209c9-7b7a-4092-a239-2e545ad19039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:05.056676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3de209c9-7b7a-4092-a239-2e545ad19039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:05.064821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3de209c9-7b7a-4092-a239-2e545ad19039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.301192 Aug 08 09:09:05.065410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 821/1732] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:04 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:05.772409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ffe80dcb-93d7-4205-830f-db7e40ab5b58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:05.773585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ffe80dcb-93d7-4205-830f-db7e40ab5b58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:05.775840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=56 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:09:05.780682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffe80dcb-93d7-4205-830f-db7e40ab5b58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:05.781178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffe80dcb-93d7-4205-830f-db7e40ab5b58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:05.781619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffe80dcb-93d7-4205-830f-db7e40ab5b58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:05.782338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffe80dcb-93d7-4205-830f-db7e40ab5b58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:05.782807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffe80dcb-93d7-4205-830f-db7e40ab5b58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:05.783316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffe80dcb-93d7-4205-830f-db7e40ab5b58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:05.844684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ffe80dcb-93d7-4205-830f-db7e40ab5b58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:05.852661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ffe80dcb-93d7-4205-830f-db7e40ab5b58 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084171 Aug 08 09:09:05.853243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 912/1733] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:05 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:06.085812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9216636f-c534-4523-bc91-5e4c9619d5dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:06.086381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9216636f-c534-4523-bc91-5e4c9619d5dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:06.088345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=52 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:09:06.092950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9216636f-c534-4523-bc91-5e4c9619d5dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:06.093487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9216636f-c534-4523-bc91-5e4c9619d5dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:06.093934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9216636f-c534-4523-bc91-5e4c9619d5dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:06.094631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9216636f-c534-4523-bc91-5e4c9619d5dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:06.095093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9216636f-c534-4523-bc91-5e4c9619d5dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:06.095523 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9216636f-c534-4523-bc91-5e4c9619d5dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:06.232857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9216636f-c534-4523-bc91-5e4c9619d5dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:06.240801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9216636f-c534-4523-bc91-5e4c9619d5dc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.159034 Aug 08 09:09:06.241884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 822/1734] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:06 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:06.873722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-164dcb9f-55db-44e0-9196-25c0cc1890b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:06.874346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-164dcb9f-55db-44e0-9196-25c0cc1890b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:06.880363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-164dcb9f-55db-44e0-9196-25c0cc1890b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:06.880850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-164dcb9f-55db-44e0-9196-25c0cc1890b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:06.881332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-164dcb9f-55db-44e0-9196-25c0cc1890b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:06.883069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-164dcb9f-55db-44e0-9196-25c0cc1890b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:06.883717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-164dcb9f-55db-44e0-9196-25c0cc1890b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:06.884152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-164dcb9f-55db-44e0-9196-25c0cc1890b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:06.943154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-164dcb9f-55db-44e0-9196-25c0cc1890b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:06.951635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-164dcb9f-55db-44e0-9196-25c0cc1890b7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081874 Aug 08 09:09:06.952192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 913/1735] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:06 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:07.262227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a6faee53-2055-47fc-b46c-99b6839556ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:07.262769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a6faee53-2055-47fc-b46c-99b6839556ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:07.269578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6faee53-2055-47fc-b46c-99b6839556ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:07.270067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6faee53-2055-47fc-b46c-99b6839556ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:07.270512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6faee53-2055-47fc-b46c-99b6839556ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:07.271206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6faee53-2055-47fc-b46c-99b6839556ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:07.271667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6faee53-2055-47fc-b46c-99b6839556ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:07.272096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a6faee53-2055-47fc-b46c-99b6839556ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:07.399380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a6faee53-2055-47fc-b46c-99b6839556ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:07.414402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a6faee53-2055-47fc-b46c-99b6839556ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149365 Aug 08 09:09:07.414402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 823/1736] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:07 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:07.972523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cc706f80-3c17-4745-a158-c9e1e3c13979 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:07.973131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cc706f80-3c17-4745-a158-c9e1e3c13979 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:07.979966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc706f80-3c17-4745-a158-c9e1e3c13979 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:07.980444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc706f80-3c17-4745-a158-c9e1e3c13979 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:07.980879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc706f80-3c17-4745-a158-c9e1e3c13979 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:07.981599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc706f80-3c17-4745-a158-c9e1e3c13979 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:07.982052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc706f80-3c17-4745-a158-c9e1e3c13979 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:07.982476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc706f80-3c17-4745-a158-c9e1e3c13979 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:08.045326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cc706f80-3c17-4745-a158-c9e1e3c13979 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:08.053227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cc706f80-3c17-4745-a158-c9e1e3c13979 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084545 Aug 08 09:09:08.053918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 914/1737] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:07 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:08.433471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-78bb0531-6835-4682-aa2c-9d0a9079124b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:08.434084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-78bb0531-6835-4682-aa2c-9d0a9079124b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:08.440513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78bb0531-6835-4682-aa2c-9d0a9079124b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:08.440997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78bb0531-6835-4682-aa2c-9d0a9079124b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:08.441469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78bb0531-6835-4682-aa2c-9d0a9079124b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:08.442166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78bb0531-6835-4682-aa2c-9d0a9079124b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:08.442620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78bb0531-6835-4682-aa2c-9d0a9079124b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:08.443043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78bb0531-6835-4682-aa2c-9d0a9079124b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:08.568021 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-78bb0531-6835-4682-aa2c-9d0a9079124b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:08.576622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-78bb0531-6835-4682-aa2c-9d0a9079124b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.147646 Aug 08 09:09:08.577192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 824/1738] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:08 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:09.072935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3e096cb1-0148-4b4c-b25b-d71c80d38a1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:09.073573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3e096cb1-0148-4b4c-b25b-d71c80d38a1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:09.079896 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e096cb1-0148-4b4c-b25b-d71c80d38a1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:09.080373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e096cb1-0148-4b4c-b25b-d71c80d38a1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:09.080808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e096cb1-0148-4b4c-b25b-d71c80d38a1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:09.081521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e096cb1-0148-4b4c-b25b-d71c80d38a1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:09.081974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e096cb1-0148-4b4c-b25b-d71c80d38a1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:09.082394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e096cb1-0148-4b4c-b25b-d71c80d38a1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:09.144324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3e096cb1-0148-4b4c-b25b-d71c80d38a1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:09.152850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3e096cb1-0148-4b4c-b25b-d71c80d38a1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083869 Aug 08 09:09:09.153447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 915/1739] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:09.597388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f4533afc-fd0c-4266-91af-12f7cc1b8db1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:09.598018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f4533afc-fd0c-4266-91af-12f7cc1b8db1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:09.604541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4533afc-fd0c-4266-91af-12f7cc1b8db1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:09.605031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4533afc-fd0c-4266-91af-12f7cc1b8db1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:09.605503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4533afc-fd0c-4266-91af-12f7cc1b8db1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:09.606228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4533afc-fd0c-4266-91af-12f7cc1b8db1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:09.606690 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4533afc-fd0c-4266-91af-12f7cc1b8db1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:09.607121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f4533afc-fd0c-4266-91af-12f7cc1b8db1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:09.737434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f4533afc-fd0c-4266-91af-12f7cc1b8db1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:09.746042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f4533afc-fd0c-4266-91af-12f7cc1b8db1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152614 Aug 08 09:09:09.746632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 825/1740] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:09 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:10.174335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-279b244e-3e77-4c14-85da-bf0d8679ef36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:10.174948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-279b244e-3e77-4c14-85da-bf0d8679ef36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:10.182186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-279b244e-3e77-4c14-85da-bf0d8679ef36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:10.182668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-279b244e-3e77-4c14-85da-bf0d8679ef36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:10.183131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-279b244e-3e77-4c14-85da-bf0d8679ef36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:10.183895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-279b244e-3e77-4c14-85da-bf0d8679ef36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:10.184329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-279b244e-3e77-4c14-85da-bf0d8679ef36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:10.184756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-279b244e-3e77-4c14-85da-bf0d8679ef36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:10.245316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-279b244e-3e77-4c14-85da-bf0d8679ef36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:10.253118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-279b244e-3e77-4c14-85da-bf0d8679ef36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082645 Aug 08 09:09:10.253698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 916/1741] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:10 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:10.768156 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-98547a23-9f1f-48ef-8b8d-f52c908ae54f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:10.768760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-98547a23-9f1f-48ef-8b8d-f52c908ae54f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:10.776429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98547a23-9f1f-48ef-8b8d-f52c908ae54f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:10.776928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98547a23-9f1f-48ef-8b8d-f52c908ae54f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:10.777404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98547a23-9f1f-48ef-8b8d-f52c908ae54f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:10.778124 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98547a23-9f1f-48ef-8b8d-f52c908ae54f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:10.778591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98547a23-9f1f-48ef-8b8d-f52c908ae54f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:10.779019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98547a23-9f1f-48ef-8b8d-f52c908ae54f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:10.911279 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-98547a23-9f1f-48ef-8b8d-f52c908ae54f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:10.919234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-98547a23-9f1f-48ef-8b8d-f52c908ae54f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.155118 Aug 08 09:09:10.919793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 826/1742] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:10 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:11.274288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0e1bde8d-cab9-47b4-a0f9-4b3303913594 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:11.274901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0e1bde8d-cab9-47b4-a0f9-4b3303913594 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:11.281207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1bde8d-cab9-47b4-a0f9-4b3303913594 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:11.281688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1bde8d-cab9-47b4-a0f9-4b3303913594 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:11.282123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1bde8d-cab9-47b4-a0f9-4b3303913594 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:11.282806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1bde8d-cab9-47b4-a0f9-4b3303913594 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:11.283256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1bde8d-cab9-47b4-a0f9-4b3303913594 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:11.283679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e1bde8d-cab9-47b4-a0f9-4b3303913594 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:11.347133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0e1bde8d-cab9-47b4-a0f9-4b3303913594 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:11.355456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0e1bde8d-cab9-47b4-a0f9-4b3303913594 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085117 Aug 08 09:09:11.356040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 917/1743] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:11 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:11.939480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2b8e548a-1408-4a9c-a184-d182cd525edb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:11.940101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2b8e548a-1408-4a9c-a184-d182cd525edb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:11.946566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b8e548a-1408-4a9c-a184-d182cd525edb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:11.947054 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b8e548a-1408-4a9c-a184-d182cd525edb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:11.947496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b8e548a-1408-4a9c-a184-d182cd525edb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:11.948194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b8e548a-1408-4a9c-a184-d182cd525edb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:11.948657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b8e548a-1408-4a9c-a184-d182cd525edb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:11.949092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2b8e548a-1408-4a9c-a184-d182cd525edb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:12.076753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2b8e548a-1408-4a9c-a184-d182cd525edb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:12.084611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2b8e548a-1408-4a9c-a184-d182cd525edb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148977 Aug 08 09:09:12.085730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 827/1744] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:11 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:12.376765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-865d5620-fc90-4cd2-a748-cb34709c9bee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:12.377422 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-865d5620-fc90-4cd2-a748-cb34709c9bee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:12.384425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-865d5620-fc90-4cd2-a748-cb34709c9bee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:12.384987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-865d5620-fc90-4cd2-a748-cb34709c9bee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:12.385457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-865d5620-fc90-4cd2-a748-cb34709c9bee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:12.386151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-865d5620-fc90-4cd2-a748-cb34709c9bee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:12.386610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-865d5620-fc90-4cd2-a748-cb34709c9bee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:12.387036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-865d5620-fc90-4cd2-a748-cb34709c9bee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:12.447133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-865d5620-fc90-4cd2-a748-cb34709c9bee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:12.454962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-865d5620-fc90-4cd2-a748-cb34709c9bee tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082109 Aug 08 09:09:12.455515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 918/1745] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:12 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:13.106487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8bfd520b-da2a-412f-939f-264c7b27b611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:13.107101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8bfd520b-da2a-412f-939f-264c7b27b611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:13.113539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8bfd520b-da2a-412f-939f-264c7b27b611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:13.114029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8bfd520b-da2a-412f-939f-264c7b27b611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:13.114468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8bfd520b-da2a-412f-939f-264c7b27b611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:13.115164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8bfd520b-da2a-412f-939f-264c7b27b611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:13.115622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8bfd520b-da2a-412f-939f-264c7b27b611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:13.116051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8bfd520b-da2a-412f-939f-264c7b27b611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:13.248814 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8bfd520b-da2a-412f-939f-264c7b27b611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:13.257346 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8bfd520b-da2a-412f-939f-264c7b27b611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154264 Aug 08 09:09:13.257916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 828/1746] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:13 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:13.475847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9dd46ffd-6e72-4b88-b91b-b7f5d3b9f10e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:13.476606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9dd46ffd-6e72-4b88-b91b-b7f5d3b9f10e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:13.482956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dd46ffd-6e72-4b88-b91b-b7f5d3b9f10e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:13.483434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dd46ffd-6e72-4b88-b91b-b7f5d3b9f10e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:13.483868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dd46ffd-6e72-4b88-b91b-b7f5d3b9f10e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:13.484585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dd46ffd-6e72-4b88-b91b-b7f5d3b9f10e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:13.485037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dd46ffd-6e72-4b88-b91b-b7f5d3b9f10e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:13.485484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9dd46ffd-6e72-4b88-b91b-b7f5d3b9f10e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:13.546335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9dd46ffd-6e72-4b88-b91b-b7f5d3b9f10e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:13.554894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9dd46ffd-6e72-4b88-b91b-b7f5d3b9f10e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082969 Aug 08 09:09:13.555454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 919/1747] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:14.278922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-10c21eba-ba33-4b60-8d2e-6c5d28193974 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:14.279482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-10c21eba-ba33-4b60-8d2e-6c5d28193974 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:14.285846 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10c21eba-ba33-4b60-8d2e-6c5d28193974 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:14.286321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10c21eba-ba33-4b60-8d2e-6c5d28193974 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:14.286753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10c21eba-ba33-4b60-8d2e-6c5d28193974 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:14.287437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10c21eba-ba33-4b60-8d2e-6c5d28193974 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:14.287889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10c21eba-ba33-4b60-8d2e-6c5d28193974 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:14.289079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-10c21eba-ba33-4b60-8d2e-6c5d28193974 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:14.415752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-10c21eba-ba33-4b60-8d2e-6c5d28193974 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:14.423689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-10c21eba-ba33-4b60-8d2e-6c5d28193974 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148734 Aug 08 09:09:14.424242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 829/1748] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:14 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:14.576131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c9153708-976d-46a1-8f11-1630fc942991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:14.576665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c9153708-976d-46a1-8f11-1630fc942991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:14.583176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9153708-976d-46a1-8f11-1630fc942991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:14.583652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9153708-976d-46a1-8f11-1630fc942991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:14.584084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9153708-976d-46a1-8f11-1630fc942991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:14.584769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9153708-976d-46a1-8f11-1630fc942991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:14.585287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9153708-976d-46a1-8f11-1630fc942991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:14.585714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9153708-976d-46a1-8f11-1630fc942991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:14.603581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:09:14.650355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c9153708-976d-46a1-8f11-1630fc942991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:14.658060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c9153708-976d-46a1-8f11-1630fc942991 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085848 Aug 08 09:09:14.658615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 920/1749] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:15.445861 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-da744965-6e10-4d82-9003-10f7d5d9a8c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:15.446473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-da744965-6e10-4d82-9003-10f7d5d9a8c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:15.452807 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da744965-6e10-4d82-9003-10f7d5d9a8c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:15.453325 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da744965-6e10-4d82-9003-10f7d5d9a8c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:15.453762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da744965-6e10-4d82-9003-10f7d5d9a8c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:15.454452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da744965-6e10-4d82-9003-10f7d5d9a8c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:15.454912 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da744965-6e10-4d82-9003-10f7d5d9a8c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:15.455330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-da744965-6e10-4d82-9003-10f7d5d9a8c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:15.584223 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-da744965-6e10-4d82-9003-10f7d5d9a8c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:15.592782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-da744965-6e10-4d82-9003-10f7d5d9a8c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151455 Aug 08 09:09:15.593359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 830/1750] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:15 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:15.680080 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d1d1d4a6-2457-4fe9-8315-59383783d798 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:15.680623 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d1d1d4a6-2457-4fe9-8315-59383783d798 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:15.686904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d1d4a6-2457-4fe9-8315-59383783d798 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:15.687394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d1d4a6-2457-4fe9-8315-59383783d798 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:15.687817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d1d4a6-2457-4fe9-8315-59383783d798 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:15.688500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d1d4a6-2457-4fe9-8315-59383783d798 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:15.688951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d1d4a6-2457-4fe9-8315-59383783d798 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:15.689406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1d1d4a6-2457-4fe9-8315-59383783d798 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:15.749935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d1d1d4a6-2457-4fe9-8315-59383783d798 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:15.758458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d1d1d4a6-2457-4fe9-8315-59383783d798 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082336 Aug 08 09:09:15.759006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 921/1751] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:15 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:16.613873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-76e69676-c4d4-41b0-b431-a8e5f285b88a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:16.614486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-76e69676-c4d4-41b0-b431-a8e5f285b88a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:16.621034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76e69676-c4d4-41b0-b431-a8e5f285b88a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:16.621544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76e69676-c4d4-41b0-b431-a8e5f285b88a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:16.621981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76e69676-c4d4-41b0-b431-a8e5f285b88a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:16.622666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76e69676-c4d4-41b0-b431-a8e5f285b88a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:16.623118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76e69676-c4d4-41b0-b431-a8e5f285b88a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:16.623541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-76e69676-c4d4-41b0-b431-a8e5f285b88a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:16.752056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-76e69676-c4d4-41b0-b431-a8e5f285b88a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:16.760177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-76e69676-c4d4-41b0-b431-a8e5f285b88a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150143 Aug 08 09:09:16.760738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 831/1752] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:16 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:16.779334 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5623482e-9a8e-429e-8e18-edeb27557d98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:16.779944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5623482e-9a8e-429e-8e18-edeb27557d98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:16.786284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5623482e-9a8e-429e-8e18-edeb27557d98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:16.786763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5623482e-9a8e-429e-8e18-edeb27557d98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:16.787198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5623482e-9a8e-429e-8e18-edeb27557d98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:16.787880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5623482e-9a8e-429e-8e18-edeb27557d98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:16.788971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5623482e-9a8e-429e-8e18-edeb27557d98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:16.789503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5623482e-9a8e-429e-8e18-edeb27557d98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:16.849771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5623482e-9a8e-429e-8e18-edeb27557d98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:16.858260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5623482e-9a8e-429e-8e18-edeb27557d98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082664 Aug 08 09:09:16.858817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 922/1753] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:17.781512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-04272fa4-868c-4628-a278-5e46f4703924 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:17.782045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-04272fa4-868c-4628-a278-5e46f4703924 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:17.788373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04272fa4-868c-4628-a278-5e46f4703924 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:17.788864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04272fa4-868c-4628-a278-5e46f4703924 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:17.789337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04272fa4-868c-4628-a278-5e46f4703924 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:17.790032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04272fa4-868c-4628-a278-5e46f4703924 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:17.790492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04272fa4-868c-4628-a278-5e46f4703924 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:17.790917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04272fa4-868c-4628-a278-5e46f4703924 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:17.878787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-65469cce-69d1-425e-9e27-b941df18c68d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:17.879409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-65469cce-69d1-425e-9e27-b941df18c68d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:17.886757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65469cce-69d1-425e-9e27-b941df18c68d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:17.887240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65469cce-69d1-425e-9e27-b941df18c68d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:17.887674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65469cce-69d1-425e-9e27-b941df18c68d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:17.888393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65469cce-69d1-425e-9e27-b941df18c68d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:17.888845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65469cce-69d1-425e-9e27-b941df18c68d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:17.889300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-65469cce-69d1-425e-9e27-b941df18c68d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:17.918251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-04272fa4-868c-4628-a278-5e46f4703924 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:17.926274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-04272fa4-868c-4628-a278-5e46f4703924 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148776 Aug 08 09:09:17.926843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 832/1754] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:17 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:17.954189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-65469cce-69d1-425e-9e27-b941df18c68d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:17.962089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-65469cce-69d1-425e-9e27-b941df18c68d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087162 Aug 08 09:09:17.962649 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 923/1755] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:17 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:18.946633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cf6dfe41-f097-403e-a480-aef04e90e44b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:18.947248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cf6dfe41-f097-403e-a480-aef04e90e44b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:18.953754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf6dfe41-f097-403e-a480-aef04e90e44b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:18.954239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf6dfe41-f097-403e-a480-aef04e90e44b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:18.954680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf6dfe41-f097-403e-a480-aef04e90e44b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:18.955374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf6dfe41-f097-403e-a480-aef04e90e44b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:18.955830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf6dfe41-f097-403e-a480-aef04e90e44b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:18.956261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf6dfe41-f097-403e-a480-aef04e90e44b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:18.982294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7d24b605-a390-4ae7-af2e-318b8fe162cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:18.982932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7d24b605-a390-4ae7-af2e-318b8fe162cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:18.989281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d24b605-a390-4ae7-af2e-318b8fe162cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:18.989763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d24b605-a390-4ae7-af2e-318b8fe162cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:18.990191 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d24b605-a390-4ae7-af2e-318b8fe162cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:18.990877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d24b605-a390-4ae7-af2e-318b8fe162cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:18.991818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d24b605-a390-4ae7-af2e-318b8fe162cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:18.992240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d24b605-a390-4ae7-af2e-318b8fe162cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:19.064017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7d24b605-a390-4ae7-af2e-318b8fe162cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:19.072693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7d24b605-a390-4ae7-af2e-318b8fe162cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.094202 Aug 08 09:09:19.073282 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 924/1756] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:18 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:19.110193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cf6dfe41-f097-403e-a480-aef04e90e44b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:19.113642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:09:19.119090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cf6dfe41-f097-403e-a480-aef04e90e44b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.176991 Aug 08 09:09:19.119646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 833/1757] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:18 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:20.093591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2b753750-f521-4c86-a7df-ba2aa58f433a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:20.094124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2b753750-f521-4c86-a7df-ba2aa58f433a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:20.100430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b753750-f521-4c86-a7df-ba2aa58f433a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:20.100915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b753750-f521-4c86-a7df-ba2aa58f433a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:20.101391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b753750-f521-4c86-a7df-ba2aa58f433a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:20.102120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b753750-f521-4c86-a7df-ba2aa58f433a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:20.102574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b753750-f521-4c86-a7df-ba2aa58f433a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:20.102998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2b753750-f521-4c86-a7df-ba2aa58f433a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:20.144770 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c494dad6-de7d-429e-a308-a94c29f4c4c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:20.145405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c494dad6-de7d-429e-a308-a94c29f4c4c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:20.152677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c494dad6-de7d-429e-a308-a94c29f4c4c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:20.153185 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c494dad6-de7d-429e-a308-a94c29f4c4c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:20.153629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c494dad6-de7d-429e-a308-a94c29f4c4c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:20.154324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c494dad6-de7d-429e-a308-a94c29f4c4c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:20.154779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c494dad6-de7d-429e-a308-a94c29f4c4c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:20.155201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c494dad6-de7d-429e-a308-a94c29f4c4c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:20.163514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2b753750-f521-4c86-a7df-ba2aa58f433a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:20.171581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2b753750-f521-4c86-a7df-ba2aa58f433a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081896 Aug 08 09:09:20.172146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 925/1758] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:20 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:20.287298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c494dad6-de7d-429e-a308-a94c29f4c4c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:20.295119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c494dad6-de7d-429e-a308-a94c29f4c4c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154281 Aug 08 09:09:20.295672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 834/1759] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:20 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:21.192876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8b577c1f-d2af-437a-8802-9c9006b2c754 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:21.193517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8b577c1f-d2af-437a-8802-9c9006b2c754 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:21.200178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b577c1f-d2af-437a-8802-9c9006b2c754 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:21.200654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b577c1f-d2af-437a-8802-9c9006b2c754 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:21.201087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b577c1f-d2af-437a-8802-9c9006b2c754 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:21.201797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b577c1f-d2af-437a-8802-9c9006b2c754 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:21.202246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b577c1f-d2af-437a-8802-9c9006b2c754 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:21.202667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b577c1f-d2af-437a-8802-9c9006b2c754 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:21.264824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8b577c1f-d2af-437a-8802-9c9006b2c754 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:21.272923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8b577c1f-d2af-437a-8802-9c9006b2c754 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083880 Aug 08 09:09:21.273530 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 926/1760] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:21 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:21.316427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-290999f4-7ba0-4900-8841-c6f835927080 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:21.317112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-290999f4-7ba0-4900-8841-c6f835927080 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:21.323991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-290999f4-7ba0-4900-8841-c6f835927080 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:21.324488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-290999f4-7ba0-4900-8841-c6f835927080 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:21.324934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-290999f4-7ba0-4900-8841-c6f835927080 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:21.325664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-290999f4-7ba0-4900-8841-c6f835927080 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:21.326131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-290999f4-7ba0-4900-8841-c6f835927080 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:21.326565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-290999f4-7ba0-4900-8841-c6f835927080 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:21.458370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-290999f4-7ba0-4900-8841-c6f835927080 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:21.467081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-290999f4-7ba0-4900-8841-c6f835927080 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154493 Aug 08 09:09:21.467637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 835/1761] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:21 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:22.297045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7aac3e01-3c60-46b3-ae03-161b8070c47b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:22.297903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7aac3e01-3c60-46b3-ae03-161b8070c47b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:22.308918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7aac3e01-3c60-46b3-ae03-161b8070c47b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:22.309384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7aac3e01-3c60-46b3-ae03-161b8070c47b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:22.309831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7aac3e01-3c60-46b3-ae03-161b8070c47b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:22.310535 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7aac3e01-3c60-46b3-ae03-161b8070c47b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:22.311020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7aac3e01-3c60-46b3-ae03-161b8070c47b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:22.311487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7aac3e01-3c60-46b3-ae03-161b8070c47b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:22.380232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7aac3e01-3c60-46b3-ae03-161b8070c47b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:22.391270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7aac3e01-3c60-46b3-ae03-161b8070c47b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.099699 Aug 08 09:09:22.391849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 927/1762] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:22.491344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-267abb16-4523-4b3d-833d-017a11b472ad tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:22.492367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-267abb16-4523-4b3d-833d-017a11b472ad tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:22.500425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267abb16-4523-4b3d-833d-017a11b472ad tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:22.500911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267abb16-4523-4b3d-833d-017a11b472ad tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:22.501388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267abb16-4523-4b3d-833d-017a11b472ad tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:22.502469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267abb16-4523-4b3d-833d-017a11b472ad tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:22.502927 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267abb16-4523-4b3d-833d-017a11b472ad tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:22.503355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-267abb16-4523-4b3d-833d-017a11b472ad tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:22.638276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-267abb16-4523-4b3d-833d-017a11b472ad tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:22.646561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-267abb16-4523-4b3d-833d-017a11b472ad tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.162024 Aug 08 09:09:22.647143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 836/1763] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:22 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:23.412302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ae154c36-4ec0-436f-abe2-eb2057d603a9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:23.412940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ae154c36-4ec0-436f-abe2-eb2057d603a9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:23.419803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae154c36-4ec0-436f-abe2-eb2057d603a9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:23.420295 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae154c36-4ec0-436f-abe2-eb2057d603a9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:23.420739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae154c36-4ec0-436f-abe2-eb2057d603a9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:23.421494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae154c36-4ec0-436f-abe2-eb2057d603a9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:23.421983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae154c36-4ec0-436f-abe2-eb2057d603a9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:23.422415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae154c36-4ec0-436f-abe2-eb2057d603a9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:23.483218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ae154c36-4ec0-436f-abe2-eb2057d603a9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:23.491238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ae154c36-4ec0-436f-abe2-eb2057d603a9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082749 Aug 08 09:09:23.491805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 928/1764] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:23.667562 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f958b784-e738-43be-afe3-52a78c831c92 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:23.668204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f958b784-e738-43be-afe3-52a78c831c92 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:23.674627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f958b784-e738-43be-afe3-52a78c831c92 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:23.675133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f958b784-e738-43be-afe3-52a78c831c92 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:23.675590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f958b784-e738-43be-afe3-52a78c831c92 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:23.676285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f958b784-e738-43be-afe3-52a78c831c92 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:23.676740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f958b784-e738-43be-afe3-52a78c831c92 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:23.677186 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f958b784-e738-43be-afe3-52a78c831c92 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:23.816343 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f958b784-e738-43be-afe3-52a78c831c92 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:23.825046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f958b784-e738-43be-afe3-52a78c831c92 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.161937 Aug 08 09:09:23.825726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 837/1765] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:23 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:24.514182 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7b65696f-99ed-4ff0-8fe7-368c62367468 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:24.514795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7b65696f-99ed-4ff0-8fe7-368c62367468 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:24.521061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b65696f-99ed-4ff0-8fe7-368c62367468 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:24.521577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b65696f-99ed-4ff0-8fe7-368c62367468 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:24.522010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b65696f-99ed-4ff0-8fe7-368c62367468 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:24.522694 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b65696f-99ed-4ff0-8fe7-368c62367468 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:24.523144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b65696f-99ed-4ff0-8fe7-368c62367468 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:24.523568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b65696f-99ed-4ff0-8fe7-368c62367468 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:24.584222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7b65696f-99ed-4ff0-8fe7-368c62367468 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:24.592119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7b65696f-99ed-4ff0-8fe7-368c62367468 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081798 Aug 08 09:09:24.592677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 929/1766] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:24 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:24.846519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4bc3b957-d644-4ff5-954b-a201f4f8115b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:24.847084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4bc3b957-d644-4ff5-954b-a201f4f8115b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:24.854268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bc3b957-d644-4ff5-954b-a201f4f8115b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:24.854759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bc3b957-d644-4ff5-954b-a201f4f8115b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:24.855198 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bc3b957-d644-4ff5-954b-a201f4f8115b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:24.855896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bc3b957-d644-4ff5-954b-a201f4f8115b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:24.856353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bc3b957-d644-4ff5-954b-a201f4f8115b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:24.856782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4bc3b957-d644-4ff5-954b-a201f4f8115b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:24.987949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4bc3b957-d644-4ff5-954b-a201f4f8115b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:24.995774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4bc3b957-d644-4ff5-954b-a201f4f8115b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153256 Aug 08 09:09:24.996333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 838/1767] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:24 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:25.613336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ec247507-bf62-4d32-b7b6-b4d7b0dbc47a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:25.613954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ec247507-bf62-4d32-b7b6-b4d7b0dbc47a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:25.620908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec247507-bf62-4d32-b7b6-b4d7b0dbc47a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:25.621502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec247507-bf62-4d32-b7b6-b4d7b0dbc47a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:25.621946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec247507-bf62-4d32-b7b6-b4d7b0dbc47a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:25.622641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec247507-bf62-4d32-b7b6-b4d7b0dbc47a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:25.623113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec247507-bf62-4d32-b7b6-b4d7b0dbc47a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:25.623527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ec247507-bf62-4d32-b7b6-b4d7b0dbc47a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:25.684980 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ec247507-bf62-4d32-b7b6-b4d7b0dbc47a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:25.693429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ec247507-bf62-4d32-b7b6-b4d7b0dbc47a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083952 Aug 08 09:09:25.693985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 930/1768] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:26.016936 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8e916495-e041-4c2c-8044-0bc0d0c25d5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:26.017574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8e916495-e041-4c2c-8044-0bc0d0c25d5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:26.023947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e916495-e041-4c2c-8044-0bc0d0c25d5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:26.028596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e916495-e041-4c2c-8044-0bc0d0c25d5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:26.028596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e916495-e041-4c2c-8044-0bc0d0c25d5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:26.028596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e916495-e041-4c2c-8044-0bc0d0c25d5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:26.028596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e916495-e041-4c2c-8044-0bc0d0c25d5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:26.029005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e916495-e041-4c2c-8044-0bc0d0c25d5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:26.152819 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8e916495-e041-4c2c-8044-0bc0d0c25d5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:26.160762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8e916495-e041-4c2c-8044-0bc0d0c25d5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.147749 Aug 08 09:09:26.161345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 839/1769] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:26 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:26.715056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e12153db-1827-4106-919b-5833003c52fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:26.715579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e12153db-1827-4106-919b-5833003c52fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:26.722189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e12153db-1827-4106-919b-5833003c52fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:26.722671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e12153db-1827-4106-919b-5833003c52fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:26.723100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e12153db-1827-4106-919b-5833003c52fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:26.723817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e12153db-1827-4106-919b-5833003c52fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:26.724266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e12153db-1827-4106-919b-5833003c52fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:26.724714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e12153db-1827-4106-919b-5833003c52fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:26.785729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e12153db-1827-4106-919b-5833003c52fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:26.793819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e12153db-1827-4106-919b-5833003c52fd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083476 Aug 08 09:09:26.794372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 931/1770] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:27.182796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8e0b6629-f0bc-4146-9750-94e853a29e9a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:27.183416 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8e0b6629-f0bc-4146-9750-94e853a29e9a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:27.189903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e0b6629-f0bc-4146-9750-94e853a29e9a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:27.190391 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e0b6629-f0bc-4146-9750-94e853a29e9a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:27.190833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e0b6629-f0bc-4146-9750-94e853a29e9a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:27.191531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e0b6629-f0bc-4146-9750-94e853a29e9a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:27.191988 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e0b6629-f0bc-4146-9750-94e853a29e9a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:27.192417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e0b6629-f0bc-4146-9750-94e853a29e9a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:27.325697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8e0b6629-f0bc-4146-9750-94e853a29e9a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:27.333590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8e0b6629-f0bc-4146-9750-94e853a29e9a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.155128 Aug 08 09:09:27.334162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 840/1771] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:27 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:27.814659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9b07b0d3-dae5-450d-b8c0-b04a134479cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:27.815280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9b07b0d3-dae5-450d-b8c0-b04a134479cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:27.821736 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b07b0d3-dae5-450d-b8c0-b04a134479cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:27.822221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b07b0d3-dae5-450d-b8c0-b04a134479cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:27.822664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b07b0d3-dae5-450d-b8c0-b04a134479cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:27.823360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b07b0d3-dae5-450d-b8c0-b04a134479cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:27.823817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b07b0d3-dae5-450d-b8c0-b04a134479cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:27.824250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b07b0d3-dae5-450d-b8c0-b04a134479cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:27.885438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9b07b0d3-dae5-450d-b8c0-b04a134479cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:27.893959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9b07b0d3-dae5-450d-b8c0-b04a134479cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083120 Aug 08 09:09:27.894510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 932/1772] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:27 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:28.354828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1e0b2e38-d2f3-4dd5-b5ac-365a9a5d9cbd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:28.355476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1e0b2e38-d2f3-4dd5-b5ac-365a9a5d9cbd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:28.361864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e0b2e38-d2f3-4dd5-b5ac-365a9a5d9cbd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:28.362351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e0b2e38-d2f3-4dd5-b5ac-365a9a5d9cbd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:28.362786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e0b2e38-d2f3-4dd5-b5ac-365a9a5d9cbd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:28.363478 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e0b2e38-d2f3-4dd5-b5ac-365a9a5d9cbd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:28.363937 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e0b2e38-d2f3-4dd5-b5ac-365a9a5d9cbd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:28.364361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e0b2e38-d2f3-4dd5-b5ac-365a9a5d9cbd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:28.497571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1e0b2e38-d2f3-4dd5-b5ac-365a9a5d9cbd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:28.505499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1e0b2e38-d2f3-4dd5-b5ac-365a9a5d9cbd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154634 Aug 08 09:09:28.506055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 841/1773] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:28 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:28.916201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a74b1eaf-86f2-4e06-bfae-4683cae2fd82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:28.916846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a74b1eaf-86f2-4e06-bfae-4683cae2fd82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:28.923172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a74b1eaf-86f2-4e06-bfae-4683cae2fd82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:28.923913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a74b1eaf-86f2-4e06-bfae-4683cae2fd82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:28.924358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a74b1eaf-86f2-4e06-bfae-4683cae2fd82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:28.925039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a74b1eaf-86f2-4e06-bfae-4683cae2fd82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:28.925512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a74b1eaf-86f2-4e06-bfae-4683cae2fd82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:28.925938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a74b1eaf-86f2-4e06-bfae-4683cae2fd82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:28.987593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a74b1eaf-86f2-4e06-bfae-4683cae2fd82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:28.996040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a74b1eaf-86f2-4e06-bfae-4683cae2fd82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084545 Aug 08 09:09:28.996593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 933/1774] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:28 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:29.527787 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7efdfd16-4482-4958-88ce-0cc5c18d16e0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:29.528396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7efdfd16-4482-4958-88ce-0cc5c18d16e0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:29.534935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7efdfd16-4482-4958-88ce-0cc5c18d16e0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:29.535422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7efdfd16-4482-4958-88ce-0cc5c18d16e0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:29.535859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7efdfd16-4482-4958-88ce-0cc5c18d16e0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:29.536552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7efdfd16-4482-4958-88ce-0cc5c18d16e0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:29.537009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7efdfd16-4482-4958-88ce-0cc5c18d16e0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:29.537468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7efdfd16-4482-4958-88ce-0cc5c18d16e0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:29.665627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7efdfd16-4482-4958-88ce-0cc5c18d16e0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:29.673581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7efdfd16-4482-4958-88ce-0cc5c18d16e0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150170 Aug 08 09:09:29.674083 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 842/1775] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:29 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:30.017212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ce8afd6e-789c-49ef-8a4e-92b3cbedf9aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:30.017762 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ce8afd6e-789c-49ef-8a4e-92b3cbedf9aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:30.024224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce8afd6e-789c-49ef-8a4e-92b3cbedf9aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:30.024707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce8afd6e-789c-49ef-8a4e-92b3cbedf9aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:30.025167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce8afd6e-789c-49ef-8a4e-92b3cbedf9aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:30.025872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce8afd6e-789c-49ef-8a4e-92b3cbedf9aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:30.026337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce8afd6e-789c-49ef-8a4e-92b3cbedf9aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:30.026768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce8afd6e-789c-49ef-8a4e-92b3cbedf9aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:30.089711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ce8afd6e-789c-49ef-8a4e-92b3cbedf9aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:30.098668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ce8afd6e-789c-49ef-8a4e-92b3cbedf9aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085252 Aug 08 09:09:30.099275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 934/1776] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:30 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:30.694180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2ce8fff7-3322-4174-b0f5-6849dd25e611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:30.694713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2ce8fff7-3322-4174-b0f5-6849dd25e611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:30.701443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ce8fff7-3322-4174-b0f5-6849dd25e611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:30.701939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ce8fff7-3322-4174-b0f5-6849dd25e611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:30.702383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ce8fff7-3322-4174-b0f5-6849dd25e611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:30.703089 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ce8fff7-3322-4174-b0f5-6849dd25e611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:30.703553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ce8fff7-3322-4174-b0f5-6849dd25e611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:30.703985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ce8fff7-3322-4174-b0f5-6849dd25e611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:30.834953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2ce8fff7-3322-4174-b0f5-6849dd25e611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:30.843485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2ce8fff7-3322-4174-b0f5-6849dd25e611 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153274 Aug 08 09:09:30.844051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 843/1777] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:30 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:31.123567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e554be50-2e73-4004-b1b6-6f8f115336fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:31.124185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e554be50-2e73-4004-b1b6-6f8f115336fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:31.130542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e554be50-2e73-4004-b1b6-6f8f115336fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:31.131026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e554be50-2e73-4004-b1b6-6f8f115336fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:31.131465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e554be50-2e73-4004-b1b6-6f8f115336fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:31.132151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e554be50-2e73-4004-b1b6-6f8f115336fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:31.132869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e554be50-2e73-4004-b1b6-6f8f115336fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:31.133811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e554be50-2e73-4004-b1b6-6f8f115336fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:31.193668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e554be50-2e73-4004-b1b6-6f8f115336fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:31.202093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e554be50-2e73-4004-b1b6-6f8f115336fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082487 Aug 08 09:09:31.202655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 935/1778] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:31 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:31.865502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-48802d14-2934-4310-b025-24983e97ef87 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:31.866117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-48802d14-2934-4310-b025-24983e97ef87 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:31.872996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48802d14-2934-4310-b025-24983e97ef87 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:31.873507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48802d14-2934-4310-b025-24983e97ef87 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:31.873938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48802d14-2934-4310-b025-24983e97ef87 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:31.874623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48802d14-2934-4310-b025-24983e97ef87 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:31.875080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48802d14-2934-4310-b025-24983e97ef87 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:31.875505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48802d14-2934-4310-b025-24983e97ef87 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:32.005718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-48802d14-2934-4310-b025-24983e97ef87 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:32.014163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-48802d14-2934-4310-b025-24983e97ef87 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152519 Aug 08 09:09:32.014718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 844/1779] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:31 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:32.223398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2c2a5ac8-f8d9-4ad2-ac21-e5a1c5feff44 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:32.224044 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2c2a5ac8-f8d9-4ad2-ac21-e5a1c5feff44 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:32.231225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c2a5ac8-f8d9-4ad2-ac21-e5a1c5feff44 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:32.231707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c2a5ac8-f8d9-4ad2-ac21-e5a1c5feff44 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:32.232148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c2a5ac8-f8d9-4ad2-ac21-e5a1c5feff44 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:32.232836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c2a5ac8-f8d9-4ad2-ac21-e5a1c5feff44 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:32.233322 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c2a5ac8-f8d9-4ad2-ac21-e5a1c5feff44 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:32.233750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2c2a5ac8-f8d9-4ad2-ac21-e5a1c5feff44 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:32.294896 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2c2a5ac8-f8d9-4ad2-ac21-e5a1c5feff44 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:32.302797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2c2a5ac8-f8d9-4ad2-ac21-e5a1c5feff44 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083259 Aug 08 09:09:32.309955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 936/1780] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:33.035137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c8e528bb-d81b-4bf6-8759-7164f0e4e56b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:33.035756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c8e528bb-d81b-4bf6-8759-7164f0e4e56b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:33.042811 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8e528bb-d81b-4bf6-8759-7164f0e4e56b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:33.043301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8e528bb-d81b-4bf6-8759-7164f0e4e56b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:33.043743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8e528bb-d81b-4bf6-8759-7164f0e4e56b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:33.044441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8e528bb-d81b-4bf6-8759-7164f0e4e56b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:33.044906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8e528bb-d81b-4bf6-8759-7164f0e4e56b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:33.045373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c8e528bb-d81b-4bf6-8759-7164f0e4e56b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:33.171496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c8e528bb-d81b-4bf6-8759-7164f0e4e56b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:33.179378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c8e528bb-d81b-4bf6-8759-7164f0e4e56b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148120 Aug 08 09:09:33.180041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 845/1781] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:33 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:33.324495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d70efcfd-cca6-416e-812a-1afeeace3020 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:33.325061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d70efcfd-cca6-416e-812a-1afeeace3020 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:33.331477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d70efcfd-cca6-416e-812a-1afeeace3020 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:33.331961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d70efcfd-cca6-416e-812a-1afeeace3020 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:33.332401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d70efcfd-cca6-416e-812a-1afeeace3020 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:33.333097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d70efcfd-cca6-416e-812a-1afeeace3020 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:33.333580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d70efcfd-cca6-416e-812a-1afeeace3020 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:33.334010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d70efcfd-cca6-416e-812a-1afeeace3020 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:33.338576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:09:33.394046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d70efcfd-cca6-416e-812a-1afeeace3020 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:33.402608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d70efcfd-cca6-416e-812a-1afeeace3020 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082641 Aug 08 09:09:33.403167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 937/1782] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:33 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:34.200031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-69fd1287-74f2-4cf6-bb83-aae4758f7037 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:34.200642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-69fd1287-74f2-4cf6-bb83-aae4758f7037 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:34.207118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69fd1287-74f2-4cf6-bb83-aae4758f7037 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:34.207605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69fd1287-74f2-4cf6-bb83-aae4758f7037 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:34.208070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69fd1287-74f2-4cf6-bb83-aae4758f7037 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:34.208763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69fd1287-74f2-4cf6-bb83-aae4758f7037 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:34.209243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69fd1287-74f2-4cf6-bb83-aae4758f7037 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:34.209674 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-69fd1287-74f2-4cf6-bb83-aae4758f7037 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:34.341672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-69fd1287-74f2-4cf6-bb83-aae4758f7037 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:34.349507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-69fd1287-74f2-4cf6-bb83-aae4758f7037 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153471 Aug 08 09:09:34.350074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 846/1783] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:34 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:34.423280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7ea13b52-cc12-4670-81c7-4d89544a2a9e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:34.423899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7ea13b52-cc12-4670-81c7-4d89544a2a9e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:34.430996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea13b52-cc12-4670-81c7-4d89544a2a9e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:34.431395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea13b52-cc12-4670-81c7-4d89544a2a9e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:34.431833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea13b52-cc12-4670-81c7-4d89544a2a9e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:34.432554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea13b52-cc12-4670-81c7-4d89544a2a9e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:34.433009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea13b52-cc12-4670-81c7-4d89544a2a9e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:34.433472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea13b52-cc12-4670-81c7-4d89544a2a9e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:34.492868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7ea13b52-cc12-4670-81c7-4d89544a2a9e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:34.500576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7ea13b52-cc12-4670-81c7-4d89544a2a9e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081142 Aug 08 09:09:34.501138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 938/1784] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:35.370845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1c3eda30-9b5b-4357-a72e-9419430aab37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:35.371462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1c3eda30-9b5b-4357-a72e-9419430aab37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:35.377843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c3eda30-9b5b-4357-a72e-9419430aab37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:35.378357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c3eda30-9b5b-4357-a72e-9419430aab37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:35.378797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c3eda30-9b5b-4357-a72e-9419430aab37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:35.379488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c3eda30-9b5b-4357-a72e-9419430aab37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:35.379947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c3eda30-9b5b-4357-a72e-9419430aab37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:35.380375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1c3eda30-9b5b-4357-a72e-9419430aab37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:35.509051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1c3eda30-9b5b-4357-a72e-9419430aab37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:35.517251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1c3eda30-9b5b-4357-a72e-9419430aab37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150657 Aug 08 09:09:35.517962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 847/1785] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:35 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:35.521551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f61cc1f0-24d4-4ec2-940e-ef2a580e2f25 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:35.522168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f61cc1f0-24d4-4ec2-940e-ef2a580e2f25 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:35.529067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f61cc1f0-24d4-4ec2-940e-ef2a580e2f25 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:35.529577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f61cc1f0-24d4-4ec2-940e-ef2a580e2f25 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:35.530009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f61cc1f0-24d4-4ec2-940e-ef2a580e2f25 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:35.530693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f61cc1f0-24d4-4ec2-940e-ef2a580e2f25 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:35.531144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f61cc1f0-24d4-4ec2-940e-ef2a580e2f25 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:35.531563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f61cc1f0-24d4-4ec2-940e-ef2a580e2f25 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:35.592835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f61cc1f0-24d4-4ec2-940e-ef2a580e2f25 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:35.600900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f61cc1f0-24d4-4ec2-940e-ef2a580e2f25 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083267 Aug 08 09:09:35.601501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 939/1786] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:35 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:36.538521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ded627df-85d2-4440-b512-07a506b789cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:36.539161 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ded627df-85d2-4440-b512-07a506b789cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:36.541081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=52 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:09:36.545733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ded627df-85d2-4440-b512-07a506b789cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:36.546217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ded627df-85d2-4440-b512-07a506b789cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:36.546657 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ded627df-85d2-4440-b512-07a506b789cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:36.547350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ded627df-85d2-4440-b512-07a506b789cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:36.547815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ded627df-85d2-4440-b512-07a506b789cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:36.548245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ded627df-85d2-4440-b512-07a506b789cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:36.622210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ff4b19e4-bbc1-416e-9d2d-304c01356d7d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:36.622823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ff4b19e4-bbc1-416e-9d2d-304c01356d7d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:36.624663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=56 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:09:36.629434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4b19e4-bbc1-416e-9d2d-304c01356d7d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:36.636385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4b19e4-bbc1-416e-9d2d-304c01356d7d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:36.636385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4b19e4-bbc1-416e-9d2d-304c01356d7d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:36.636385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4b19e4-bbc1-416e-9d2d-304c01356d7d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:36.636385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4b19e4-bbc1-416e-9d2d-304c01356d7d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:36.636769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ff4b19e4-bbc1-416e-9d2d-304c01356d7d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:36.687603 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ded627df-85d2-4440-b512-07a506b789cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:36.696294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ded627df-85d2-4440-b512-07a506b789cd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.161192 Aug 08 09:09:36.696868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 848/1787] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:36 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:36.703877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ff4b19e4-bbc1-416e-9d2d-304c01356d7d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:36.712317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ff4b19e4-bbc1-416e-9d2d-304c01356d7d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.094115 Aug 08 09:09:36.712886 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 940/1788] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:37.717954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-828be77b-b04b-4fe7-9f4a-978f3501a252 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:37.718509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-828be77b-b04b-4fe7-9f4a-978f3501a252 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:37.724839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-828be77b-b04b-4fe7-9f4a-978f3501a252 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:37.725353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-828be77b-b04b-4fe7-9f4a-978f3501a252 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:37.725785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-828be77b-b04b-4fe7-9f4a-978f3501a252 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:37.726469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-828be77b-b04b-4fe7-9f4a-978f3501a252 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:37.727021 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-828be77b-b04b-4fe7-9f4a-978f3501a252 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:37.727476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-828be77b-b04b-4fe7-9f4a-978f3501a252 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:37.733622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bd36ab17-69aa-40bc-8e0f-063f2e60032f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:37.734771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bd36ab17-69aa-40bc-8e0f-063f2e60032f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:37.741267 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd36ab17-69aa-40bc-8e0f-063f2e60032f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:37.741753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd36ab17-69aa-40bc-8e0f-063f2e60032f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:37.742233 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd36ab17-69aa-40bc-8e0f-063f2e60032f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:37.743085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd36ab17-69aa-40bc-8e0f-063f2e60032f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:37.743542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd36ab17-69aa-40bc-8e0f-063f2e60032f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:37.743968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd36ab17-69aa-40bc-8e0f-063f2e60032f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:37.826122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bd36ab17-69aa-40bc-8e0f-063f2e60032f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:37.833925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bd36ab17-69aa-40bc-8e0f-063f2e60032f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.104052 Aug 08 09:09:37.834485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 941/1789] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:37 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:37.883711 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-828be77b-b04b-4fe7-9f4a-978f3501a252 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:37.891580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-828be77b-b04b-4fe7-9f4a-978f3501a252 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.177576 Aug 08 09:09:37.892137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 849/1790] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:37 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:38.855929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e6c822e6-a3e9-46f4-87b2-ed3000102014 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:38.856574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e6c822e6-a3e9-46f4-87b2-ed3000102014 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:38.863006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6c822e6-a3e9-46f4-87b2-ed3000102014 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:38.863482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6c822e6-a3e9-46f4-87b2-ed3000102014 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:38.863917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6c822e6-a3e9-46f4-87b2-ed3000102014 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:38.864614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6c822e6-a3e9-46f4-87b2-ed3000102014 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:38.865055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6c822e6-a3e9-46f4-87b2-ed3000102014 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:38.865559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6c822e6-a3e9-46f4-87b2-ed3000102014 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:38.913289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-feb6475b-6c29-44a2-aa74-f2005d0ad424 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:38.914011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-feb6475b-6c29-44a2-aa74-f2005d0ad424 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:38.921304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-feb6475b-6c29-44a2-aa74-f2005d0ad424 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:38.921876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-feb6475b-6c29-44a2-aa74-f2005d0ad424 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:38.922330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-feb6475b-6c29-44a2-aa74-f2005d0ad424 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:38.923035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-feb6475b-6c29-44a2-aa74-f2005d0ad424 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:38.923498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-feb6475b-6c29-44a2-aa74-f2005d0ad424 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:38.924500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-feb6475b-6c29-44a2-aa74-f2005d0ad424 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:38.926484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e6c822e6-a3e9-46f4-87b2-ed3000102014 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:38.935049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e6c822e6-a3e9-46f4-87b2-ed3000102014 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083560 Aug 08 09:09:38.935615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 942/1791] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:38 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:38.942813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:09:39.057548 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-feb6475b-6c29-44a2-aa74-f2005d0ad424 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:39.065477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-feb6475b-6c29-44a2-aa74-f2005d0ad424 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.156072 Aug 08 09:09:39.066037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 850/1792] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:38 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:39.957663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9ae3ee1c-1202-4c92-8595-babb6ff12092 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:39.958316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9ae3ee1c-1202-4c92-8595-babb6ff12092 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:39.965085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ae3ee1c-1202-4c92-8595-babb6ff12092 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:39.965597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ae3ee1c-1202-4c92-8595-babb6ff12092 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:39.966032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ae3ee1c-1202-4c92-8595-babb6ff12092 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:39.966717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ae3ee1c-1202-4c92-8595-babb6ff12092 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:39.967171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ae3ee1c-1202-4c92-8595-babb6ff12092 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:39.967602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ae3ee1c-1202-4c92-8595-babb6ff12092 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:40.030650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9ae3ee1c-1202-4c92-8595-babb6ff12092 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:40.038500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9ae3ee1c-1202-4c92-8595-babb6ff12092 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084610 Aug 08 09:09:40.039125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 943/1793] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:39 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:40.086136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-841b0c6b-1f00-493a-a805-1fc9974b75cc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:40.086745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-841b0c6b-1f00-493a-a805-1fc9974b75cc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:40.093238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-841b0c6b-1f00-493a-a805-1fc9974b75cc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:40.093721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-841b0c6b-1f00-493a-a805-1fc9974b75cc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:40.094162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-841b0c6b-1f00-493a-a805-1fc9974b75cc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:40.094857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-841b0c6b-1f00-493a-a805-1fc9974b75cc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:40.095315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-841b0c6b-1f00-493a-a805-1fc9974b75cc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:40.095747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-841b0c6b-1f00-493a-a805-1fc9974b75cc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:40.221578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-841b0c6b-1f00-493a-a805-1fc9974b75cc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:40.230116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-841b0c6b-1f00-493a-a805-1fc9974b75cc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.147877 Aug 08 09:09:40.230679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 851/1794] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:40 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:41.060054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f3c4360a-58e9-492e-805a-a832a8a62df0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:41.060677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f3c4360a-58e9-492e-805a-a832a8a62df0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:41.067027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c4360a-58e9-492e-805a-a832a8a62df0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:41.067513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c4360a-58e9-492e-805a-a832a8a62df0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:41.067953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c4360a-58e9-492e-805a-a832a8a62df0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:41.068640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c4360a-58e9-492e-805a-a832a8a62df0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:41.069094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c4360a-58e9-492e-805a-a832a8a62df0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:41.069544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c4360a-58e9-492e-805a-a832a8a62df0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:41.133217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f3c4360a-58e9-492e-805a-a832a8a62df0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:41.141313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f3c4360a-58e9-492e-805a-a832a8a62df0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085118 Aug 08 09:09:41.141874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 944/1795] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:41 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:41.251190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e163f2d5-1721-475f-8657-e14e23dc58b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:41.251819 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e163f2d5-1721-475f-8657-e14e23dc58b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:41.258532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e163f2d5-1721-475f-8657-e14e23dc58b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:41.259030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e163f2d5-1721-475f-8657-e14e23dc58b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:41.259471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e163f2d5-1721-475f-8657-e14e23dc58b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:41.260164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e163f2d5-1721-475f-8657-e14e23dc58b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:41.260625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e163f2d5-1721-475f-8657-e14e23dc58b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:41.261056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e163f2d5-1721-475f-8657-e14e23dc58b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:41.386150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e163f2d5-1721-475f-8657-e14e23dc58b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:41.393980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e163f2d5-1721-475f-8657-e14e23dc58b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.146621 Aug 08 09:09:41.394546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 852/1796] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:41 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:42.162266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4deaa9d4-b715-49e0-9963-1aa3e229231f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:42.162888 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4deaa9d4-b715-49e0-9963-1aa3e229231f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:42.169345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4deaa9d4-b715-49e0-9963-1aa3e229231f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:42.169829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4deaa9d4-b715-49e0-9963-1aa3e229231f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:42.170492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4deaa9d4-b715-49e0-9963-1aa3e229231f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:42.170938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4deaa9d4-b715-49e0-9963-1aa3e229231f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:42.171389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4deaa9d4-b715-49e0-9963-1aa3e229231f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:42.171811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4deaa9d4-b715-49e0-9963-1aa3e229231f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:42.232269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4deaa9d4-b715-49e0-9963-1aa3e229231f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:42.240468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4deaa9d4-b715-49e0-9963-1aa3e229231f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082375 Aug 08 09:09:42.241020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 945/1797] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:42 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:42.416423 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fedc7d71-7ab9-4f32-81ac-439a79a53494 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:42.417071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fedc7d71-7ab9-4f32-81ac-439a79a53494 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:42.423558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fedc7d71-7ab9-4f32-81ac-439a79a53494 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:42.424045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fedc7d71-7ab9-4f32-81ac-439a79a53494 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:42.424484 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fedc7d71-7ab9-4f32-81ac-439a79a53494 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:42.425213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fedc7d71-7ab9-4f32-81ac-439a79a53494 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:42.425673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fedc7d71-7ab9-4f32-81ac-439a79a53494 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:42.426101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fedc7d71-7ab9-4f32-81ac-439a79a53494 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:42.558941 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fedc7d71-7ab9-4f32-81ac-439a79a53494 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:42.567110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fedc7d71-7ab9-4f32-81ac-439a79a53494 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.155290 Aug 08 09:09:42.567683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 853/1798] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:42 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:43.262493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e9822ca2-2def-49d9-839c-424231dcdba1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:43.263107 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e9822ca2-2def-49d9-839c-424231dcdba1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:43.269637 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9822ca2-2def-49d9-839c-424231dcdba1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:43.270124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9822ca2-2def-49d9-839c-424231dcdba1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:43.270564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9822ca2-2def-49d9-839c-424231dcdba1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:43.271256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9822ca2-2def-49d9-839c-424231dcdba1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:43.271714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9822ca2-2def-49d9-839c-424231dcdba1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:43.272157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e9822ca2-2def-49d9-839c-424231dcdba1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:43.332944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e9822ca2-2def-49d9-839c-424231dcdba1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:43.341441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e9822ca2-2def-49d9-839c-424231dcdba1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083567 Aug 08 09:09:43.341996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 946/1799] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:43.587939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d978fea2-5ebb-420e-bbb7-8425003a22f5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:43.588516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d978fea2-5ebb-420e-bbb7-8425003a22f5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:43.594934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d978fea2-5ebb-420e-bbb7-8425003a22f5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:43.595420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d978fea2-5ebb-420e-bbb7-8425003a22f5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:43.595860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d978fea2-5ebb-420e-bbb7-8425003a22f5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:43.596550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d978fea2-5ebb-420e-bbb7-8425003a22f5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:43.597010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d978fea2-5ebb-420e-bbb7-8425003a22f5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:43.597464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d978fea2-5ebb-420e-bbb7-8425003a22f5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:43.723882 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d978fea2-5ebb-420e-bbb7-8425003a22f5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:43.732036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d978fea2-5ebb-420e-bbb7-8425003a22f5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148253 Aug 08 09:09:43.732590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 854/1800] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:43 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:44.362916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cda6886b-7996-48c2-bc58-2d31f0b2d4d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:44.363451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cda6886b-7996-48c2-bc58-2d31f0b2d4d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:44.370029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cda6886b-7996-48c2-bc58-2d31f0b2d4d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:44.370511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cda6886b-7996-48c2-bc58-2d31f0b2d4d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:44.370939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cda6886b-7996-48c2-bc58-2d31f0b2d4d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:44.371613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cda6886b-7996-48c2-bc58-2d31f0b2d4d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:44.372067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cda6886b-7996-48c2-bc58-2d31f0b2d4d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:44.372490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cda6886b-7996-48c2-bc58-2d31f0b2d4d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:44.437610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cda6886b-7996-48c2-bc58-2d31f0b2d4d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:44.445559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cda6886b-7996-48c2-bc58-2d31f0b2d4d9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086629 Aug 08 09:09:44.446153 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 947/1801] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:44.753526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2a4a8249-f61e-4e94-96c4-24c9bd4c58c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:44.754118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2a4a8249-f61e-4e94-96c4-24c9bd4c58c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:44.761265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4a8249-f61e-4e94-96c4-24c9bd4c58c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:44.761750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4a8249-f61e-4e94-96c4-24c9bd4c58c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:44.762185 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4a8249-f61e-4e94-96c4-24c9bd4c58c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:44.762872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4a8249-f61e-4e94-96c4-24c9bd4c58c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:44.763326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4a8249-f61e-4e94-96c4-24c9bd4c58c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:44.763749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a4a8249-f61e-4e94-96c4-24c9bd4c58c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:44.893969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2a4a8249-f61e-4e94-96c4-24c9bd4c58c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:44.902600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2a4a8249-f61e-4e94-96c4-24c9bd4c58c7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152893 Aug 08 09:09:44.904840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 855/1802] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:44 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:45.466230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-af0353ea-0354-45f1-ac90-9fe8e5d459ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:45.466841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-af0353ea-0354-45f1-ac90-9fe8e5d459ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:45.473161 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af0353ea-0354-45f1-ac90-9fe8e5d459ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:45.473641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af0353ea-0354-45f1-ac90-9fe8e5d459ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:45.474072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af0353ea-0354-45f1-ac90-9fe8e5d459ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:45.474748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af0353ea-0354-45f1-ac90-9fe8e5d459ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:45.475199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af0353ea-0354-45f1-ac90-9fe8e5d459ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:45.475619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-af0353ea-0354-45f1-ac90-9fe8e5d459ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:45.535610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-af0353ea-0354-45f1-ac90-9fe8e5d459ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:45.543958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-af0353ea-0354-45f1-ac90-9fe8e5d459ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081534 Aug 08 09:09:45.544508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 948/1803] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:45.923326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c0fe38d3-1e88-42b1-8430-f4d94eb97d11 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:45.923975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c0fe38d3-1e88-42b1-8430-f4d94eb97d11 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:45.930442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0fe38d3-1e88-42b1-8430-f4d94eb97d11 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:45.930920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0fe38d3-1e88-42b1-8430-f4d94eb97d11 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:45.931355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0fe38d3-1e88-42b1-8430-f4d94eb97d11 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:45.932044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0fe38d3-1e88-42b1-8430-f4d94eb97d11 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:45.932494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0fe38d3-1e88-42b1-8430-f4d94eb97d11 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:45.932921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c0fe38d3-1e88-42b1-8430-f4d94eb97d11 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:46.062382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c0fe38d3-1e88-42b1-8430-f4d94eb97d11 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:46.070833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c0fe38d3-1e88-42b1-8430-f4d94eb97d11 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150848 Aug 08 09:09:46.071576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 856/1804] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:45 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:46.565471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6bf63a78-8963-43f1-a5e5-359753481efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:46.566021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6bf63a78-8963-43f1-a5e5-359753481efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:46.572978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6bf63a78-8963-43f1-a5e5-359753481efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:46.573497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6bf63a78-8963-43f1-a5e5-359753481efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:46.573942 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6bf63a78-8963-43f1-a5e5-359753481efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:46.574640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6bf63a78-8963-43f1-a5e5-359753481efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:46.575099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6bf63a78-8963-43f1-a5e5-359753481efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:46.575529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6bf63a78-8963-43f1-a5e5-359753481efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:46.639760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6bf63a78-8963-43f1-a5e5-359753481efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:46.647599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6bf63a78-8963-43f1-a5e5-359753481efe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086080 Aug 08 09:09:46.648167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 949/1805] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:46 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:47.103090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5ce62e59-87b2-4fb6-948f-87ed6e62c736 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:47.103714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5ce62e59-87b2-4fb6-948f-87ed6e62c736 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:47.110117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5ce62e59-87b2-4fb6-948f-87ed6e62c736 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:47.110597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5ce62e59-87b2-4fb6-948f-87ed6e62c736 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:47.111034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5ce62e59-87b2-4fb6-948f-87ed6e62c736 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:47.111722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5ce62e59-87b2-4fb6-948f-87ed6e62c736 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:47.112181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5ce62e59-87b2-4fb6-948f-87ed6e62c736 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:47.112608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5ce62e59-87b2-4fb6-948f-87ed6e62c736 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:47.239202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5ce62e59-87b2-4fb6-948f-87ed6e62c736 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:47.247065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5ce62e59-87b2-4fb6-948f-87ed6e62c736 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148474 Aug 08 09:09:47.247626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 857/1806] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:47 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:47.668708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c11fe329-bc64-4152-a2b4-63662abea641 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:47.669296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c11fe329-bc64-4152-a2b4-63662abea641 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:47.675654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c11fe329-bc64-4152-a2b4-63662abea641 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:47.676129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c11fe329-bc64-4152-a2b4-63662abea641 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:47.676560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c11fe329-bc64-4152-a2b4-63662abea641 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:47.677274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c11fe329-bc64-4152-a2b4-63662abea641 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:47.677725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c11fe329-bc64-4152-a2b4-63662abea641 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:47.678173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c11fe329-bc64-4152-a2b4-63662abea641 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:47.742477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c11fe329-bc64-4152-a2b4-63662abea641 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:47.750354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c11fe329-bc64-4152-a2b4-63662abea641 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085613 Aug 08 09:09:47.750910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 950/1807] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:48.267811 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6ed5c4e3-90cb-4709-b660-637b81f74f64 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:48.268427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6ed5c4e3-90cb-4709-b660-637b81f74f64 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:48.275119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ed5c4e3-90cb-4709-b660-637b81f74f64 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:48.275656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ed5c4e3-90cb-4709-b660-637b81f74f64 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:48.276096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ed5c4e3-90cb-4709-b660-637b81f74f64 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:48.276785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ed5c4e3-90cb-4709-b660-637b81f74f64 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:48.277266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ed5c4e3-90cb-4709-b660-637b81f74f64 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:48.277693 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6ed5c4e3-90cb-4709-b660-637b81f74f64 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:48.403623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6ed5c4e3-90cb-4709-b660-637b81f74f64 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:48.411627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6ed5c4e3-90cb-4709-b660-637b81f74f64 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.147676 Aug 08 09:09:48.412417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 858/1808] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:48 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:48.771707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dd0c6e95-57dd-4e4b-8a28-4d61c3640a89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:48.772314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dd0c6e95-57dd-4e4b-8a28-4d61c3640a89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:48.779272 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd0c6e95-57dd-4e4b-8a28-4d61c3640a89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:48.779751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd0c6e95-57dd-4e4b-8a28-4d61c3640a89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:48.780182 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd0c6e95-57dd-4e4b-8a28-4d61c3640a89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:48.780868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd0c6e95-57dd-4e4b-8a28-4d61c3640a89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:48.781342 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd0c6e95-57dd-4e4b-8a28-4d61c3640a89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:48.781769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd0c6e95-57dd-4e4b-8a28-4d61c3640a89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:48.844025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-dd0c6e95-57dd-4e4b-8a28-4d61c3640a89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:48.853178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dd0c6e95-57dd-4e4b-8a28-4d61c3640a89 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085145 Aug 08 09:09:48.853739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 951/1809] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:49.432565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-48ccfedf-d507-4337-8c37-5f5ac59a4765 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:49.433209 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-48ccfedf-d507-4337-8c37-5f5ac59a4765 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:49.439696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48ccfedf-d507-4337-8c37-5f5ac59a4765 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:49.440181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48ccfedf-d507-4337-8c37-5f5ac59a4765 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:49.440617 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48ccfedf-d507-4337-8c37-5f5ac59a4765 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:49.441392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48ccfedf-d507-4337-8c37-5f5ac59a4765 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:49.441846 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48ccfedf-d507-4337-8c37-5f5ac59a4765 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:49.442335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48ccfedf-d507-4337-8c37-5f5ac59a4765 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:49.573135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-48ccfedf-d507-4337-8c37-5f5ac59a4765 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:49.581046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-48ccfedf-d507-4337-8c37-5f5ac59a4765 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153087 Aug 08 09:09:49.581644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 859/1810] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:49 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:49.874637 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a95e6e33-2586-4101-b109-ffdca2e5a085 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:49.875301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a95e6e33-2586-4101-b109-ffdca2e5a085 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:49.882166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a95e6e33-2586-4101-b109-ffdca2e5a085 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:49.882674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a95e6e33-2586-4101-b109-ffdca2e5a085 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:49.883683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a95e6e33-2586-4101-b109-ffdca2e5a085 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:49.884335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a95e6e33-2586-4101-b109-ffdca2e5a085 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:49.884790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a95e6e33-2586-4101-b109-ffdca2e5a085 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:49.885241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a95e6e33-2586-4101-b109-ffdca2e5a085 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:49.947308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a95e6e33-2586-4101-b109-ffdca2e5a085 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:49.955269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a95e6e33-2586-4101-b109-ffdca2e5a085 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084668 Aug 08 09:09:49.955835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 952/1811] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:50.601738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f575034d-7298-41fd-8f6e-3c7ccf2555de tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:50.602415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f575034d-7298-41fd-8f6e-3c7ccf2555de tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:50.608834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f575034d-7298-41fd-8f6e-3c7ccf2555de tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:50.609366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f575034d-7298-41fd-8f6e-3c7ccf2555de tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:50.609800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f575034d-7298-41fd-8f6e-3c7ccf2555de tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:50.610500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f575034d-7298-41fd-8f6e-3c7ccf2555de tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:50.610961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f575034d-7298-41fd-8f6e-3c7ccf2555de tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:50.611398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f575034d-7298-41fd-8f6e-3c7ccf2555de tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:50.738290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f575034d-7298-41fd-8f6e-3c7ccf2555de tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:50.746310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f575034d-7298-41fd-8f6e-3c7ccf2555de tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148514 Aug 08 09:09:50.746870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 860/1812] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:50 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:50.975881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-45dbd061-ef19-4bad-9333-242d424d18e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:50.982828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-45dbd061-ef19-4bad-9333-242d424d18e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:50.983834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45dbd061-ef19-4bad-9333-242d424d18e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:50.984327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45dbd061-ef19-4bad-9333-242d424d18e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:50.984771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45dbd061-ef19-4bad-9333-242d424d18e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:50.985499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45dbd061-ef19-4bad-9333-242d424d18e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:50.985960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45dbd061-ef19-4bad-9333-242d424d18e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:50.986390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45dbd061-ef19-4bad-9333-242d424d18e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:51.051415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-45dbd061-ef19-4bad-9333-242d424d18e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:51.054757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:09:51.059554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-45dbd061-ef19-4bad-9333-242d424d18e9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087549 Aug 08 09:09:51.060119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 953/1813] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:50 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:51.767910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0aaea917-6901-49a7-b01a-a794727aa8c2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:51.768455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0aaea917-6901-49a7-b01a-a794727aa8c2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:51.774845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aaea917-6901-49a7-b01a-a794727aa8c2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:51.775325 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aaea917-6901-49a7-b01a-a794727aa8c2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:51.775758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aaea917-6901-49a7-b01a-a794727aa8c2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:51.776450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aaea917-6901-49a7-b01a-a794727aa8c2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:51.776900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aaea917-6901-49a7-b01a-a794727aa8c2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:51.777354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aaea917-6901-49a7-b01a-a794727aa8c2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:51.905492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0aaea917-6901-49a7-b01a-a794727aa8c2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:51.913335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0aaea917-6901-49a7-b01a-a794727aa8c2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149362 Aug 08 09:09:51.913895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 861/1814] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:51 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:52.080341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-739bc319-8093-41f8-b713-631c7f81b2d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:52.080993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-739bc319-8093-41f8-b713-631c7f81b2d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:52.087517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-739bc319-8093-41f8-b713-631c7f81b2d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:52.087996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-739bc319-8093-41f8-b713-631c7f81b2d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:52.088430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-739bc319-8093-41f8-b713-631c7f81b2d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:52.089115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-739bc319-8093-41f8-b713-631c7f81b2d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:52.089589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-739bc319-8093-41f8-b713-631c7f81b2d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:52.090013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-739bc319-8093-41f8-b713-631c7f81b2d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:52.150071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-739bc319-8093-41f8-b713-631c7f81b2d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:52.157862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-739bc319-8093-41f8-b713-631c7f81b2d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081656 Aug 08 09:09:52.158426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 954/1815] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:52 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:52.935354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d9acd008-4ddf-45c7-a29a-13ae9a5ecea7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:52.935969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d9acd008-4ddf-45c7-a29a-13ae9a5ecea7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:52.942401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9acd008-4ddf-45c7-a29a-13ae9a5ecea7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:52.942881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9acd008-4ddf-45c7-a29a-13ae9a5ecea7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:52.943316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9acd008-4ddf-45c7-a29a-13ae9a5ecea7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:52.944007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9acd008-4ddf-45c7-a29a-13ae9a5ecea7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:52.944460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9acd008-4ddf-45c7-a29a-13ae9a5ecea7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:52.944887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d9acd008-4ddf-45c7-a29a-13ae9a5ecea7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:53.074368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d9acd008-4ddf-45c7-a29a-13ae9a5ecea7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:53.082222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d9acd008-4ddf-45c7-a29a-13ae9a5ecea7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150794 Aug 08 09:09:53.082781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 862/1816] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:52 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:53.178904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f3cb79d2-9da4-44fb-87ba-c8205ac66dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:53.179569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f3cb79d2-9da4-44fb-87ba-c8205ac66dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:53.186482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3cb79d2-9da4-44fb-87ba-c8205ac66dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:53.186909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3cb79d2-9da4-44fb-87ba-c8205ac66dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:53.187347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3cb79d2-9da4-44fb-87ba-c8205ac66dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:53.188034 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3cb79d2-9da4-44fb-87ba-c8205ac66dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:53.188487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3cb79d2-9da4-44fb-87ba-c8205ac66dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:53.188912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3cb79d2-9da4-44fb-87ba-c8205ac66dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:53.249012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f3cb79d2-9da4-44fb-87ba-c8205ac66dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:53.256797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f3cb79d2-9da4-44fb-87ba-c8205ac66dca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081737 Aug 08 09:09:53.257392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 955/1817] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:53 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:54.102909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-58f02f60-134c-43f8-939f-55a8ee69e8fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:54.103523 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-58f02f60-134c-43f8-939f-55a8ee69e8fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:54.109617 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58f02f60-134c-43f8-939f-55a8ee69e8fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:54.110104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58f02f60-134c-43f8-939f-55a8ee69e8fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:54.110541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58f02f60-134c-43f8-939f-55a8ee69e8fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:54.111236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58f02f60-134c-43f8-939f-55a8ee69e8fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:54.111698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58f02f60-134c-43f8-939f-55a8ee69e8fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:54.112176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-58f02f60-134c-43f8-939f-55a8ee69e8fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:54.240790 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-58f02f60-134c-43f8-939f-55a8ee69e8fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:54.249396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-58f02f60-134c-43f8-939f-55a8ee69e8fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150471 Aug 08 09:09:54.249961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 863/1818] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:54 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:54.277616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7145c061-416f-43e2-b46e-a51ddc5a0637 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:54.278339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7145c061-416f-43e2-b46e-a51ddc5a0637 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:54.284909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7145c061-416f-43e2-b46e-a51ddc5a0637 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:54.285470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7145c061-416f-43e2-b46e-a51ddc5a0637 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:54.285848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7145c061-416f-43e2-b46e-a51ddc5a0637 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:54.286525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7145c061-416f-43e2-b46e-a51ddc5a0637 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:54.286976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7145c061-416f-43e2-b46e-a51ddc5a0637 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:54.287394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7145c061-416f-43e2-b46e-a51ddc5a0637 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:54.351771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7145c061-416f-43e2-b46e-a51ddc5a0637 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:54.359695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7145c061-416f-43e2-b46e-a51ddc5a0637 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085865 Aug 08 09:09:54.360249 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 956/1819] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:54 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:55.274416 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3520a64e-9676-489f-9d56-a32d475814b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:55.275005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3520a64e-9676-489f-9d56-a32d475814b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:55.281432 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3520a64e-9676-489f-9d56-a32d475814b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:55.281917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3520a64e-9676-489f-9d56-a32d475814b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:55.282354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3520a64e-9676-489f-9d56-a32d475814b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:55.283045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3520a64e-9676-489f-9d56-a32d475814b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:55.283499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3520a64e-9676-489f-9d56-a32d475814b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:55.283923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3520a64e-9676-489f-9d56-a32d475814b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:55.380082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6a098c44-9a17-4a27-a057-ed8eccc022a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:55.380695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6a098c44-9a17-4a27-a057-ed8eccc022a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:55.387930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a098c44-9a17-4a27-a057-ed8eccc022a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:55.388416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a098c44-9a17-4a27-a057-ed8eccc022a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:55.388848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a098c44-9a17-4a27-a057-ed8eccc022a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:55.389568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a098c44-9a17-4a27-a057-ed8eccc022a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:55.390019 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a098c44-9a17-4a27-a057-ed8eccc022a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:55.390444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a098c44-9a17-4a27-a057-ed8eccc022a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:55.413936 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3520a64e-9676-489f-9d56-a32d475814b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:55.422163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3520a64e-9676-489f-9d56-a32d475814b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152219 Aug 08 09:09:55.422735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 864/1820] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:55 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:55.451618 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6a098c44-9a17-4a27-a057-ed8eccc022a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:55.459591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6a098c44-9a17-4a27-a057-ed8eccc022a8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083316 Aug 08 09:09:55.460150 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 957/1821] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:56.443634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9d5f46a7-d639-4c9b-b9b9-cca604ba423c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:56.444184 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9d5f46a7-d639-4c9b-b9b9-cca604ba423c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:56.450730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d5f46a7-d639-4c9b-b9b9-cca604ba423c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:56.451214 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d5f46a7-d639-4c9b-b9b9-cca604ba423c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:56.451648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d5f46a7-d639-4c9b-b9b9-cca604ba423c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:56.452337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d5f46a7-d639-4c9b-b9b9-cca604ba423c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:56.452791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d5f46a7-d639-4c9b-b9b9-cca604ba423c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:56.453252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d5f46a7-d639-4c9b-b9b9-cca604ba423c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:56.480642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-456342a3-5e1e-4beb-9b19-e8d7d0bebf66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:56.481293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-456342a3-5e1e-4beb-9b19-e8d7d0bebf66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:56.487675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456342a3-5e1e-4beb-9b19-e8d7d0bebf66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:56.488167 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456342a3-5e1e-4beb-9b19-e8d7d0bebf66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:56.488606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456342a3-5e1e-4beb-9b19-e8d7d0bebf66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:56.489334 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456342a3-5e1e-4beb-9b19-e8d7d0bebf66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:56.489800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456342a3-5e1e-4beb-9b19-e8d7d0bebf66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:56.490226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-456342a3-5e1e-4beb-9b19-e8d7d0bebf66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:56.568114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-456342a3-5e1e-4beb-9b19-e8d7d0bebf66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:56.576577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-456342a3-5e1e-4beb-9b19-e8d7d0bebf66 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.100694 Aug 08 09:09:56.577166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 958/1822] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:56.604514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9d5f46a7-d639-4c9b-b9b9-cca604ba423c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:56.612293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9d5f46a7-d639-4c9b-b9b9-cca604ba423c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.172579 Aug 08 09:09:56.613062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 865/1823] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:56 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:57.597866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0c5429c2-437c-43e6-bc94-7604c1964ea9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:57.598483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0c5429c2-437c-43e6-bc94-7604c1964ea9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:57.604846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c5429c2-437c-43e6-bc94-7604c1964ea9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:57.605366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c5429c2-437c-43e6-bc94-7604c1964ea9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:57.605806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c5429c2-437c-43e6-bc94-7604c1964ea9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:57.606496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c5429c2-437c-43e6-bc94-7604c1964ea9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:57.606950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c5429c2-437c-43e6-bc94-7604c1964ea9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:57.607375 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c5429c2-437c-43e6-bc94-7604c1964ea9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:57.632294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-361c9898-6b52-46f4-b218-9d5fcc814a14 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:57.633731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-361c9898-6b52-46f4-b218-9d5fcc814a14 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:57.640115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-361c9898-6b52-46f4-b218-9d5fcc814a14 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:57.640606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-361c9898-6b52-46f4-b218-9d5fcc814a14 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:57.641048 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-361c9898-6b52-46f4-b218-9d5fcc814a14 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:57.641771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-361c9898-6b52-46f4-b218-9d5fcc814a14 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:57.642232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-361c9898-6b52-46f4-b218-9d5fcc814a14 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:57.642662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-361c9898-6b52-46f4-b218-9d5fcc814a14 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:57.668611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0c5429c2-437c-43e6-bc94-7604c1964ea9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:57.676386 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0c5429c2-437c-43e6-bc94-7604c1964ea9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082296 Aug 08 09:09:57.676955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 959/1824] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:57 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:57.776144 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-361c9898-6b52-46f4-b218-9d5fcc814a14 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:57.784065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-361c9898-6b52-46f4-b218-9d5fcc814a14 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.155627 Aug 08 09:09:57.784635 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 866/1825] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:57 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:09:58.697305 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-846d8f6e-64fd-4f74-bd6c-f87fe90c1fda tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:58.697862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-846d8f6e-64fd-4f74-bd6c-f87fe90c1fda tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:58.704241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-846d8f6e-64fd-4f74-bd6c-f87fe90c1fda tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:58.704725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-846d8f6e-64fd-4f74-bd6c-f87fe90c1fda tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:58.705186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-846d8f6e-64fd-4f74-bd6c-f87fe90c1fda tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:58.705884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-846d8f6e-64fd-4f74-bd6c-f87fe90c1fda tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:58.706344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-846d8f6e-64fd-4f74-bd6c-f87fe90c1fda tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:58.706775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-846d8f6e-64fd-4f74-bd6c-f87fe90c1fda tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:58.767665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-846d8f6e-64fd-4f74-bd6c-f87fe90c1fda tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:58.776184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-846d8f6e-64fd-4f74-bd6c-f87fe90c1fda tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082926 Aug 08 09:09:58.776747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 960/1826] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:58.803676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ae89d3dd-7f6d-4fc4-8901-fcf0f6cfab80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:58.804327 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ae89d3dd-7f6d-4fc4-8901-fcf0f6cfab80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:58.810791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae89d3dd-7f6d-4fc4-8901-fcf0f6cfab80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:58.811277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae89d3dd-7f6d-4fc4-8901-fcf0f6cfab80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:58.811713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae89d3dd-7f6d-4fc4-8901-fcf0f6cfab80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:58.812407 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae89d3dd-7f6d-4fc4-8901-fcf0f6cfab80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:58.812865 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae89d3dd-7f6d-4fc4-8901-fcf0f6cfab80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:58.813332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae89d3dd-7f6d-4fc4-8901-fcf0f6cfab80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:58.817184 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:09:58.940024 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ae89d3dd-7f6d-4fc4-8901-fcf0f6cfab80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:58.948654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ae89d3dd-7f6d-4fc4-8901-fcf0f6cfab80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148755 Aug 08 09:09:58.949176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 867/1827] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:58 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:59.796874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-89dd6734-16ba-4a13-8969-856e515191bc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:59.797465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-89dd6734-16ba-4a13-8969-856e515191bc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:59.803788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89dd6734-16ba-4a13-8969-856e515191bc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:59.804268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89dd6734-16ba-4a13-8969-856e515191bc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:59.804706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89dd6734-16ba-4a13-8969-856e515191bc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:59.805434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89dd6734-16ba-4a13-8969-856e515191bc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:59.805887 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89dd6734-16ba-4a13-8969-856e515191bc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:59.806313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89dd6734-16ba-4a13-8969-856e515191bc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:59.873310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-89dd6734-16ba-4a13-8969-856e515191bc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:09:59.881558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-89dd6734-16ba-4a13-8969-856e515191bc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.088577 Aug 08 09:09:59.882122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 961/1828] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:09:59.969228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-89442762-627b-49e2-8a8f-d77987388484 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:09:59.969843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-89442762-627b-49e2-8a8f-d77987388484 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:09:59.976310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89442762-627b-49e2-8a8f-d77987388484 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:59.977054 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89442762-627b-49e2-8a8f-d77987388484 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:59.977440 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89442762-627b-49e2-8a8f-d77987388484 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:09:59.978133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89442762-627b-49e2-8a8f-d77987388484 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:09:59.978593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89442762-627b-49e2-8a8f-d77987388484 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:09:59.979021 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89442762-627b-49e2-8a8f-d77987388484 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:00.106315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-89442762-627b-49e2-8a8f-d77987388484 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:00.114296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-89442762-627b-49e2-8a8f-d77987388484 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148953 Aug 08 09:10:00.114892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 868/1829] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:09:59 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:00.904133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0e2f71f0-1d80-4c37-bf72-b8d370048c8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:00.904813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0e2f71f0-1d80-4c37-bf72-b8d370048c8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:00.911124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2f71f0-1d80-4c37-bf72-b8d370048c8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:00.911600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2f71f0-1d80-4c37-bf72-b8d370048c8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:00.912035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2f71f0-1d80-4c37-bf72-b8d370048c8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:00.912712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2f71f0-1d80-4c37-bf72-b8d370048c8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:00.913180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2f71f0-1d80-4c37-bf72-b8d370048c8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:00.914457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2f71f0-1d80-4c37-bf72-b8d370048c8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:00.974034 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0e2f71f0-1d80-4c37-bf72-b8d370048c8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:00.983075 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0e2f71f0-1d80-4c37-bf72-b8d370048c8e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082684 Aug 08 09:10:00.983651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 962/1830] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:00 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:01.135817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6befa1c2-5dfb-4eec-8cc5-3140109cc6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:01.136439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6befa1c2-5dfb-4eec-8cc5-3140109cc6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:01.143124 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6befa1c2-5dfb-4eec-8cc5-3140109cc6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:01.143613 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6befa1c2-5dfb-4eec-8cc5-3140109cc6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:01.144057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6befa1c2-5dfb-4eec-8cc5-3140109cc6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:01.144755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6befa1c2-5dfb-4eec-8cc5-3140109cc6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:01.145258 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6befa1c2-5dfb-4eec-8cc5-3140109cc6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:01.145698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6befa1c2-5dfb-4eec-8cc5-3140109cc6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:01.277127 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6befa1c2-5dfb-4eec-8cc5-3140109cc6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:01.289611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6befa1c2-5dfb-4eec-8cc5-3140109cc6c5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.158635 Aug 08 09:10:01.290178 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 869/1831] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:01 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:02.004192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-693eae0d-cf1a-472a-b9b5-37d860d2a85c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:02.004832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-693eae0d-cf1a-472a-b9b5-37d860d2a85c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:02.011647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-693eae0d-cf1a-472a-b9b5-37d860d2a85c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:02.012131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-693eae0d-cf1a-472a-b9b5-37d860d2a85c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:02.012568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-693eae0d-cf1a-472a-b9b5-37d860d2a85c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:02.013281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-693eae0d-cf1a-472a-b9b5-37d860d2a85c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:02.013739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-693eae0d-cf1a-472a-b9b5-37d860d2a85c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:02.014165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-693eae0d-cf1a-472a-b9b5-37d860d2a85c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:02.075235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-693eae0d-cf1a-472a-b9b5-37d860d2a85c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:02.083112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-693eae0d-cf1a-472a-b9b5-37d860d2a85c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082735 Aug 08 09:10:02.083668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 963/1832] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:01 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:02.310275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bb96c892-34fa-4a32-8a3c-b4646624a8b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:02.310828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bb96c892-34fa-4a32-8a3c-b4646624a8b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:02.317079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bb96c892-34fa-4a32-8a3c-b4646624a8b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:02.317599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bb96c892-34fa-4a32-8a3c-b4646624a8b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:02.318043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bb96c892-34fa-4a32-8a3c-b4646624a8b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:02.318745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bb96c892-34fa-4a32-8a3c-b4646624a8b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:02.319210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bb96c892-34fa-4a32-8a3c-b4646624a8b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:02.319638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bb96c892-34fa-4a32-8a3c-b4646624a8b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:02.447746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bb96c892-34fa-4a32-8a3c-b4646624a8b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:02.455546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bb96c892-34fa-4a32-8a3c-b4646624a8b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149300 Aug 08 09:10:02.456102 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 870/1833] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:02 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:03.104088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1962810e-8b59-4683-9aa5-7a3ca6c35bd6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:03.104684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1962810e-8b59-4683-9aa5-7a3ca6c35bd6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:03.111059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1962810e-8b59-4683-9aa5-7a3ca6c35bd6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:03.111535 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1962810e-8b59-4683-9aa5-7a3ca6c35bd6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:03.111967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1962810e-8b59-4683-9aa5-7a3ca6c35bd6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:03.112648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1962810e-8b59-4683-9aa5-7a3ca6c35bd6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:03.113096 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1962810e-8b59-4683-9aa5-7a3ca6c35bd6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:03.113543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1962810e-8b59-4683-9aa5-7a3ca6c35bd6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:03.177274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1962810e-8b59-4683-9aa5-7a3ca6c35bd6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:03.186296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1962810e-8b59-4683-9aa5-7a3ca6c35bd6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085777 Aug 08 09:10:03.187545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 964/1834] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:03.649486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-93f5d2b3-6e04-4af7-8dd6-feaea6d0943e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:03.650107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-93f5d2b3-6e04-4af7-8dd6-feaea6d0943e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:03.655939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93f5d2b3-6e04-4af7-8dd6-feaea6d0943e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:03.656445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93f5d2b3-6e04-4af7-8dd6-feaea6d0943e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:03.656881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93f5d2b3-6e04-4af7-8dd6-feaea6d0943e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:03.657594 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93f5d2b3-6e04-4af7-8dd6-feaea6d0943e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:03.658047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93f5d2b3-6e04-4af7-8dd6-feaea6d0943e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:03.658470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93f5d2b3-6e04-4af7-8dd6-feaea6d0943e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:03.786522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-93f5d2b3-6e04-4af7-8dd6-feaea6d0943e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:03.795206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-93f5d2b3-6e04-4af7-8dd6-feaea6d0943e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.321699 Aug 08 09:10:03.795805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 871/1835] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:03 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:04.356731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d3e7dbe3-f64f-4b01-9f7f-b018f5bd8a8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:04.357377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d3e7dbe3-f64f-4b01-9f7f-b018f5bd8a8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:04.363187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3e7dbe3-f64f-4b01-9f7f-b018f5bd8a8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:04.363672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3e7dbe3-f64f-4b01-9f7f-b018f5bd8a8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:04.364109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3e7dbe3-f64f-4b01-9f7f-b018f5bd8a8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:04.364794 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3e7dbe3-f64f-4b01-9f7f-b018f5bd8a8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:04.365283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3e7dbe3-f64f-4b01-9f7f-b018f5bd8a8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:04.365711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d3e7dbe3-f64f-4b01-9f7f-b018f5bd8a8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:04.431871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d3e7dbe3-f64f-4b01-9f7f-b018f5bd8a8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:04.439812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d3e7dbe3-f64f-4b01-9f7f-b018f5bd8a8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.235317 Aug 08 09:10:04.440379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 965/1836] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:04.815869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6bf8c16e-9293-43f1-bcf8-195305afedca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:04.816412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6bf8c16e-9293-43f1-bcf8-195305afedca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:04.823720 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bf8c16e-9293-43f1-bcf8-195305afedca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:04.824212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bf8c16e-9293-43f1-bcf8-195305afedca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:04.824664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bf8c16e-9293-43f1-bcf8-195305afedca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:04.825391 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bf8c16e-9293-43f1-bcf8-195305afedca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:04.825858 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bf8c16e-9293-43f1-bcf8-195305afedca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:04.826292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bf8c16e-9293-43f1-bcf8-195305afedca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:04.958666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6bf8c16e-9293-43f1-bcf8-195305afedca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:04.967368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6bf8c16e-9293-43f1-bcf8-195305afedca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.155432 Aug 08 09:10:04.967933 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 872/1837] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:04 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:05.018116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:10:05.021251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:10:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:10:05.461617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-17d4d328-5f04-4686-8a05-3514108ea74f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:05.462226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-17d4d328-5f04-4686-8a05-3514108ea74f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:05.468516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17d4d328-5f04-4686-8a05-3514108ea74f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:05.468989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17d4d328-5f04-4686-8a05-3514108ea74f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:05.469461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17d4d328-5f04-4686-8a05-3514108ea74f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:05.470144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17d4d328-5f04-4686-8a05-3514108ea74f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:05.470593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17d4d328-5f04-4686-8a05-3514108ea74f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:05.471013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-17d4d328-5f04-4686-8a05-3514108ea74f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:05.532004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-17d4d328-5f04-4686-8a05-3514108ea74f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:05.540426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-17d4d328-5f04-4686-8a05-3514108ea74f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083160 Aug 08 09:10:05.540984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 966/1838] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:05 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:05.989068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-64289431-03cd-48a1-9a14-ae17b5fc3226 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:05.989696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-64289431-03cd-48a1-9a14-ae17b5fc3226 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:05.996356 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64289431-03cd-48a1-9a14-ae17b5fc3226 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:05.996836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64289431-03cd-48a1-9a14-ae17b5fc3226 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:05.997312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64289431-03cd-48a1-9a14-ae17b5fc3226 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:05.998000 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64289431-03cd-48a1-9a14-ae17b5fc3226 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:05.998450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64289431-03cd-48a1-9a14-ae17b5fc3226 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:05.998874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-64289431-03cd-48a1-9a14-ae17b5fc3226 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:06.131204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-64289431-03cd-48a1-9a14-ae17b5fc3226 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:06.140335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-64289431-03cd-48a1-9a14-ae17b5fc3226 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.155113 Aug 08 09:10:06.153360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 873/1839] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:05 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:06.562092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dee0084c-1042-4bfb-bd62-bf6717fe9d3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:06.562640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dee0084c-1042-4bfb-bd62-bf6717fe9d3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:06.568861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dee0084c-1042-4bfb-bd62-bf6717fe9d3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:06.569375 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dee0084c-1042-4bfb-bd62-bf6717fe9d3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:06.569837 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dee0084c-1042-4bfb-bd62-bf6717fe9d3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:06.570697 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dee0084c-1042-4bfb-bd62-bf6717fe9d3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:06.571153 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dee0084c-1042-4bfb-bd62-bf6717fe9d3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:06.571576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dee0084c-1042-4bfb-bd62-bf6717fe9d3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:06.634736 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-dee0084c-1042-4bfb-bd62-bf6717fe9d3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:06.642668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dee0084c-1042-4bfb-bd62-bf6717fe9d3d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084896 Aug 08 09:10:06.643229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 967/1840] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:06 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:07.161207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dea06652-204a-47a1-b40b-bb0a25cea7b0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:07.161940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dea06652-204a-47a1-b40b-bb0a25cea7b0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:07.164321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=52 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:10:07.169545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea06652-204a-47a1-b40b-bb0a25cea7b0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:07.170041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea06652-204a-47a1-b40b-bb0a25cea7b0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:07.170486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea06652-204a-47a1-b40b-bb0a25cea7b0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:07.171189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea06652-204a-47a1-b40b-bb0a25cea7b0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:07.171646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea06652-204a-47a1-b40b-bb0a25cea7b0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:07.172108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dea06652-204a-47a1-b40b-bb0a25cea7b0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:07.389722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dea06652-204a-47a1-b40b-bb0a25cea7b0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:07.397574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dea06652-204a-47a1-b40b-bb0a25cea7b0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.240193 Aug 08 09:10:07.398717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 874/1841] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:07 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:07.663368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f62822e2-fe97-4d4d-8d97-d131e672b7e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:07.664005 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f62822e2-fe97-4d4d-8d97-d131e672b7e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:07.666389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=56 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:10:07.670978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f62822e2-fe97-4d4d-8d97-d131e672b7e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:07.676277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f62822e2-fe97-4d4d-8d97-d131e672b7e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:07.676277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f62822e2-fe97-4d4d-8d97-d131e672b7e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:07.676277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f62822e2-fe97-4d4d-8d97-d131e672b7e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:07.676277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f62822e2-fe97-4d4d-8d97-d131e672b7e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:07.676698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f62822e2-fe97-4d4d-8d97-d131e672b7e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:07.737639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f62822e2-fe97-4d4d-8d97-d131e672b7e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:07.746102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f62822e2-fe97-4d4d-8d97-d131e672b7e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086613 Aug 08 09:10:07.746661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 968/1842] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:07 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:08.419620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-98f2b52d-8ae8-4f65-9b2e-a6d0a8fb636b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:08.420259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-98f2b52d-8ae8-4f65-9b2e-a6d0a8fb636b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:08.426695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98f2b52d-8ae8-4f65-9b2e-a6d0a8fb636b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:08.427179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98f2b52d-8ae8-4f65-9b2e-a6d0a8fb636b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:08.427624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98f2b52d-8ae8-4f65-9b2e-a6d0a8fb636b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:08.428314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98f2b52d-8ae8-4f65-9b2e-a6d0a8fb636b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:08.428771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98f2b52d-8ae8-4f65-9b2e-a6d0a8fb636b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:08.429225 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98f2b52d-8ae8-4f65-9b2e-a6d0a8fb636b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:08.554765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-98f2b52d-8ae8-4f65-9b2e-a6d0a8fb636b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:08.562605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-98f2b52d-8ae8-4f65-9b2e-a6d0a8fb636b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.146897 Aug 08 09:10:08.563162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 875/1843] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:08 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:08.608951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:10:08.609118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:10:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:10:08.767425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-39839607-38d0-4ba3-adb9-e8f7cbd67d42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:08.768061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-39839607-38d0-4ba3-adb9-e8f7cbd67d42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:08.774997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39839607-38d0-4ba3-adb9-e8f7cbd67d42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:08.775475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39839607-38d0-4ba3-adb9-e8f7cbd67d42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:08.775965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39839607-38d0-4ba3-adb9-e8f7cbd67d42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:08.776665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39839607-38d0-4ba3-adb9-e8f7cbd67d42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:08.777114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39839607-38d0-4ba3-adb9-e8f7cbd67d42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:08.777556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39839607-38d0-4ba3-adb9-e8f7cbd67d42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:08.838493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-39839607-38d0-4ba3-adb9-e8f7cbd67d42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:08.846433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-39839607-38d0-4ba3-adb9-e8f7cbd67d42 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082907 Aug 08 09:10:08.847193 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 969/1844] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:08 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:09.583513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-51ac55a5-7fc0-48c5-a0ec-83bde38195a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:09.584122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-51ac55a5-7fc0-48c5-a0ec-83bde38195a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:09.590595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51ac55a5-7fc0-48c5-a0ec-83bde38195a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:09.591075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51ac55a5-7fc0-48c5-a0ec-83bde38195a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:09.591505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51ac55a5-7fc0-48c5-a0ec-83bde38195a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:09.592191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51ac55a5-7fc0-48c5-a0ec-83bde38195a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:09.592644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51ac55a5-7fc0-48c5-a0ec-83bde38195a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:09.593066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51ac55a5-7fc0-48c5-a0ec-83bde38195a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:09.722765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-51ac55a5-7fc0-48c5-a0ec-83bde38195a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:09.731289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-51ac55a5-7fc0-48c5-a0ec-83bde38195a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151627 Aug 08 09:10:09.731844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 876/1845] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:09 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:09.866162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-385f41e4-023f-4bd0-ab93-dbc07f5ac613 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:09.866781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-385f41e4-023f-4bd0-ab93-dbc07f5ac613 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:09.873398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-385f41e4-023f-4bd0-ab93-dbc07f5ac613 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:09.878149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-385f41e4-023f-4bd0-ab93-dbc07f5ac613 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:09.878149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-385f41e4-023f-4bd0-ab93-dbc07f5ac613 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:09.878149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-385f41e4-023f-4bd0-ab93-dbc07f5ac613 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:09.878149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-385f41e4-023f-4bd0-ab93-dbc07f5ac613 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:09.878577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-385f41e4-023f-4bd0-ab93-dbc07f5ac613 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:09.893544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:10:09.937398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-385f41e4-023f-4bd0-ab93-dbc07f5ac613 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:09.945336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-385f41e4-023f-4bd0-ab93-dbc07f5ac613 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083006 Aug 08 09:10:09.945892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 970/1846] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:10.751879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-12e77033-024a-46db-b9b5-b36157bb79d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:10.752500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-12e77033-024a-46db-b9b5-b36157bb79d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:10.759984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12e77033-024a-46db-b9b5-b36157bb79d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:10.760474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12e77033-024a-46db-b9b5-b36157bb79d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:10.760915 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12e77033-024a-46db-b9b5-b36157bb79d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:10.761652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12e77033-024a-46db-b9b5-b36157bb79d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:10.762114 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12e77033-024a-46db-b9b5-b36157bb79d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:10.762549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12e77033-024a-46db-b9b5-b36157bb79d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:10.895223 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-12e77033-024a-46db-b9b5-b36157bb79d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:10.903344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-12e77033-024a-46db-b9b5-b36157bb79d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.155387 Aug 08 09:10:10.903913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 877/1847] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:10 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:10.965474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-19e04d71-8257-4e11-907c-faabc94f0569 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:10.966089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-19e04d71-8257-4e11-907c-faabc94f0569 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:10.972486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e04d71-8257-4e11-907c-faabc94f0569 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:10.972968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e04d71-8257-4e11-907c-faabc94f0569 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:10.973436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e04d71-8257-4e11-907c-faabc94f0569 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:10.974125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e04d71-8257-4e11-907c-faabc94f0569 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:10.974577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e04d71-8257-4e11-907c-faabc94f0569 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:10.975004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19e04d71-8257-4e11-907c-faabc94f0569 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:11.040037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-19e04d71-8257-4e11-907c-faabc94f0569 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:11.047912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-19e04d71-8257-4e11-907c-faabc94f0569 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086388 Aug 08 09:10:11.048475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 971/1848] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:10 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:11.924675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ed1e36df-b818-4bf8-ac7b-499d7ca24e5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:11.925334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ed1e36df-b818-4bf8-ac7b-499d7ca24e5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:11.932318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed1e36df-b818-4bf8-ac7b-499d7ca24e5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:11.932806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed1e36df-b818-4bf8-ac7b-499d7ca24e5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:11.933273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed1e36df-b818-4bf8-ac7b-499d7ca24e5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:11.933960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed1e36df-b818-4bf8-ac7b-499d7ca24e5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:11.934444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed1e36df-b818-4bf8-ac7b-499d7ca24e5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:11.934864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed1e36df-b818-4bf8-ac7b-499d7ca24e5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:12.062178 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ed1e36df-b818-4bf8-ac7b-499d7ca24e5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:12.069339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a3bfb5a1-74bf-4669-b891-7a76af866eec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:12.070536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a3bfb5a1-74bf-4669-b891-7a76af866eec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:12.070744 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ed1e36df-b818-4bf8-ac7b-499d7ca24e5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149334 Aug 08 09:10:12.071308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 878/1849] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:11 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:12.077189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3bfb5a1-74bf-4669-b891-7a76af866eec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:12.077668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3bfb5a1-74bf-4669-b891-7a76af866eec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:12.078102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3bfb5a1-74bf-4669-b891-7a76af866eec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:12.078796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3bfb5a1-74bf-4669-b891-7a76af866eec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:12.079246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3bfb5a1-74bf-4669-b891-7a76af866eec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:12.079668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a3bfb5a1-74bf-4669-b891-7a76af866eec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:12.139207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a3bfb5a1-74bf-4669-b891-7a76af866eec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:12.146941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a3bfb5a1-74bf-4669-b891-7a76af866eec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081441 Aug 08 09:10:12.147491 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 972/1850] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:12 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:10:13.092061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-445417d4-4a3a-4374-9911-a6326768ac1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:13.092723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-445417d4-4a3a-4374-9911-a6326768ac1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:13.099107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-445417d4-4a3a-4374-9911-a6326768ac1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:13.099586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-445417d4-4a3a-4374-9911-a6326768ac1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:13.100017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-445417d4-4a3a-4374-9911-a6326768ac1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:13.100703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-445417d4-4a3a-4374-9911-a6326768ac1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:13.101240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-445417d4-4a3a-4374-9911-a6326768ac1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:13.101871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-445417d4-4a3a-4374-9911-a6326768ac1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:13.167141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9bed99e6-03c4-41c0-81cf-de7bcc49efe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:13.167835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9bed99e6-03c4-41c0-81cf-de7bcc49efe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:13.174269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bed99e6-03c4-41c0-81cf-de7bcc49efe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:13.174758 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bed99e6-03c4-41c0-81cf-de7bcc49efe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:13.175202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bed99e6-03c4-41c0-81cf-de7bcc49efe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:13.175907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bed99e6-03c4-41c0-81cf-de7bcc49efe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:13.176369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bed99e6-03c4-41c0-81cf-de7bcc49efe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:13.176801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9bed99e6-03c4-41c0-81cf-de7bcc49efe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:13.247125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9bed99e6-03c4-41c0-81cf-de7bcc49efe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:13.255013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9bed99e6-03c4-41c0-81cf-de7bcc49efe7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.091785 Aug 08 09:10:13.269333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 973/1851] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:10:13.269685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-445417d4-4a3a-4374-9911-a6326768ac1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:13.269685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-445417d4-4a3a-4374-9911-a6326768ac1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.181394 Aug 08 09:10:13.269951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 879/1852] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:13 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:14.277046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-927e7ea5-1595-4fa8-906e-38b141e6669a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:14.277689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-927e7ea5-1595-4fa8-906e-38b141e6669a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:14.284019 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-927e7ea5-1595-4fa8-906e-38b141e6669a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:14.284506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-927e7ea5-1595-4fa8-906e-38b141e6669a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:14.284945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-927e7ea5-1595-4fa8-906e-38b141e6669a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:14.285704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-927e7ea5-1595-4fa8-906e-38b141e6669a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:14.286163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-927e7ea5-1595-4fa8-906e-38b141e6669a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:14.286593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-927e7ea5-1595-4fa8-906e-38b141e6669a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:14.292995 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8394a278-4f3b-47ac-b3e5-fcb02a5e0b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:14.293637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8394a278-4f3b-47ac-b3e5-fcb02a5e0b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:14.299933 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8394a278-4f3b-47ac-b3e5-fcb02a5e0b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:14.300418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8394a278-4f3b-47ac-b3e5-fcb02a5e0b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:14.300853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8394a278-4f3b-47ac-b3e5-fcb02a5e0b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:14.301578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8394a278-4f3b-47ac-b3e5-fcb02a5e0b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:14.302034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8394a278-4f3b-47ac-b3e5-fcb02a5e0b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:14.302455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8394a278-4f3b-47ac-b3e5-fcb02a5e0b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:14.349039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-927e7ea5-1595-4fa8-906e-38b141e6669a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:14.358001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-927e7ea5-1595-4fa8-906e-38b141e6669a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085197 Aug 08 09:10:14.362072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 974/1853] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:14.444786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8394a278-4f3b-47ac-b3e5-fcb02a5e0b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:14.452672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8394a278-4f3b-47ac-b3e5-fcb02a5e0b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.164331 Aug 08 09:10:14.453243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 880/1854] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:14 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:15.378712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-deaa4435-ff9f-46e8-b249-c97357722deb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:15.379318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-deaa4435-ff9f-46e8-b249-c97357722deb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:15.385969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-deaa4435-ff9f-46e8-b249-c97357722deb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:15.386447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-deaa4435-ff9f-46e8-b249-c97357722deb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:15.386877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-deaa4435-ff9f-46e8-b249-c97357722deb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:15.387559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-deaa4435-ff9f-46e8-b249-c97357722deb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:15.388006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-deaa4435-ff9f-46e8-b249-c97357722deb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:15.388424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-deaa4435-ff9f-46e8-b249-c97357722deb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:15.448622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-deaa4435-ff9f-46e8-b249-c97357722deb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:15.456440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-deaa4435-ff9f-46e8-b249-c97357722deb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081596 Aug 08 09:10:15.456988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 975/1855] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:15 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:15.473735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-88431eb5-352b-4574-bde9-1ee3bce55264 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:15.474359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-88431eb5-352b-4574-bde9-1ee3bce55264 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:15.481393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-88431eb5-352b-4574-bde9-1ee3bce55264 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:15.481883 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-88431eb5-352b-4574-bde9-1ee3bce55264 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:15.482324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-88431eb5-352b-4574-bde9-1ee3bce55264 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:15.483048 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-88431eb5-352b-4574-bde9-1ee3bce55264 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:15.483512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-88431eb5-352b-4574-bde9-1ee3bce55264 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:15.483940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-88431eb5-352b-4574-bde9-1ee3bce55264 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:15.609903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-88431eb5-352b-4574-bde9-1ee3bce55264 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:15.618381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-88431eb5-352b-4574-bde9-1ee3bce55264 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148547 Aug 08 09:10:15.618938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 881/1856] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:15 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:16.477179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a0c8a44a-eb4b-497c-b9f6-85ee6f936605 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:16.477723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a0c8a44a-eb4b-497c-b9f6-85ee6f936605 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:16.484004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0c8a44a-eb4b-497c-b9f6-85ee6f936605 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:16.484485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0c8a44a-eb4b-497c-b9f6-85ee6f936605 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:16.484916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0c8a44a-eb4b-497c-b9f6-85ee6f936605 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:16.485626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0c8a44a-eb4b-497c-b9f6-85ee6f936605 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:16.486079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0c8a44a-eb4b-497c-b9f6-85ee6f936605 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:16.486507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a0c8a44a-eb4b-497c-b9f6-85ee6f936605 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:16.546157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a0c8a44a-eb4b-497c-b9f6-85ee6f936605 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:16.553889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a0c8a44a-eb4b-497c-b9f6-85ee6f936605 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.080779 Aug 08 09:10:16.555062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 976/1857] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:16.639622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a1a24848-bfa7-443a-9325-5653ee150cee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:16.640237 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a1a24848-bfa7-443a-9325-5653ee150cee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:16.646524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1a24848-bfa7-443a-9325-5653ee150cee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:16.647002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1a24848-bfa7-443a-9325-5653ee150cee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:16.647436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1a24848-bfa7-443a-9325-5653ee150cee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:16.648268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1a24848-bfa7-443a-9325-5653ee150cee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:16.648725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1a24848-bfa7-443a-9325-5653ee150cee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:16.649168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1a24848-bfa7-443a-9325-5653ee150cee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:16.781441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a1a24848-bfa7-443a-9325-5653ee150cee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:16.789412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a1a24848-bfa7-443a-9325-5653ee150cee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153598 Aug 08 09:10:16.789975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 882/1858] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:16 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:17.576100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f155497b-436f-438e-a213-2bff2e7d5c6b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:17.576717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f155497b-436f-438e-a213-2bff2e7d5c6b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:17.583256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f155497b-436f-438e-a213-2bff2e7d5c6b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:17.583774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f155497b-436f-438e-a213-2bff2e7d5c6b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:17.584216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f155497b-436f-438e-a213-2bff2e7d5c6b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:17.584907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f155497b-436f-438e-a213-2bff2e7d5c6b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:17.586063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f155497b-436f-438e-a213-2bff2e7d5c6b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:17.586495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f155497b-436f-438e-a213-2bff2e7d5c6b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:17.646399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f155497b-436f-438e-a213-2bff2e7d5c6b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:17.654998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f155497b-436f-438e-a213-2bff2e7d5c6b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082836 Aug 08 09:10:17.655567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 977/1859] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:17 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:17.810333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3f13ca55-75ab-4d49-bc95-d4c166a92a68 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:17.810906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3f13ca55-75ab-4d49-bc95-d4c166a92a68 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:17.817221 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f13ca55-75ab-4d49-bc95-d4c166a92a68 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:17.817703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f13ca55-75ab-4d49-bc95-d4c166a92a68 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:17.818134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f13ca55-75ab-4d49-bc95-d4c166a92a68 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:17.818822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f13ca55-75ab-4d49-bc95-d4c166a92a68 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:17.819275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f13ca55-75ab-4d49-bc95-d4c166a92a68 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:17.820227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f13ca55-75ab-4d49-bc95-d4c166a92a68 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:17.950322 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3f13ca55-75ab-4d49-bc95-d4c166a92a68 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:17.953753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:10:17.958493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3f13ca55-75ab-4d49-bc95-d4c166a92a68 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152129 Aug 08 09:10:17.959040 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 883/1860] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:17 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:18.675595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-55a5463f-ccfb-42d6-98f7-11cbdd0c201b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:18.676134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-55a5463f-ccfb-42d6-98f7-11cbdd0c201b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:18.683309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55a5463f-ccfb-42d6-98f7-11cbdd0c201b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:18.685672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55a5463f-ccfb-42d6-98f7-11cbdd0c201b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:18.685672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55a5463f-ccfb-42d6-98f7-11cbdd0c201b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:18.685672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55a5463f-ccfb-42d6-98f7-11cbdd0c201b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:18.685672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55a5463f-ccfb-42d6-98f7-11cbdd0c201b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:18.686108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-55a5463f-ccfb-42d6-98f7-11cbdd0c201b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:18.982625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-28bd4015-780f-4731-99f1-48657812001f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:18.983229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-28bd4015-780f-4731-99f1-48657812001f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:18.989903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28bd4015-780f-4731-99f1-48657812001f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:18.990392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28bd4015-780f-4731-99f1-48657812001f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:18.990832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28bd4015-780f-4731-99f1-48657812001f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:18.991531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28bd4015-780f-4731-99f1-48657812001f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:18.992599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28bd4015-780f-4731-99f1-48657812001f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:18.993035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28bd4015-780f-4731-99f1-48657812001f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:18.998404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-55a5463f-ccfb-42d6-98f7-11cbdd0c201b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:19.006164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-55a5463f-ccfb-42d6-98f7-11cbdd0c201b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.334433 Aug 08 09:10:19.006753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 978/1861] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:18 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:19.120508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-28bd4015-780f-4731-99f1-48657812001f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:19.128537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-28bd4015-780f-4731-99f1-48657812001f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150577 Aug 08 09:10:19.129098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 884/1862] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:18 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:10:20.028549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d09d44ad-0a6d-422f-b48a-75b09c4c1fa8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:20.029185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d09d44ad-0a6d-422f-b48a-75b09c4c1fa8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:20.035705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d09d44ad-0a6d-422f-b48a-75b09c4c1fa8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:20.036196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d09d44ad-0a6d-422f-b48a-75b09c4c1fa8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:20.036626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d09d44ad-0a6d-422f-b48a-75b09c4c1fa8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:20.037347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d09d44ad-0a6d-422f-b48a-75b09c4c1fa8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:20.037805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d09d44ad-0a6d-422f-b48a-75b09c4c1fa8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:20.038234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d09d44ad-0a6d-422f-b48a-75b09c4c1fa8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:20.099968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d09d44ad-0a6d-422f-b48a-75b09c4c1fa8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:20.107854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d09d44ad-0a6d-422f-b48a-75b09c4c1fa8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083189 Aug 08 09:10:20.108413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 979/1863] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:20 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:20.150321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-35260bd4-d360-42fe-872c-619b3a31828f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:20.150940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-35260bd4-d360-42fe-872c-619b3a31828f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:20.157295 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35260bd4-d360-42fe-872c-619b3a31828f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:20.157782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35260bd4-d360-42fe-872c-619b3a31828f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:20.158222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35260bd4-d360-42fe-872c-619b3a31828f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:20.158918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35260bd4-d360-42fe-872c-619b3a31828f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:20.159377 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35260bd4-d360-42fe-872c-619b3a31828f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:20.159810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35260bd4-d360-42fe-872c-619b3a31828f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:20.290744 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-35260bd4-d360-42fe-872c-619b3a31828f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:20.298651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-35260bd4-d360-42fe-872c-619b3a31828f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152914 Aug 08 09:10:20.299216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 885/1864] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:20 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:21.127808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b31f6fdb-9352-47d8-8b33-a01008462145 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:21.128423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b31f6fdb-9352-47d8-8b33-a01008462145 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:21.135863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b31f6fdb-9352-47d8-8b33-a01008462145 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:21.136349 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b31f6fdb-9352-47d8-8b33-a01008462145 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:21.136789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b31f6fdb-9352-47d8-8b33-a01008462145 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:21.137551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b31f6fdb-9352-47d8-8b33-a01008462145 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:21.138014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b31f6fdb-9352-47d8-8b33-a01008462145 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:21.138443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b31f6fdb-9352-47d8-8b33-a01008462145 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:21.200432 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b31f6fdb-9352-47d8-8b33-a01008462145 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:21.208596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b31f6fdb-9352-47d8-8b33-a01008462145 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084659 Aug 08 09:10:21.209164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 980/1865] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:21 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:21.320590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-199a0203-8e3c-4d46-95ac-c89934349534 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:21.321225 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-199a0203-8e3c-4d46-95ac-c89934349534 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:21.327543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-199a0203-8e3c-4d46-95ac-c89934349534 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:21.328035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-199a0203-8e3c-4d46-95ac-c89934349534 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:21.328475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-199a0203-8e3c-4d46-95ac-c89934349534 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:21.329183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-199a0203-8e3c-4d46-95ac-c89934349534 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:21.329646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-199a0203-8e3c-4d46-95ac-c89934349534 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:21.330081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-199a0203-8e3c-4d46-95ac-c89934349534 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:21.461465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-199a0203-8e3c-4d46-95ac-c89934349534 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:21.469355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-199a0203-8e3c-4d46-95ac-c89934349534 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153190 Aug 08 09:10:21.469920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 886/1866] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:21 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:22.229084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-baac6641-431a-4602-99d4-5be82de3bc98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:22.229731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-baac6641-431a-4602-99d4-5be82de3bc98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:22.236019 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baac6641-431a-4602-99d4-5be82de3bc98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:22.236497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baac6641-431a-4602-99d4-5be82de3bc98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:22.236929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baac6641-431a-4602-99d4-5be82de3bc98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:22.237640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baac6641-431a-4602-99d4-5be82de3bc98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:22.238094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baac6641-431a-4602-99d4-5be82de3bc98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:22.238519 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-baac6641-431a-4602-99d4-5be82de3bc98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:22.300660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-baac6641-431a-4602-99d4-5be82de3bc98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:22.310255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-baac6641-431a-4602-99d4-5be82de3bc98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085608 Aug 08 09:10:22.310816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 981/1867] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:22.490229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-349ec684-6e0b-4a33-aecd-ebd69e72b213 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:22.490752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-349ec684-6e0b-4a33-aecd-ebd69e72b213 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:22.497437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-349ec684-6e0b-4a33-aecd-ebd69e72b213 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:22.497915 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-349ec684-6e0b-4a33-aecd-ebd69e72b213 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:22.498349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-349ec684-6e0b-4a33-aecd-ebd69e72b213 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:22.499032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-349ec684-6e0b-4a33-aecd-ebd69e72b213 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:22.499482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-349ec684-6e0b-4a33-aecd-ebd69e72b213 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:22.499901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-349ec684-6e0b-4a33-aecd-ebd69e72b213 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:22.625262 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-349ec684-6e0b-4a33-aecd-ebd69e72b213 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:22.633180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-349ec684-6e0b-4a33-aecd-ebd69e72b213 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.146881 Aug 08 09:10:22.633745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 887/1868] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:22 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:23.331509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-afbd4587-83da-4df8-8d10-4c92d077aba2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:23.332106 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-afbd4587-83da-4df8-8d10-4c92d077aba2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:23.338764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbd4587-83da-4df8-8d10-4c92d077aba2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:23.339198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbd4587-83da-4df8-8d10-4c92d077aba2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:23.339634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbd4587-83da-4df8-8d10-4c92d077aba2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:23.340331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbd4587-83da-4df8-8d10-4c92d077aba2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:23.340782 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbd4587-83da-4df8-8d10-4c92d077aba2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:23.341302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbd4587-83da-4df8-8d10-4c92d077aba2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:23.406404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-afbd4587-83da-4df8-8d10-4c92d077aba2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:23.415073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-afbd4587-83da-4df8-8d10-4c92d077aba2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087340 Aug 08 09:10:23.415964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 982/1869] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:23.654918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-752b5a2f-6b7a-4936-ab94-862fba5b62c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:23.663027 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-752b5a2f-6b7a-4936-ab94-862fba5b62c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:23.663027 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-752b5a2f-6b7a-4936-ab94-862fba5b62c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:23.663027 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-752b5a2f-6b7a-4936-ab94-862fba5b62c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:23.663432 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-752b5a2f-6b7a-4936-ab94-862fba5b62c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:23.664014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-752b5a2f-6b7a-4936-ab94-862fba5b62c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:23.664473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-752b5a2f-6b7a-4936-ab94-862fba5b62c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:23.664903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-752b5a2f-6b7a-4936-ab94-862fba5b62c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:23.808675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-752b5a2f-6b7a-4936-ab94-862fba5b62c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:23.817256 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-752b5a2f-6b7a-4936-ab94-862fba5b62c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.166399 Aug 08 09:10:23.817840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 888/1870] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:23 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:10:24.437877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2f8446e4-fe66-4ee9-bcfc-b88d4b270d97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:24.438502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2f8446e4-fe66-4ee9-bcfc-b88d4b270d97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:24.444989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f8446e4-fe66-4ee9-bcfc-b88d4b270d97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:24.445551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f8446e4-fe66-4ee9-bcfc-b88d4b270d97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:24.445995 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f8446e4-fe66-4ee9-bcfc-b88d4b270d97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:24.446690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f8446e4-fe66-4ee9-bcfc-b88d4b270d97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:24.447147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f8446e4-fe66-4ee9-bcfc-b88d4b270d97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:24.447575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f8446e4-fe66-4ee9-bcfc-b88d4b270d97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:24.507265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2f8446e4-fe66-4ee9-bcfc-b88d4b270d97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:24.515291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2f8446e4-fe66-4ee9-bcfc-b88d4b270d97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081312 Aug 08 09:10:24.515856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 983/1871] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:24 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:24.841328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4c40868f-c73b-495c-adb3-2146756a7113 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:24.841890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4c40868f-c73b-495c-adb3-2146756a7113 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:24.848325 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c40868f-c73b-495c-adb3-2146756a7113 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:24.848817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c40868f-c73b-495c-adb3-2146756a7113 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:24.849299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c40868f-c73b-495c-adb3-2146756a7113 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:24.850003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c40868f-c73b-495c-adb3-2146756a7113 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:24.850464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c40868f-c73b-495c-adb3-2146756a7113 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:24.851479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c40868f-c73b-495c-adb3-2146756a7113 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:24.982288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4c40868f-c73b-495c-adb3-2146756a7113 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:24.990153 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4c40868f-c73b-495c-adb3-2146756a7113 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152908 Aug 08 09:10:24.990708 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 889/1872] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:24 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:25.010150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:10:25.010320 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:10:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:10:25.535681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dde05020-b02d-48e0-96e0-7b13ffb09fcd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:25.536302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dde05020-b02d-48e0-96e0-7b13ffb09fcd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:25.542931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde05020-b02d-48e0-96e0-7b13ffb09fcd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:25.543410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde05020-b02d-48e0-96e0-7b13ffb09fcd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:25.543850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde05020-b02d-48e0-96e0-7b13ffb09fcd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:25.544537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde05020-b02d-48e0-96e0-7b13ffb09fcd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:25.544988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde05020-b02d-48e0-96e0-7b13ffb09fcd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:25.545442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dde05020-b02d-48e0-96e0-7b13ffb09fcd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:25.606317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-dde05020-b02d-48e0-96e0-7b13ffb09fcd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:25.614119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dde05020-b02d-48e0-96e0-7b13ffb09fcd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082250 Aug 08 09:10:25.614677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 984/1873] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:26.011363 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-55f61565-82e8-4cfb-b0b7-ed69e6da440a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:26.011985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-55f61565-82e8-4cfb-b0b7-ed69e6da440a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:26.018654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55f61565-82e8-4cfb-b0b7-ed69e6da440a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:26.019137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55f61565-82e8-4cfb-b0b7-ed69e6da440a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:26.019572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55f61565-82e8-4cfb-b0b7-ed69e6da440a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:26.020260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55f61565-82e8-4cfb-b0b7-ed69e6da440a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:26.020713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55f61565-82e8-4cfb-b0b7-ed69e6da440a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:26.021138 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-55f61565-82e8-4cfb-b0b7-ed69e6da440a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:26.148051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-55f61565-82e8-4cfb-b0b7-ed69e6da440a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:26.155999 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-55f61565-82e8-4cfb-b0b7-ed69e6da440a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149039 Aug 08 09:10:26.156580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 890/1874] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:26 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:26.635912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-11fbb05b-69fa-44a4-9c28-788ce5dfe043 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:26.636525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-11fbb05b-69fa-44a4-9c28-788ce5dfe043 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:26.642922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11fbb05b-69fa-44a4-9c28-788ce5dfe043 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:26.643404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11fbb05b-69fa-44a4-9c28-788ce5dfe043 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:26.643844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11fbb05b-69fa-44a4-9c28-788ce5dfe043 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:26.644531 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11fbb05b-69fa-44a4-9c28-788ce5dfe043 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:26.644984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11fbb05b-69fa-44a4-9c28-788ce5dfe043 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:26.645438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11fbb05b-69fa-44a4-9c28-788ce5dfe043 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:26.705099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-11fbb05b-69fa-44a4-9c28-788ce5dfe043 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:26.713608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-11fbb05b-69fa-44a4-9c28-788ce5dfe043 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082356 Aug 08 09:10:26.714164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 985/1875] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:27.177610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-14714dcc-14a4-4ddd-9c53-365e90bcc36b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:27.178256 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-14714dcc-14a4-4ddd-9c53-365e90bcc36b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:27.185296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14714dcc-14a4-4ddd-9c53-365e90bcc36b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:27.185729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14714dcc-14a4-4ddd-9c53-365e90bcc36b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:27.186161 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14714dcc-14a4-4ddd-9c53-365e90bcc36b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:27.186844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14714dcc-14a4-4ddd-9c53-365e90bcc36b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:27.187301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14714dcc-14a4-4ddd-9c53-365e90bcc36b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:27.187723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-14714dcc-14a4-4ddd-9c53-365e90bcc36b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:27.320525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-14714dcc-14a4-4ddd-9c53-365e90bcc36b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:27.328509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-14714dcc-14a4-4ddd-9c53-365e90bcc36b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154761 Aug 08 09:10:27.329080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 891/1876] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:27 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:27.734433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a7d996e4-a346-499d-af5d-d573636c470b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:27.735051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a7d996e4-a346-499d-af5d-d573636c470b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:27.741400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d996e4-a346-499d-af5d-d573636c470b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:27.741992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d996e4-a346-499d-af5d-d573636c470b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:27.742440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d996e4-a346-499d-af5d-d573636c470b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:27.743128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d996e4-a346-499d-af5d-d573636c470b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:27.743584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d996e4-a346-499d-af5d-d573636c470b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:27.744012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a7d996e4-a346-499d-af5d-d573636c470b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:27.804141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a7d996e4-a346-499d-af5d-d573636c470b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:27.812029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a7d996e4-a346-499d-af5d-d573636c470b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081550 Aug 08 09:10:27.812585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 986/1877] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:27 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:28.348869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5b8d9555-a5ef-4d6f-8808-0587db4ec564 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:28.349553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5b8d9555-a5ef-4d6f-8808-0587db4ec564 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:28.356434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b8d9555-a5ef-4d6f-8808-0587db4ec564 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:28.356922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b8d9555-a5ef-4d6f-8808-0587db4ec564 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:28.357394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b8d9555-a5ef-4d6f-8808-0587db4ec564 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:28.358093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b8d9555-a5ef-4d6f-8808-0587db4ec564 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:28.358553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b8d9555-a5ef-4d6f-8808-0587db4ec564 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:28.358985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5b8d9555-a5ef-4d6f-8808-0587db4ec564 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:28.490502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5b8d9555-a5ef-4d6f-8808-0587db4ec564 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:28.499195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5b8d9555-a5ef-4d6f-8808-0587db4ec564 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154355 Aug 08 09:10:28.499765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 892/1878] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:28 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:28.833436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5dbb6663-ebbc-44f4-bebe-20c9cdf83396 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:28.833983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5dbb6663-ebbc-44f4-bebe-20c9cdf83396 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:28.840545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5dbb6663-ebbc-44f4-bebe-20c9cdf83396 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:28.841026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5dbb6663-ebbc-44f4-bebe-20c9cdf83396 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:28.841501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5dbb6663-ebbc-44f4-bebe-20c9cdf83396 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:28.842188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5dbb6663-ebbc-44f4-bebe-20c9cdf83396 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:28.842637 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5dbb6663-ebbc-44f4-bebe-20c9cdf83396 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:28.843060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5dbb6663-ebbc-44f4-bebe-20c9cdf83396 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:28.846931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:10:28.905666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5dbb6663-ebbc-44f4-bebe-20c9cdf83396 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:28.913859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5dbb6663-ebbc-44f4-bebe-20c9cdf83396 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083841 Aug 08 09:10:28.914431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 987/1879] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:28 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:29.520671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-39a33d0b-311f-4e36-80d4-afa0bfc717d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:29.521413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-39a33d0b-311f-4e36-80d4-afa0bfc717d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:29.527641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-39a33d0b-311f-4e36-80d4-afa0bfc717d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:29.528131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-39a33d0b-311f-4e36-80d4-afa0bfc717d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:29.528565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-39a33d0b-311f-4e36-80d4-afa0bfc717d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:29.529291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-39a33d0b-311f-4e36-80d4-afa0bfc717d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:29.529752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-39a33d0b-311f-4e36-80d4-afa0bfc717d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:29.530200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-39a33d0b-311f-4e36-80d4-afa0bfc717d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:29.655669 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-39a33d0b-311f-4e36-80d4-afa0bfc717d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:29.664202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-39a33d0b-311f-4e36-80d4-afa0bfc717d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.146708 Aug 08 09:10:29.664767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 893/1880] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:29 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:29.934810 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d38ba3d3-90a3-476a-8df3-ad41e492015c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:29.935542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d38ba3d3-90a3-476a-8df3-ad41e492015c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:29.942203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d38ba3d3-90a3-476a-8df3-ad41e492015c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:29.942677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d38ba3d3-90a3-476a-8df3-ad41e492015c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:29.943118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d38ba3d3-90a3-476a-8df3-ad41e492015c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:29.943811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d38ba3d3-90a3-476a-8df3-ad41e492015c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:29.944271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d38ba3d3-90a3-476a-8df3-ad41e492015c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:29.945474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d38ba3d3-90a3-476a-8df3-ad41e492015c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:30.006362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d38ba3d3-90a3-476a-8df3-ad41e492015c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:30.015274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d38ba3d3-90a3-476a-8df3-ad41e492015c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084329 Aug 08 09:10:30.016115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 988/1881] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:29 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:30.685052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9367c08d-3236-4719-a427-d0407b4b59f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:30.685698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9367c08d-3236-4719-a427-d0407b4b59f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:30.692101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9367c08d-3236-4719-a427-d0407b4b59f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:30.692585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9367c08d-3236-4719-a427-d0407b4b59f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:30.693019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9367c08d-3236-4719-a427-d0407b4b59f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:30.693741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9367c08d-3236-4719-a427-d0407b4b59f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:30.694204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9367c08d-3236-4719-a427-d0407b4b59f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:30.694678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9367c08d-3236-4719-a427-d0407b4b59f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:30.822471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9367c08d-3236-4719-a427-d0407b4b59f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:30.830354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9367c08d-3236-4719-a427-d0407b4b59f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149193 Aug 08 09:10:30.830914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 894/1882] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:30 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:31.035818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fc31f4ea-2a72-485d-9070-2b6ca182ea00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:31.036356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fc31f4ea-2a72-485d-9070-2b6ca182ea00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:31.043066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc31f4ea-2a72-485d-9070-2b6ca182ea00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:31.043551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc31f4ea-2a72-485d-9070-2b6ca182ea00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:31.043990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc31f4ea-2a72-485d-9070-2b6ca182ea00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:31.044682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc31f4ea-2a72-485d-9070-2b6ca182ea00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:31.045163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc31f4ea-2a72-485d-9070-2b6ca182ea00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:31.045600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc31f4ea-2a72-485d-9070-2b6ca182ea00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:31.107802 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fc31f4ea-2a72-485d-9070-2b6ca182ea00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:31.117127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fc31f4ea-2a72-485d-9070-2b6ca182ea00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084593 Aug 08 09:10:31.117703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 989/1883] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:31 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:31.852728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6825f036-4381-4faa-983e-de13e05aea96 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:31.853396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6825f036-4381-4faa-983e-de13e05aea96 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:31.859628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6825f036-4381-4faa-983e-de13e05aea96 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:31.860115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6825f036-4381-4faa-983e-de13e05aea96 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:31.860553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6825f036-4381-4faa-983e-de13e05aea96 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:31.861275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6825f036-4381-4faa-983e-de13e05aea96 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:31.861735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6825f036-4381-4faa-983e-de13e05aea96 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:31.862164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6825f036-4381-4faa-983e-de13e05aea96 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:31.991123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6825f036-4381-4faa-983e-de13e05aea96 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:31.999314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6825f036-4381-4faa-983e-de13e05aea96 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150822 Aug 08 09:10:31.999913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 895/1884] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:31 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:32.138407 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2307ad26-1d3e-4dfb-b70b-96737a2042dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:32.139026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2307ad26-1d3e-4dfb-b70b-96737a2042dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:32.145367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2307ad26-1d3e-4dfb-b70b-96737a2042dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:32.145852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2307ad26-1d3e-4dfb-b70b-96737a2042dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:32.146290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2307ad26-1d3e-4dfb-b70b-96737a2042dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:32.146979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2307ad26-1d3e-4dfb-b70b-96737a2042dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:32.147438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2307ad26-1d3e-4dfb-b70b-96737a2042dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:32.148500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2307ad26-1d3e-4dfb-b70b-96737a2042dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:32.208561 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2307ad26-1d3e-4dfb-b70b-96737a2042dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:32.216414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2307ad26-1d3e-4dfb-b70b-96737a2042dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082090 Aug 08 09:10:32.216972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 990/1885] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:33.021299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-045c8be4-88f9-40c0-9c15-f073494aaf1d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:33.021916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-045c8be4-88f9-40c0-9c15-f073494aaf1d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:33.029087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-045c8be4-88f9-40c0-9c15-f073494aaf1d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:33.029608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-045c8be4-88f9-40c0-9c15-f073494aaf1d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:33.030046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-045c8be4-88f9-40c0-9c15-f073494aaf1d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:33.030741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-045c8be4-88f9-40c0-9c15-f073494aaf1d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:33.031200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-045c8be4-88f9-40c0-9c15-f073494aaf1d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:33.031629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-045c8be4-88f9-40c0-9c15-f073494aaf1d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:33.157255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-045c8be4-88f9-40c0-9c15-f073494aaf1d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:33.165772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-045c8be4-88f9-40c0-9c15-f073494aaf1d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148405 Aug 08 09:10:33.166339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 896/1886] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:33 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:33.236631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-89de87b8-34c8-48e4-8617-c093e5b08988 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:33.237279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-89de87b8-34c8-48e4-8617-c093e5b08988 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:33.243795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89de87b8-34c8-48e4-8617-c093e5b08988 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:33.244278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89de87b8-34c8-48e4-8617-c093e5b08988 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:33.244721 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89de87b8-34c8-48e4-8617-c093e5b08988 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:33.245444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89de87b8-34c8-48e4-8617-c093e5b08988 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:33.245906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89de87b8-34c8-48e4-8617-c093e5b08988 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:33.246339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89de87b8-34c8-48e4-8617-c093e5b08988 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:33.308076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-89de87b8-34c8-48e4-8617-c093e5b08988 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:33.315853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-89de87b8-34c8-48e4-8617-c093e5b08988 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083066 Aug 08 09:10:33.316406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 991/1887] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:33 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:34.186617 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fc868650-22b0-4c9b-9f60-dac6d39c2fff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:34.187242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fc868650-22b0-4c9b-9f60-dac6d39c2fff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:34.193754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc868650-22b0-4c9b-9f60-dac6d39c2fff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:34.194108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc868650-22b0-4c9b-9f60-dac6d39c2fff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:34.194560 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc868650-22b0-4c9b-9f60-dac6d39c2fff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:34.195254 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc868650-22b0-4c9b-9f60-dac6d39c2fff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:34.195712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc868650-22b0-4c9b-9f60-dac6d39c2fff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:34.196145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fc868650-22b0-4c9b-9f60-dac6d39c2fff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:34.325482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fc868650-22b0-4c9b-9f60-dac6d39c2fff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:34.333483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fc868650-22b0-4c9b-9f60-dac6d39c2fff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150723 Aug 08 09:10:34.334197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 897/1888] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:34 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:34.336599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4cd70b85-840f-4ec3-9ab3-3d6f78ce0336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:34.337243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4cd70b85-840f-4ec3-9ab3-3d6f78ce0336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:34.343518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cd70b85-840f-4ec3-9ab3-3d6f78ce0336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:34.343999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cd70b85-840f-4ec3-9ab3-3d6f78ce0336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:34.344437 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cd70b85-840f-4ec3-9ab3-3d6f78ce0336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:34.345126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cd70b85-840f-4ec3-9ab3-3d6f78ce0336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:34.345615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cd70b85-840f-4ec3-9ab3-3d6f78ce0336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:34.346040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4cd70b85-840f-4ec3-9ab3-3d6f78ce0336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:34.405957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4cd70b85-840f-4ec3-9ab3-3d6f78ce0336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:34.414578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4cd70b85-840f-4ec3-9ab3-3d6f78ce0336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081944 Aug 08 09:10:34.415196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 992/1889] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:35.355114 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a34b1769-a9d8-458e-9cc2-0e56be3cc656 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:35.355749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a34b1769-a9d8-458e-9cc2-0e56be3cc656 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:35.362147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a34b1769-a9d8-458e-9cc2-0e56be3cc656 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:35.362631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a34b1769-a9d8-458e-9cc2-0e56be3cc656 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:35.363062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a34b1769-a9d8-458e-9cc2-0e56be3cc656 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:35.363749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a34b1769-a9d8-458e-9cc2-0e56be3cc656 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:35.364201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a34b1769-a9d8-458e-9cc2-0e56be3cc656 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:35.364623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a34b1769-a9d8-458e-9cc2-0e56be3cc656 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:35.435306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5247b557-f33b-4e2f-a7f4-246d9aa1047d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:35.435919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5247b557-f33b-4e2f-a7f4-246d9aa1047d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:35.443573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5247b557-f33b-4e2f-a7f4-246d9aa1047d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:35.445214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5247b557-f33b-4e2f-a7f4-246d9aa1047d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:35.445214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5247b557-f33b-4e2f-a7f4-246d9aa1047d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:35.445758 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5247b557-f33b-4e2f-a7f4-246d9aa1047d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:35.446243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5247b557-f33b-4e2f-a7f4-246d9aa1047d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:35.446806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5247b557-f33b-4e2f-a7f4-246d9aa1047d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:35.521044 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5247b557-f33b-4e2f-a7f4-246d9aa1047d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:35.524485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a34b1769-a9d8-458e-9cc2-0e56be3cc656 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:35.529324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5247b557-f33b-4e2f-a7f4-246d9aa1047d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.097778 Aug 08 09:10:35.529992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 993/1890] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:35 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:10:35.532602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a34b1769-a9d8-458e-9cc2-0e56be3cc656 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.181345 Aug 08 09:10:35.533171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 898/1891] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:35 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:36.550486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-89711397-88c0-4342-8f5b-6ef2891c57be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:36.551036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-89711397-88c0-4342-8f5b-6ef2891c57be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:36.552777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bdfb2f93-d5db-4fc1-b8f7-0c0e07ee4218 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:36.553428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bdfb2f93-d5db-4fc1-b8f7-0c0e07ee4218 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:36.557063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89711397-88c0-4342-8f5b-6ef2891c57be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:36.557574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89711397-88c0-4342-8f5b-6ef2891c57be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:36.558087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89711397-88c0-4342-8f5b-6ef2891c57be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:36.558697 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89711397-88c0-4342-8f5b-6ef2891c57be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:36.559152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89711397-88c0-4342-8f5b-6ef2891c57be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:36.559464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdfb2f93-d5db-4fc1-b8f7-0c0e07ee4218 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:36.559602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89711397-88c0-4342-8f5b-6ef2891c57be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:36.559954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdfb2f93-d5db-4fc1-b8f7-0c0e07ee4218 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:36.560398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdfb2f93-d5db-4fc1-b8f7-0c0e07ee4218 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:36.561095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdfb2f93-d5db-4fc1-b8f7-0c0e07ee4218 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:36.561590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdfb2f93-d5db-4fc1-b8f7-0c0e07ee4218 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:36.562025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bdfb2f93-d5db-4fc1-b8f7-0c0e07ee4218 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:36.641654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-89711397-88c0-4342-8f5b-6ef2891c57be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:36.650024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-89711397-88c0-4342-8f5b-6ef2891c57be tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.103668 Aug 08 09:10:36.650593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 994/1892] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:36.710475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bdfb2f93-d5db-4fc1-b8f7-0c0e07ee4218 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:36.718511 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bdfb2f93-d5db-4fc1-b8f7-0c0e07ee4218 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.169843 Aug 08 09:10:36.719066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 899/1893] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:36 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:10:37.671148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ed89ac7c-addb-42f7-9cfd-aeb527d1da8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:37.671696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ed89ac7c-addb-42f7-9cfd-aeb527d1da8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:37.677999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed89ac7c-addb-42f7-9cfd-aeb527d1da8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:37.678477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed89ac7c-addb-42f7-9cfd-aeb527d1da8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:37.679547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed89ac7c-addb-42f7-9cfd-aeb527d1da8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:37.680458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed89ac7c-addb-42f7-9cfd-aeb527d1da8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:37.680915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed89ac7c-addb-42f7-9cfd-aeb527d1da8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:37.681375 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed89ac7c-addb-42f7-9cfd-aeb527d1da8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:37.739919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ad8eebd4-5126-4665-80e6-bd02964d1625 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:37.740555 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ad8eebd4-5126-4665-80e6-bd02964d1625 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:37.743476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=52 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:10:37.745030 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ed89ac7c-addb-42f7-9cfd-aeb527d1da8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:37.748238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad8eebd4-5126-4665-80e6-bd02964d1625 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:37.748737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad8eebd4-5126-4665-80e6-bd02964d1625 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:37.749207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad8eebd4-5126-4665-80e6-bd02964d1625 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:37.749912 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad8eebd4-5126-4665-80e6-bd02964d1625 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:37.750470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad8eebd4-5126-4665-80e6-bd02964d1625 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:37.750843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ad8eebd4-5126-4665-80e6-bd02964d1625 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:37.753029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ed89ac7c-addb-42f7-9cfd-aeb527d1da8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085839 Aug 08 09:10:37.753637 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 995/1894] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:37 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:37.770429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:10:37.880317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ad8eebd4-5126-4665-80e6-bd02964d1625 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:37.888686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ad8eebd4-5126-4665-80e6-bd02964d1625 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152772 Aug 08 09:10:37.889304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 900/1895] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:37 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:10:38.774957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-940eb874-52ab-4ff3-834b-c7e1217d6355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:38.775564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-940eb874-52ab-4ff3-834b-c7e1217d6355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:38.777849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=56 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:10:38.782424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-940eb874-52ab-4ff3-834b-c7e1217d6355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:38.782899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-940eb874-52ab-4ff3-834b-c7e1217d6355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:38.783331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-940eb874-52ab-4ff3-834b-c7e1217d6355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:38.784010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-940eb874-52ab-4ff3-834b-c7e1217d6355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:38.784461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-940eb874-52ab-4ff3-834b-c7e1217d6355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:38.784883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-940eb874-52ab-4ff3-834b-c7e1217d6355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:38.846344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-940eb874-52ab-4ff3-834b-c7e1217d6355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:38.854960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-940eb874-52ab-4ff3-834b-c7e1217d6355 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084108 Aug 08 09:10:38.855585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 996/1896] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:38 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:38.909413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cd2e163c-c488-48c2-a6ca-3129197ad2b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:38.910030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cd2e163c-c488-48c2-a6ca-3129197ad2b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:38.916939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd2e163c-c488-48c2-a6ca-3129197ad2b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:38.917502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd2e163c-c488-48c2-a6ca-3129197ad2b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:38.917946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd2e163c-c488-48c2-a6ca-3129197ad2b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:38.918642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd2e163c-c488-48c2-a6ca-3129197ad2b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:38.919101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd2e163c-c488-48c2-a6ca-3129197ad2b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:38.919532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cd2e163c-c488-48c2-a6ca-3129197ad2b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:39.049406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cd2e163c-c488-48c2-a6ca-3129197ad2b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:39.057391 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cd2e163c-c488-48c2-a6ca-3129197ad2b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151823 Aug 08 09:10:39.057950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 901/1897] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:38 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:39.876735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0dd15946-2a6c-4c43-9f45-3823b9130aa5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:39.877428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0dd15946-2a6c-4c43-9f45-3823b9130aa5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:39.884528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0dd15946-2a6c-4c43-9f45-3823b9130aa5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:39.885319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0dd15946-2a6c-4c43-9f45-3823b9130aa5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:39.885768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0dd15946-2a6c-4c43-9f45-3823b9130aa5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:39.886462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0dd15946-2a6c-4c43-9f45-3823b9130aa5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:39.886922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0dd15946-2a6c-4c43-9f45-3823b9130aa5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:39.887351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0dd15946-2a6c-4c43-9f45-3823b9130aa5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:39.948565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0dd15946-2a6c-4c43-9f45-3823b9130aa5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:39.956438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0dd15946-2a6c-4c43-9f45-3823b9130aa5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083617 Aug 08 09:10:39.957569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 997/1898] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:39 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:40.077349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-419cd7e5-5fe4-4dd4-92bb-55d67468b733 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:40.077969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-419cd7e5-5fe4-4dd4-92bb-55d67468b733 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:40.084338 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-419cd7e5-5fe4-4dd4-92bb-55d67468b733 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:40.084819 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-419cd7e5-5fe4-4dd4-92bb-55d67468b733 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:40.085363 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-419cd7e5-5fe4-4dd4-92bb-55d67468b733 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:40.086079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-419cd7e5-5fe4-4dd4-92bb-55d67468b733 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:40.086533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-419cd7e5-5fe4-4dd4-92bb-55d67468b733 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:40.086958 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-419cd7e5-5fe4-4dd4-92bb-55d67468b733 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:40.214076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-419cd7e5-5fe4-4dd4-92bb-55d67468b733 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:40.222101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-419cd7e5-5fe4-4dd4-92bb-55d67468b733 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148610 Aug 08 09:10:40.222701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 902/1899] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:40 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:40.977435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-be66f573-a0b3-4568-a070-736567527174 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:40.978057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-be66f573-a0b3-4568-a070-736567527174 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:40.984388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be66f573-a0b3-4568-a070-736567527174 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:40.984869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be66f573-a0b3-4568-a070-736567527174 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:40.985343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be66f573-a0b3-4568-a070-736567527174 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:40.986033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be66f573-a0b3-4568-a070-736567527174 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:40.986491 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be66f573-a0b3-4568-a070-736567527174 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:40.986916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-be66f573-a0b3-4568-a070-736567527174 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:41.049753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-be66f573-a0b3-4568-a070-736567527174 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:41.057606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-be66f573-a0b3-4568-a070-736567527174 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084123 Aug 08 09:10:41.058168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 998/1900] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:40 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:41.244206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-425e19aa-73a8-4b78-8df0-80c8aa728229 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:41.244742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-425e19aa-73a8-4b78-8df0-80c8aa728229 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:41.251181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-425e19aa-73a8-4b78-8df0-80c8aa728229 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:41.251672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-425e19aa-73a8-4b78-8df0-80c8aa728229 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:41.252116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-425e19aa-73a8-4b78-8df0-80c8aa728229 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:41.252815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-425e19aa-73a8-4b78-8df0-80c8aa728229 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:41.253306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-425e19aa-73a8-4b78-8df0-80c8aa728229 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:41.253740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-425e19aa-73a8-4b78-8df0-80c8aa728229 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:41.380743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-425e19aa-73a8-4b78-8df0-80c8aa728229 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:41.389746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-425e19aa-73a8-4b78-8df0-80c8aa728229 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150115 Aug 08 09:10:41.390296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 903/1901] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:41 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:42.078717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-738feb43-3e02-4413-b9eb-3de59281c873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:42.079368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-738feb43-3e02-4413-b9eb-3de59281c873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:42.085783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-738feb43-3e02-4413-b9eb-3de59281c873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:42.086262 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-738feb43-3e02-4413-b9eb-3de59281c873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:42.086696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-738feb43-3e02-4413-b9eb-3de59281c873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:42.087385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-738feb43-3e02-4413-b9eb-3de59281c873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:42.087843 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-738feb43-3e02-4413-b9eb-3de59281c873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:42.088271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-738feb43-3e02-4413-b9eb-3de59281c873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:42.148005 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-738feb43-3e02-4413-b9eb-3de59281c873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:42.156013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-738feb43-3e02-4413-b9eb-3de59281c873 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081138 Aug 08 09:10:42.156611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 999/1902] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:42 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:42.410702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2e90b8ce-3d94-4ec0-b5e0-784bd0d306d7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:42.411324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2e90b8ce-3d94-4ec0-b5e0-784bd0d306d7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:42.418594 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e90b8ce-3d94-4ec0-b5e0-784bd0d306d7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:42.418798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e90b8ce-3d94-4ec0-b5e0-784bd0d306d7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:42.419237 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e90b8ce-3d94-4ec0-b5e0-784bd0d306d7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:42.419944 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e90b8ce-3d94-4ec0-b5e0-784bd0d306d7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:42.420401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e90b8ce-3d94-4ec0-b5e0-784bd0d306d7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:42.420831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e90b8ce-3d94-4ec0-b5e0-784bd0d306d7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:42.551660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2e90b8ce-3d94-4ec0-b5e0-784bd0d306d7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:42.560263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2e90b8ce-3d94-4ec0-b5e0-784bd0d306d7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153499 Aug 08 09:10:42.561047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 904/1903] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:42 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:43.177029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5c06b86e-b232-4e30-96ff-ab6478598336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:43.177669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5c06b86e-b232-4e30-96ff-ab6478598336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:43.184099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c06b86e-b232-4e30-96ff-ab6478598336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:43.184583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c06b86e-b232-4e30-96ff-ab6478598336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:43.185019 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c06b86e-b232-4e30-96ff-ab6478598336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:43.185807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c06b86e-b232-4e30-96ff-ab6478598336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:43.186264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c06b86e-b232-4e30-96ff-ab6478598336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:43.186693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5c06b86e-b232-4e30-96ff-ab6478598336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:43.246439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5c06b86e-b232-4e30-96ff-ab6478598336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:43.254329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5c06b86e-b232-4e30-96ff-ab6478598336 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081180 Aug 08 09:10:43.254890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1000/1904] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:43.581001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-75cfd797-f787-43f0-9447-f4251453f7bd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:43.581566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-75cfd797-f787-43f0-9447-f4251453f7bd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:43.588713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75cfd797-f787-43f0-9447-f4251453f7bd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:43.589248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75cfd797-f787-43f0-9447-f4251453f7bd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:43.589688 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75cfd797-f787-43f0-9447-f4251453f7bd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:43.590391 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75cfd797-f787-43f0-9447-f4251453f7bd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:43.590856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75cfd797-f787-43f0-9447-f4251453f7bd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:43.591288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75cfd797-f787-43f0-9447-f4251453f7bd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:43.718777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-75cfd797-f787-43f0-9447-f4251453f7bd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:43.727035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-75cfd797-f787-43f0-9447-f4251453f7bd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149956 Aug 08 09:10:43.727607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 905/1905] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:43 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:44.276421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c67a2ce1-d84c-43f9-8df4-edd133d310c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:44.276968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c67a2ce1-d84c-43f9-8df4-edd133d310c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:44.283349 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c67a2ce1-d84c-43f9-8df4-edd133d310c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:44.283829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c67a2ce1-d84c-43f9-8df4-edd133d310c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:44.284266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c67a2ce1-d84c-43f9-8df4-edd133d310c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:44.284982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c67a2ce1-d84c-43f9-8df4-edd133d310c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:44.285463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c67a2ce1-d84c-43f9-8df4-edd133d310c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:44.285891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c67a2ce1-d84c-43f9-8df4-edd133d310c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:44.348812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c67a2ce1-d84c-43f9-8df4-edd133d310c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:44.357892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c67a2ce1-d84c-43f9-8df4-edd133d310c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085992 Aug 08 09:10:44.358455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1001/1906] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:44.747741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3b958a87-dd0c-4cf3-8fd8-7ffd501a125e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:44.748384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3b958a87-dd0c-4cf3-8fd8-7ffd501a125e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:44.754766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b958a87-dd0c-4cf3-8fd8-7ffd501a125e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:44.755253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b958a87-dd0c-4cf3-8fd8-7ffd501a125e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:44.755690 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b958a87-dd0c-4cf3-8fd8-7ffd501a125e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:44.756379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b958a87-dd0c-4cf3-8fd8-7ffd501a125e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:44.757340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b958a87-dd0c-4cf3-8fd8-7ffd501a125e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:44.757786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b958a87-dd0c-4cf3-8fd8-7ffd501a125e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:44.884642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3b958a87-dd0c-4cf3-8fd8-7ffd501a125e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:44.892762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3b958a87-dd0c-4cf3-8fd8-7ffd501a125e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148882 Aug 08 09:10:44.893348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 906/1907] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:44 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:45.377972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3b868c9a-7a6a-4dca-bb88-10a5be6d80e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:45.378589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3b868c9a-7a6a-4dca-bb88-10a5be6d80e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:45.384937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b868c9a-7a6a-4dca-bb88-10a5be6d80e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:45.385710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b868c9a-7a6a-4dca-bb88-10a5be6d80e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:45.386149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b868c9a-7a6a-4dca-bb88-10a5be6d80e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:45.386841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b868c9a-7a6a-4dca-bb88-10a5be6d80e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:45.387302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b868c9a-7a6a-4dca-bb88-10a5be6d80e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:45.387731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b868c9a-7a6a-4dca-bb88-10a5be6d80e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:45.448392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3b868c9a-7a6a-4dca-bb88-10a5be6d80e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:45.456352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3b868c9a-7a6a-4dca-bb88-10a5be6d80e6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082225 Aug 08 09:10:45.456913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1002/1908] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:45.914557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-42d90a38-3175-4071-b895-45ccdc72ea1b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:45.915172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-42d90a38-3175-4071-b895-45ccdc72ea1b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:45.921562 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42d90a38-3175-4071-b895-45ccdc72ea1b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:45.922053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42d90a38-3175-4071-b895-45ccdc72ea1b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:45.922488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42d90a38-3175-4071-b895-45ccdc72ea1b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:45.923177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42d90a38-3175-4071-b895-45ccdc72ea1b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:45.923633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42d90a38-3175-4071-b895-45ccdc72ea1b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:45.924067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-42d90a38-3175-4071-b895-45ccdc72ea1b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:46.054797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-42d90a38-3175-4071-b895-45ccdc72ea1b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:46.062662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-42d90a38-3175-4071-b895-45ccdc72ea1b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152756 Aug 08 09:10:46.063219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 907/1909] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:45 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:46.477205 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d88044c6-fc95-4fa9-82db-07477e8f88f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:46.477761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d88044c6-fc95-4fa9-82db-07477e8f88f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:46.484149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d88044c6-fc95-4fa9-82db-07477e8f88f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:46.484636 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d88044c6-fc95-4fa9-82db-07477e8f88f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:46.485076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d88044c6-fc95-4fa9-82db-07477e8f88f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:46.485791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d88044c6-fc95-4fa9-82db-07477e8f88f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:46.486247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d88044c6-fc95-4fa9-82db-07477e8f88f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:46.486674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d88044c6-fc95-4fa9-82db-07477e8f88f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:46.546854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d88044c6-fc95-4fa9-82db-07477e8f88f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:46.550216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:10:46.555592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d88044c6-fc95-4fa9-82db-07477e8f88f6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082361 Aug 08 09:10:46.556149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1003/1910] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:46 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:47.084532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6b989551-bc50-400d-8d55-8e1bbddb914e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:47.085395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6b989551-bc50-400d-8d55-8e1bbddb914e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:47.091913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b989551-bc50-400d-8d55-8e1bbddb914e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:47.092396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b989551-bc50-400d-8d55-8e1bbddb914e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:47.092834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b989551-bc50-400d-8d55-8e1bbddb914e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:47.093543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b989551-bc50-400d-8d55-8e1bbddb914e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:47.094002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b989551-bc50-400d-8d55-8e1bbddb914e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:47.094426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b989551-bc50-400d-8d55-8e1bbddb914e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:47.221531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6b989551-bc50-400d-8d55-8e1bbddb914e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:47.229561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6b989551-bc50-400d-8d55-8e1bbddb914e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149284 Aug 08 09:10:47.230115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 908/1911] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:47 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:47.576757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-97759c2d-7216-43e9-8bfd-4b3f7b2e9f1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:47.577402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-97759c2d-7216-43e9-8bfd-4b3f7b2e9f1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:47.584328 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97759c2d-7216-43e9-8bfd-4b3f7b2e9f1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:47.584825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97759c2d-7216-43e9-8bfd-4b3f7b2e9f1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:47.585367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97759c2d-7216-43e9-8bfd-4b3f7b2e9f1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:47.586071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97759c2d-7216-43e9-8bfd-4b3f7b2e9f1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:47.586532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97759c2d-7216-43e9-8bfd-4b3f7b2e9f1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:47.586964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97759c2d-7216-43e9-8bfd-4b3f7b2e9f1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:47.650871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-97759c2d-7216-43e9-8bfd-4b3f7b2e9f1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:47.658728 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-97759c2d-7216-43e9-8bfd-4b3f7b2e9f1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085845 Aug 08 09:10:47.659289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1004/1912] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:48.251143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9b48c0fc-9b13-46e5-abca-0a28b1b2896f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:48.251763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9b48c0fc-9b13-46e5-abca-0a28b1b2896f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:48.258484 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b48c0fc-9b13-46e5-abca-0a28b1b2896f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:48.259017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b48c0fc-9b13-46e5-abca-0a28b1b2896f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:48.259717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b48c0fc-9b13-46e5-abca-0a28b1b2896f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:48.260566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b48c0fc-9b13-46e5-abca-0a28b1b2896f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:48.261029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b48c0fc-9b13-46e5-abca-0a28b1b2896f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:48.261489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9b48c0fc-9b13-46e5-abca-0a28b1b2896f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:48.393433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9b48c0fc-9b13-46e5-abca-0a28b1b2896f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:48.402131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9b48c0fc-9b13-46e5-abca-0a28b1b2896f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.155154 Aug 08 09:10:48.402692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 909/1913] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:48 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:48.680360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a098a2eb-f9f2-41a9-87aa-5507d2a3703a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:48.680973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a098a2eb-f9f2-41a9-87aa-5507d2a3703a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:48.687601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a098a2eb-f9f2-41a9-87aa-5507d2a3703a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:48.688086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a098a2eb-f9f2-41a9-87aa-5507d2a3703a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:48.688685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a098a2eb-f9f2-41a9-87aa-5507d2a3703a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:48.689474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a098a2eb-f9f2-41a9-87aa-5507d2a3703a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:48.689934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a098a2eb-f9f2-41a9-87aa-5507d2a3703a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:48.690395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a098a2eb-f9f2-41a9-87aa-5507d2a3703a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:48.752159 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a098a2eb-f9f2-41a9-87aa-5507d2a3703a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:48.760966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a098a2eb-f9f2-41a9-87aa-5507d2a3703a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084975 Aug 08 09:10:48.764937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1005/1914] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:49.423136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f9e0e629-c0cf-4641-b87b-8e7d53cc6f44 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:49.423754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f9e0e629-c0cf-4641-b87b-8e7d53cc6f44 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:49.430857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9e0e629-c0cf-4641-b87b-8e7d53cc6f44 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:49.431346 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9e0e629-c0cf-4641-b87b-8e7d53cc6f44 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:49.431784 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9e0e629-c0cf-4641-b87b-8e7d53cc6f44 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:49.432475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9e0e629-c0cf-4641-b87b-8e7d53cc6f44 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:49.432934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9e0e629-c0cf-4641-b87b-8e7d53cc6f44 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:49.433399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f9e0e629-c0cf-4641-b87b-8e7d53cc6f44 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:49.567172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f9e0e629-c0cf-4641-b87b-8e7d53cc6f44 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:49.575605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f9e0e629-c0cf-4641-b87b-8e7d53cc6f44 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.156402 Aug 08 09:10:49.576171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 910/1915] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:49 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:49.781477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7b9166b2-c6cb-4aa9-9259-ab2eaf4bf750 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:49.782684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7b9166b2-c6cb-4aa9-9259-ab2eaf4bf750 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:49.790003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b9166b2-c6cb-4aa9-9259-ab2eaf4bf750 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:49.790486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b9166b2-c6cb-4aa9-9259-ab2eaf4bf750 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:49.790921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b9166b2-c6cb-4aa9-9259-ab2eaf4bf750 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:49.791633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b9166b2-c6cb-4aa9-9259-ab2eaf4bf750 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:49.792085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b9166b2-c6cb-4aa9-9259-ab2eaf4bf750 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:49.792510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7b9166b2-c6cb-4aa9-9259-ab2eaf4bf750 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:49.853539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7b9166b2-c6cb-4aa9-9259-ab2eaf4bf750 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:49.861363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7b9166b2-c6cb-4aa9-9259-ab2eaf4bf750 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083868 Aug 08 09:10:49.861914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1006/1916] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:50.597086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a3868a0c-387e-4964-8149-6de6ec3e2683 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:50.597682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a3868a0c-387e-4964-8149-6de6ec3e2683 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:50.604474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a3868a0c-387e-4964-8149-6de6ec3e2683 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:50.604952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a3868a0c-387e-4964-8149-6de6ec3e2683 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:50.605421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a3868a0c-387e-4964-8149-6de6ec3e2683 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:50.606113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a3868a0c-387e-4964-8149-6de6ec3e2683 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:50.606588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a3868a0c-387e-4964-8149-6de6ec3e2683 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:50.607031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a3868a0c-387e-4964-8149-6de6ec3e2683 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:50.735494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a3868a0c-387e-4964-8149-6de6ec3e2683 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:50.744877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a3868a0c-387e-4964-8149-6de6ec3e2683 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151649 Aug 08 09:10:50.745487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 911/1917] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:50 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:50.882525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c83fa5fa-ae02-4177-b911-456a34fb33b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:50.883145 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c83fa5fa-ae02-4177-b911-456a34fb33b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:50.889860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c83fa5fa-ae02-4177-b911-456a34fb33b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:50.890344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c83fa5fa-ae02-4177-b911-456a34fb33b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:50.890778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c83fa5fa-ae02-4177-b911-456a34fb33b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:50.891464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c83fa5fa-ae02-4177-b911-456a34fb33b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:50.891917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c83fa5fa-ae02-4177-b911-456a34fb33b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:50.892344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c83fa5fa-ae02-4177-b911-456a34fb33b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:50.956359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c83fa5fa-ae02-4177-b911-456a34fb33b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:50.965356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c83fa5fa-ae02-4177-b911-456a34fb33b4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086790 Aug 08 09:10:50.965927 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1007/1918] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:50 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:51.765972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7f776270-e431-4b0a-ac2a-406a12547767 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:51.766582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7f776270-e431-4b0a-ac2a-406a12547767 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:51.773020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f776270-e431-4b0a-ac2a-406a12547767 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:51.773576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f776270-e431-4b0a-ac2a-406a12547767 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:51.774013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f776270-e431-4b0a-ac2a-406a12547767 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:51.774705 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f776270-e431-4b0a-ac2a-406a12547767 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:51.775163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f776270-e431-4b0a-ac2a-406a12547767 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:51.775589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f776270-e431-4b0a-ac2a-406a12547767 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:51.902348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7f776270-e431-4b0a-ac2a-406a12547767 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:51.910169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7f776270-e431-4b0a-ac2a-406a12547767 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148047 Aug 08 09:10:51.910727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 912/1919] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:51 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:51.986491 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1ae070ca-4dd1-4b9f-9dd4-18b15eb10e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:51.987108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1ae070ca-4dd1-4b9f-9dd4-18b15eb10e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:51.993731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ae070ca-4dd1-4b9f-9dd4-18b15eb10e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:51.994253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ae070ca-4dd1-4b9f-9dd4-18b15eb10e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:51.994693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ae070ca-4dd1-4b9f-9dd4-18b15eb10e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:51.995447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ae070ca-4dd1-4b9f-9dd4-18b15eb10e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:51.995908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ae070ca-4dd1-4b9f-9dd4-18b15eb10e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:51.996340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1ae070ca-4dd1-4b9f-9dd4-18b15eb10e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:52.056693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1ae070ca-4dd1-4b9f-9dd4-18b15eb10e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:52.064642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1ae070ca-4dd1-4b9f-9dd4-18b15eb10e0d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082043 Aug 08 09:10:52.065227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1008/1920] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:51 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:52.932066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-565ab7b1-18e1-4fc2-b21c-edf8afcb51fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:52.932665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-565ab7b1-18e1-4fc2-b21c-edf8afcb51fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:52.939083 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-565ab7b1-18e1-4fc2-b21c-edf8afcb51fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:52.939563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-565ab7b1-18e1-4fc2-b21c-edf8afcb51fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:52.939997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-565ab7b1-18e1-4fc2-b21c-edf8afcb51fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:52.940687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-565ab7b1-18e1-4fc2-b21c-edf8afcb51fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:52.941163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-565ab7b1-18e1-4fc2-b21c-edf8afcb51fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:52.941589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-565ab7b1-18e1-4fc2-b21c-edf8afcb51fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:53.075591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-565ab7b1-18e1-4fc2-b21c-edf8afcb51fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:53.080239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-565ab7b1-18e1-4fc2-b21c-edf8afcb51fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152720 Aug 08 09:10:53.080801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 913/1921] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:52 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:53.085854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e2f55f3c-54ac-48ff-b48f-4c4a89644527 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:53.086470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e2f55f3c-54ac-48ff-b48f-4c4a89644527 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:53.092994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2f55f3c-54ac-48ff-b48f-4c4a89644527 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:53.093583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2f55f3c-54ac-48ff-b48f-4c4a89644527 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:53.094025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2f55f3c-54ac-48ff-b48f-4c4a89644527 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:53.094724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2f55f3c-54ac-48ff-b48f-4c4a89644527 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:53.095184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2f55f3c-54ac-48ff-b48f-4c4a89644527 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:53.095612 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e2f55f3c-54ac-48ff-b48f-4c4a89644527 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:53.156271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e2f55f3c-54ac-48ff-b48f-4c4a89644527 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:53.164824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e2f55f3c-54ac-48ff-b48f-4c4a89644527 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083089 Aug 08 09:10:53.165411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1009/1922] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:53 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:10:54.101081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fb9ecc75-7856-4a07-81cc-d0a86f83c9bc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:54.101677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fb9ecc75-7856-4a07-81cc-d0a86f83c9bc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:54.108067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb9ecc75-7856-4a07-81cc-d0a86f83c9bc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:54.108556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb9ecc75-7856-4a07-81cc-d0a86f83c9bc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:54.108995 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb9ecc75-7856-4a07-81cc-d0a86f83c9bc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:54.109722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb9ecc75-7856-4a07-81cc-d0a86f83c9bc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:54.110193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb9ecc75-7856-4a07-81cc-d0a86f83c9bc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:54.110625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fb9ecc75-7856-4a07-81cc-d0a86f83c9bc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:54.185379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-53f81d49-9ccc-4155-ad47-056c8ed8cfa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:54.185999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-53f81d49-9ccc-4155-ad47-056c8ed8cfa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:54.192497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f81d49-9ccc-4155-ad47-056c8ed8cfa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:54.192981 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f81d49-9ccc-4155-ad47-056c8ed8cfa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:54.193456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f81d49-9ccc-4155-ad47-056c8ed8cfa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:54.194144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f81d49-9ccc-4155-ad47-056c8ed8cfa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:54.195152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f81d49-9ccc-4155-ad47-056c8ed8cfa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:54.195577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53f81d49-9ccc-4155-ad47-056c8ed8cfa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:54.266662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fb9ecc75-7856-4a07-81cc-d0a86f83c9bc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:54.268271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-53f81d49-9ccc-4155-ad47-056c8ed8cfa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:54.275193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fb9ecc75-7856-4a07-81cc-d0a86f83c9bc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.178139 Aug 08 09:10:54.275765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 914/1923] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:54 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:54.276127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-53f81d49-9ccc-4155-ad47-056c8ed8cfa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.094562 Aug 08 09:10:54.276917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1010/1924] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:54 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:10:55.296111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ae3f6c31-a763-44ce-bca4-7041dc91e9d3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:55.296745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-81fd04bb-9432-4cf7-acbb-951c501a4aff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:55.297165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ae3f6c31-a763-44ce-bca4-7041dc91e9d3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:55.297288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-81fd04bb-9432-4cf7-acbb-951c501a4aff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:55.303004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-81fd04bb-9432-4cf7-acbb-951c501a4aff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:55.303157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae3f6c31-a763-44ce-bca4-7041dc91e9d3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:55.303487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-81fd04bb-9432-4cf7-acbb-951c501a4aff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:55.303755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae3f6c31-a763-44ce-bca4-7041dc91e9d3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:55.304010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-81fd04bb-9432-4cf7-acbb-951c501a4aff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:55.304187 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae3f6c31-a763-44ce-bca4-7041dc91e9d3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:55.304839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae3f6c31-a763-44ce-bca4-7041dc91e9d3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:55.304978 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-81fd04bb-9432-4cf7-acbb-951c501a4aff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:55.305337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-81fd04bb-9432-4cf7-acbb-951c501a4aff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:55.305465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae3f6c31-a763-44ce-bca4-7041dc91e9d3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:55.305770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-81fd04bb-9432-4cf7-acbb-951c501a4aff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:55.305880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae3f6c31-a763-44ce-bca4-7041dc91e9d3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:55.374353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-81fd04bb-9432-4cf7-acbb-951c501a4aff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:55.382831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-81fd04bb-9432-4cf7-acbb-951c501a4aff tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.090245 Aug 08 09:10:55.383444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1011/1925] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:10:55.459370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ae3f6c31-a763-44ce-bca4-7041dc91e9d3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:55.468060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ae3f6c31-a763-44ce-bca4-7041dc91e9d3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.175878 Aug 08 09:10:55.468628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 915/1926] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:55 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:56.404454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1a5081ed-b5ab-4579-87fd-a1256376e9bd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:56.405065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1a5081ed-b5ab-4579-87fd-a1256376e9bd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:56.411840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a5081ed-b5ab-4579-87fd-a1256376e9bd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:56.412330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a5081ed-b5ab-4579-87fd-a1256376e9bd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:56.412770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a5081ed-b5ab-4579-87fd-a1256376e9bd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:56.414058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a5081ed-b5ab-4579-87fd-a1256376e9bd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:56.414523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a5081ed-b5ab-4579-87fd-a1256376e9bd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:56.414953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1a5081ed-b5ab-4579-87fd-a1256376e9bd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:56.474589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1a5081ed-b5ab-4579-87fd-a1256376e9bd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:56.483024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1a5081ed-b5ab-4579-87fd-a1256376e9bd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082394 Aug 08 09:10:56.483586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1012/1927] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:56.489859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2c0359f5-0275-449d-be42-a6e99350d6a7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:56.490475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2c0359f5-0275-449d-be42-a6e99350d6a7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:56.496793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c0359f5-0275-449d-be42-a6e99350d6a7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:56.497317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c0359f5-0275-449d-be42-a6e99350d6a7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:56.497758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c0359f5-0275-449d-be42-a6e99350d6a7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:56.498443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c0359f5-0275-449d-be42-a6e99350d6a7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:56.498900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c0359f5-0275-449d-be42-a6e99350d6a7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:56.499324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c0359f5-0275-449d-be42-a6e99350d6a7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:56.627596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2c0359f5-0275-449d-be42-a6e99350d6a7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:56.636223 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2c0359f5-0275-449d-be42-a6e99350d6a7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150229 Aug 08 09:10:56.636781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 916/1928] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:56 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:57.504241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0c03481e-77ee-4f7a-bc82-15bd1608c6a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:57.504849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0c03481e-77ee-4f7a-bc82-15bd1608c6a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:57.511528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c03481e-77ee-4f7a-bc82-15bd1608c6a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:57.512005 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c03481e-77ee-4f7a-bc82-15bd1608c6a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:57.512437 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c03481e-77ee-4f7a-bc82-15bd1608c6a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:57.513115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c03481e-77ee-4f7a-bc82-15bd1608c6a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:57.513592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c03481e-77ee-4f7a-bc82-15bd1608c6a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:57.514012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0c03481e-77ee-4f7a-bc82-15bd1608c6a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:57.575120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0c03481e-77ee-4f7a-bc82-15bd1608c6a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:57.583012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0c03481e-77ee-4f7a-bc82-15bd1608c6a6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083239 Aug 08 09:10:57.583561 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1013/1929] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:57 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:57.657583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-de87db7a-4325-4e17-b559-8e92a95f2f45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:57.658218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-de87db7a-4325-4e17-b559-8e92a95f2f45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:57.665085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de87db7a-4325-4e17-b559-8e92a95f2f45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:57.665602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de87db7a-4325-4e17-b559-8e92a95f2f45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:57.666040 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de87db7a-4325-4e17-b559-8e92a95f2f45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:57.666737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de87db7a-4325-4e17-b559-8e92a95f2f45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:57.667196 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de87db7a-4325-4e17-b559-8e92a95f2f45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:57.667625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de87db7a-4325-4e17-b559-8e92a95f2f45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:57.671670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:10:57.795507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-de87db7a-4325-4e17-b559-8e92a95f2f45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:57.803425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-de87db7a-4325-4e17-b559-8e92a95f2f45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149704 Aug 08 09:10:57.804139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 917/1930] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:57 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:58.604124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ce3f108b-18d1-4ab4-b4e4-4f83d007e131 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:58.604683 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ce3f108b-18d1-4ab4-b4e4-4f83d007e131 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:58.611124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce3f108b-18d1-4ab4-b4e4-4f83d007e131 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:58.611601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce3f108b-18d1-4ab4-b4e4-4f83d007e131 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:58.612033 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce3f108b-18d1-4ab4-b4e4-4f83d007e131 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:58.612716 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce3f108b-18d1-4ab4-b4e4-4f83d007e131 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:58.613188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce3f108b-18d1-4ab4-b4e4-4f83d007e131 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:58.613621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce3f108b-18d1-4ab4-b4e4-4f83d007e131 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:58.676864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ce3f108b-18d1-4ab4-b4e4-4f83d007e131 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:58.685202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ce3f108b-18d1-4ab4-b4e4-4f83d007e131 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085309 Aug 08 09:10:58.685761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1014/1931] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:58.824778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b105caa2-acdb-468e-88db-3e03bbbe628e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:58.825420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b105caa2-acdb-468e-88db-3e03bbbe628e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:58.831785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b105caa2-acdb-468e-88db-3e03bbbe628e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:58.832266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b105caa2-acdb-468e-88db-3e03bbbe628e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:58.832703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b105caa2-acdb-468e-88db-3e03bbbe628e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:58.833417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b105caa2-acdb-468e-88db-3e03bbbe628e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:58.834146 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b105caa2-acdb-468e-88db-3e03bbbe628e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:58.834579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b105caa2-acdb-468e-88db-3e03bbbe628e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:58.965093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b105caa2-acdb-468e-88db-3e03bbbe628e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:58.972909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b105caa2-acdb-468e-88db-3e03bbbe628e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151959 Aug 08 09:10:58.973495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 918/1932] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:58 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:59.706258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1599593c-3afe-4fc2-bab5-bd5f6c675663 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:59.706817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1599593c-3afe-4fc2-bab5-bd5f6c675663 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:10:59.714012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1599593c-3afe-4fc2-bab5-bd5f6c675663 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:59.714487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1599593c-3afe-4fc2-bab5-bd5f6c675663 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:59.714922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1599593c-3afe-4fc2-bab5-bd5f6c675663 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:59.715603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1599593c-3afe-4fc2-bab5-bd5f6c675663 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:10:59.716054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1599593c-3afe-4fc2-bab5-bd5f6c675663 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:10:59.716474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1599593c-3afe-4fc2-bab5-bd5f6c675663 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:10:59.777077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1599593c-3afe-4fc2-bab5-bd5f6c675663 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:10:59.784921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1599593c-3afe-4fc2-bab5-bd5f6c675663 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082608 Aug 08 09:10:59.785816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1015/1933] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:10:59.994902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b6853b7a-0451-4261-8d4f-b926e0b53a47 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:10:59.995425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b6853b7a-0451-4261-8d4f-b926e0b53a47 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:00.001769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6853b7a-0451-4261-8d4f-b926e0b53a47 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:00.002255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6853b7a-0451-4261-8d4f-b926e0b53a47 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:00.002683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6853b7a-0451-4261-8d4f-b926e0b53a47 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:00.003369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6853b7a-0451-4261-8d4f-b926e0b53a47 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:00.003821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6853b7a-0451-4261-8d4f-b926e0b53a47 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:00.004238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6853b7a-0451-4261-8d4f-b926e0b53a47 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:00.135754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b6853b7a-0451-4261-8d4f-b926e0b53a47 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:00.143681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b6853b7a-0451-4261-8d4f-b926e0b53a47 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153213 Aug 08 09:11:00.144238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 919/1934] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:10:59 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:00.806142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b358a7f9-d009-4cd3-ba16-67d9c79df20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:00.806684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b358a7f9-d009-4cd3-ba16-67d9c79df20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:00.813210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b358a7f9-d009-4cd3-ba16-67d9c79df20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:00.813702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b358a7f9-d009-4cd3-ba16-67d9c79df20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:00.814179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b358a7f9-d009-4cd3-ba16-67d9c79df20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:00.814880 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b358a7f9-d009-4cd3-ba16-67d9c79df20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:00.815340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b358a7f9-d009-4cd3-ba16-67d9c79df20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:00.815770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b358a7f9-d009-4cd3-ba16-67d9c79df20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:00.876103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b358a7f9-d009-4cd3-ba16-67d9c79df20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:00.883979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b358a7f9-d009-4cd3-ba16-67d9c79df20b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082016 Aug 08 09:11:00.884533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1016/1935] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:00 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:01.165513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3af480b3-b269-469d-a2c8-75daf3db0903 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:01.166109 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3af480b3-b269-469d-a2c8-75daf3db0903 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:01.172496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3af480b3-b269-469d-a2c8-75daf3db0903 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:01.172973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3af480b3-b269-469d-a2c8-75daf3db0903 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:01.173441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3af480b3-b269-469d-a2c8-75daf3db0903 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:01.174126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3af480b3-b269-469d-a2c8-75daf3db0903 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:01.174580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3af480b3-b269-469d-a2c8-75daf3db0903 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:01.175002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3af480b3-b269-469d-a2c8-75daf3db0903 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:01.299551 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3af480b3-b269-469d-a2c8-75daf3db0903 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:01.308069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3af480b3-b269-469d-a2c8-75daf3db0903 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.147095 Aug 08 09:11:01.308640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 920/1936] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:01 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:01.906178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-582a25ea-9dc5-4516-9692-7d68cd4ea157 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:01.906788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-582a25ea-9dc5-4516-9692-7d68cd4ea157 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:01.913256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-582a25ea-9dc5-4516-9692-7d68cd4ea157 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:01.913780 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-582a25ea-9dc5-4516-9692-7d68cd4ea157 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:01.914218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-582a25ea-9dc5-4516-9692-7d68cd4ea157 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:01.914915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-582a25ea-9dc5-4516-9692-7d68cd4ea157 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:01.915365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-582a25ea-9dc5-4516-9692-7d68cd4ea157 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:01.915788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-582a25ea-9dc5-4516-9692-7d68cd4ea157 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:01.980377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-582a25ea-9dc5-4516-9692-7d68cd4ea157 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:01.988232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-582a25ea-9dc5-4516-9692-7d68cd4ea157 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085904 Aug 08 09:11:01.988790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1017/1937] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:01 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:02.327880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f8b474b6-cf62-4ed6-8fff-6b14b23d7f10 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:02.328492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f8b474b6-cf62-4ed6-8fff-6b14b23d7f10 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:02.336531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f8b474b6-cf62-4ed6-8fff-6b14b23d7f10 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:02.337013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f8b474b6-cf62-4ed6-8fff-6b14b23d7f10 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:02.337483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f8b474b6-cf62-4ed6-8fff-6b14b23d7f10 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:02.338233 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f8b474b6-cf62-4ed6-8fff-6b14b23d7f10 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:02.338689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f8b474b6-cf62-4ed6-8fff-6b14b23d7f10 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:02.339111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f8b474b6-cf62-4ed6-8fff-6b14b23d7f10 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:02.472075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f8b474b6-cf62-4ed6-8fff-6b14b23d7f10 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:02.480640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f8b474b6-cf62-4ed6-8fff-6b14b23d7f10 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.156630 Aug 08 09:11:02.481567 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 921/1938] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:02 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:03.009690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-92160503-2005-4ddf-998f-00a5df07fd77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:03.010295 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-92160503-2005-4ddf-998f-00a5df07fd77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:03.017011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92160503-2005-4ddf-998f-00a5df07fd77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:03.017527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92160503-2005-4ddf-998f-00a5df07fd77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:03.017964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92160503-2005-4ddf-998f-00a5df07fd77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:03.018657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92160503-2005-4ddf-998f-00a5df07fd77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:03.019111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92160503-2005-4ddf-998f-00a5df07fd77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:03.019536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-92160503-2005-4ddf-998f-00a5df07fd77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:03.080065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-92160503-2005-4ddf-998f-00a5df07fd77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:03.088345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-92160503-2005-4ddf-998f-00a5df07fd77 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083247 Aug 08 09:11:03.088909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1018/1939] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:03.501685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-61ba9aac-0131-44f6-b096-a3ffee438379 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:03.502301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-61ba9aac-0131-44f6-b096-a3ffee438379 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:03.509030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba9aac-0131-44f6-b096-a3ffee438379 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:03.509544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba9aac-0131-44f6-b096-a3ffee438379 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:03.510007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba9aac-0131-44f6-b096-a3ffee438379 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:03.510946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba9aac-0131-44f6-b096-a3ffee438379 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:03.511402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba9aac-0131-44f6-b096-a3ffee438379 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:03.511829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61ba9aac-0131-44f6-b096-a3ffee438379 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:03.641068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-61ba9aac-0131-44f6-b096-a3ffee438379 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:03.649169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-61ba9aac-0131-44f6-b096-a3ffee438379 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151316 Aug 08 09:11:03.649742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 922/1940] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:03 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:04.108453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-de508620-7230-490d-b4ba-c6cb51f696cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:04.109104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-de508620-7230-490d-b4ba-c6cb51f696cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:04.115480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de508620-7230-490d-b4ba-c6cb51f696cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:04.115970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de508620-7230-490d-b4ba-c6cb51f696cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:04.116410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de508620-7230-490d-b4ba-c6cb51f696cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:04.117105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de508620-7230-490d-b4ba-c6cb51f696cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:04.117589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de508620-7230-490d-b4ba-c6cb51f696cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:04.118025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de508620-7230-490d-b4ba-c6cb51f696cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:04.178427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-de508620-7230-490d-b4ba-c6cb51f696cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:04.186365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-de508620-7230-490d-b4ba-c6cb51f696cb tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081813 Aug 08 09:11:04.186935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1019/1941] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:04.669782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f5eaceac-021d-4570-9a05-d81383297813 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:04.670341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f5eaceac-021d-4570-9a05-d81383297813 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:04.676813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5eaceac-021d-4570-9a05-d81383297813 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:04.677335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5eaceac-021d-4570-9a05-d81383297813 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:04.677771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5eaceac-021d-4570-9a05-d81383297813 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:04.678986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5eaceac-021d-4570-9a05-d81383297813 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:04.679457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5eaceac-021d-4570-9a05-d81383297813 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:04.679897 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f5eaceac-021d-4570-9a05-d81383297813 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:04.818836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f5eaceac-021d-4570-9a05-d81383297813 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:04.827712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f5eaceac-021d-4570-9a05-d81383297813 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.161820 Aug 08 09:11:04.830333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 923/1942] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:04 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:05.207920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-594f807f-301f-473c-9c37-235050c8c1cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:05.208546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-594f807f-301f-473c-9c37-235050c8c1cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:05.215605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-594f807f-301f-473c-9c37-235050c8c1cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:05.216088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-594f807f-301f-473c-9c37-235050c8c1cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:05.216525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-594f807f-301f-473c-9c37-235050c8c1cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:05.217237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-594f807f-301f-473c-9c37-235050c8c1cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:05.217691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-594f807f-301f-473c-9c37-235050c8c1cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:05.218121 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-594f807f-301f-473c-9c37-235050c8c1cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:05.236587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:11:05.282572 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-594f807f-301f-473c-9c37-235050c8c1cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:05.290903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-594f807f-301f-473c-9c37-235050c8c1cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086947 Aug 08 09:11:05.291465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1020/1943] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:05 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:05.847783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3e6ca43e-1246-4e11-b70d-f5b87f68da83 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:05.848438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3e6ca43e-1246-4e11-b70d-f5b87f68da83 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:05.855164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e6ca43e-1246-4e11-b70d-f5b87f68da83 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:05.855679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e6ca43e-1246-4e11-b70d-f5b87f68da83 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:05.856121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e6ca43e-1246-4e11-b70d-f5b87f68da83 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:05.856812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e6ca43e-1246-4e11-b70d-f5b87f68da83 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:05.857299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e6ca43e-1246-4e11-b70d-f5b87f68da83 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:05.857729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e6ca43e-1246-4e11-b70d-f5b87f68da83 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:05.987224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3e6ca43e-1246-4e11-b70d-f5b87f68da83 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:05.995090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3e6ca43e-1246-4e11-b70d-f5b87f68da83 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151185 Aug 08 09:11:05.995651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 924/1944] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:05 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:06.311546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-42a8b9c1-8368-49f3-95fb-0bcb71b9652b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:06.312194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-42a8b9c1-8368-49f3-95fb-0bcb71b9652b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:06.318087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42a8b9c1-8368-49f3-95fb-0bcb71b9652b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:06.318569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42a8b9c1-8368-49f3-95fb-0bcb71b9652b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:06.319699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42a8b9c1-8368-49f3-95fb-0bcb71b9652b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:06.320409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42a8b9c1-8368-49f3-95fb-0bcb71b9652b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:06.320866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42a8b9c1-8368-49f3-95fb-0bcb71b9652b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:06.321340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42a8b9c1-8368-49f3-95fb-0bcb71b9652b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:06.380242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-42a8b9c1-8368-49f3-95fb-0bcb71b9652b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:06.388960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-42a8b9c1-8368-49f3-95fb-0bcb71b9652b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081430 Aug 08 09:11:06.389549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1021/1945] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:06 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:07.015469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d819a46e-36d4-4a84-9d18-dffca80174ea tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:07.016063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d819a46e-36d4-4a84-9d18-dffca80174ea tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:07.022892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d819a46e-36d4-4a84-9d18-dffca80174ea tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:07.023372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d819a46e-36d4-4a84-9d18-dffca80174ea tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:07.023810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d819a46e-36d4-4a84-9d18-dffca80174ea tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:07.024509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d819a46e-36d4-4a84-9d18-dffca80174ea tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:07.024967 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d819a46e-36d4-4a84-9d18-dffca80174ea tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:07.025441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d819a46e-36d4-4a84-9d18-dffca80174ea tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:07.156164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d819a46e-36d4-4a84-9d18-dffca80174ea tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:07.164656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d819a46e-36d4-4a84-9d18-dffca80174ea tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153076 Aug 08 09:11:07.165300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 925/1946] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:07 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:07.409936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1139a4e6-5d73-4178-aad1-210a215cf224 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:07.410531 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1139a4e6-5d73-4178-aad1-210a215cf224 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:07.418012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1139a4e6-5d73-4178-aad1-210a215cf224 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:07.418364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1139a4e6-5d73-4178-aad1-210a215cf224 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:07.419081 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1139a4e6-5d73-4178-aad1-210a215cf224 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:07.419778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1139a4e6-5d73-4178-aad1-210a215cf224 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:07.420224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1139a4e6-5d73-4178-aad1-210a215cf224 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:07.420643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1139a4e6-5d73-4178-aad1-210a215cf224 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:07.482074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1139a4e6-5d73-4178-aad1-210a215cf224 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:07.490197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1139a4e6-5d73-4178-aad1-210a215cf224 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084186 Aug 08 09:11:07.490787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1022/1947] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:07 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:08.185774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-75ff2722-7110-4d5f-94a0-bb666ecd19b9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:08.186387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-75ff2722-7110-4d5f-94a0-bb666ecd19b9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:08.188700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=52 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:11:08.193353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75ff2722-7110-4d5f-94a0-bb666ecd19b9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:08.201980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75ff2722-7110-4d5f-94a0-bb666ecd19b9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:08.201980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75ff2722-7110-4d5f-94a0-bb666ecd19b9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:08.201980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75ff2722-7110-4d5f-94a0-bb666ecd19b9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:08.201980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75ff2722-7110-4d5f-94a0-bb666ecd19b9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:08.202448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75ff2722-7110-4d5f-94a0-bb666ecd19b9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:08.324771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-75ff2722-7110-4d5f-94a0-bb666ecd19b9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:08.332645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-75ff2722-7110-4d5f-94a0-bb666ecd19b9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150836 Aug 08 09:11:08.333223 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 926/1948] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:08 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:08.511661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3d4ac7df-d36e-4ab2-9a42-4366faaf5678 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:08.512269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3d4ac7df-d36e-4ab2-9a42-4366faaf5678 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:08.518563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d4ac7df-d36e-4ab2-9a42-4366faaf5678 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:08.519046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d4ac7df-d36e-4ab2-9a42-4366faaf5678 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:08.519484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d4ac7df-d36e-4ab2-9a42-4366faaf5678 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:08.520175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d4ac7df-d36e-4ab2-9a42-4366faaf5678 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:08.520638 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d4ac7df-d36e-4ab2-9a42-4366faaf5678 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:08.521066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d4ac7df-d36e-4ab2-9a42-4366faaf5678 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:08.584306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3d4ac7df-d36e-4ab2-9a42-4366faaf5678 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:08.592187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3d4ac7df-d36e-4ab2-9a42-4366faaf5678 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085286 Aug 08 09:11:08.592749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1023/1949] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:08 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:09.353594 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6be2d321-7f07-4cdd-b349-89cb81f633d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:09.354207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6be2d321-7f07-4cdd-b349-89cb81f633d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:09.360482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6be2d321-7f07-4cdd-b349-89cb81f633d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:09.360968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6be2d321-7f07-4cdd-b349-89cb81f633d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:09.361434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6be2d321-7f07-4cdd-b349-89cb81f633d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:09.362126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6be2d321-7f07-4cdd-b349-89cb81f633d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:09.362582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6be2d321-7f07-4cdd-b349-89cb81f633d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:09.363007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6be2d321-7f07-4cdd-b349-89cb81f633d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:09.570402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6be2d321-7f07-4cdd-b349-89cb81f633d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:09.578356 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6be2d321-7f07-4cdd-b349-89cb81f633d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.228800 Aug 08 09:11:09.579164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 927/1950] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:09 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:09.613644 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bab8ca94-0606-4776-a76c-c7a272868f17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:09.614312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bab8ca94-0606-4776-a76c-c7a272868f17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:09.616723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=56 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:11:09.621409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bab8ca94-0606-4776-a76c-c7a272868f17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:09.621895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bab8ca94-0606-4776-a76c-c7a272868f17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:09.622335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bab8ca94-0606-4776-a76c-c7a272868f17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:09.623030 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bab8ca94-0606-4776-a76c-c7a272868f17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:09.623488 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bab8ca94-0606-4776-a76c-c7a272868f17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:09.623913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bab8ca94-0606-4776-a76c-c7a272868f17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:09.686356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bab8ca94-0606-4776-a76c-c7a272868f17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:09.695184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bab8ca94-0606-4776-a76c-c7a272868f17 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084620 Aug 08 09:11:09.695785 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1024/1951] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:10.599884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b77629e2-28cf-4824-9c6a-0de4aab7c2ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:10.604691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b77629e2-28cf-4824-9c6a-0de4aab7c2ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:10.607618 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b77629e2-28cf-4824-9c6a-0de4aab7c2ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:10.608105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b77629e2-28cf-4824-9c6a-0de4aab7c2ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:10.608542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b77629e2-28cf-4824-9c6a-0de4aab7c2ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:10.609280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b77629e2-28cf-4824-9c6a-0de4aab7c2ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:10.609739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b77629e2-28cf-4824-9c6a-0de4aab7c2ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:10.610165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b77629e2-28cf-4824-9c6a-0de4aab7c2ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:10.716657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-89edba04-0d65-446a-a138-394bed50430d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:10.717309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-89edba04-0d65-446a-a138-394bed50430d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:10.723933 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89edba04-0d65-446a-a138-394bed50430d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:10.724423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89edba04-0d65-446a-a138-394bed50430d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:10.724895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89edba04-0d65-446a-a138-394bed50430d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:10.726662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89edba04-0d65-446a-a138-394bed50430d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:10.727123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89edba04-0d65-446a-a138-394bed50430d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:10.727552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89edba04-0d65-446a-a138-394bed50430d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:10.738417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b77629e2-28cf-4824-9c6a-0de4aab7c2ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:10.747172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b77629e2-28cf-4824-9c6a-0de4aab7c2ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151192 Aug 08 09:11:10.747731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 928/1952] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:10 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:10.791705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-89edba04-0d65-446a-a138-394bed50430d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:10.799658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-89edba04-0d65-446a-a138-394bed50430d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086880 Aug 08 09:11:10.800223 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1025/1953] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:10 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:11:11.767953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3e192ab0-9b15-423c-a0e0-9b51757d7acd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:11.768502 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3e192ab0-9b15-423c-a0e0-9b51757d7acd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:11.775602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e192ab0-9b15-423c-a0e0-9b51757d7acd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:11.776079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e192ab0-9b15-423c-a0e0-9b51757d7acd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:11.776512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e192ab0-9b15-423c-a0e0-9b51757d7acd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:11.777225 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e192ab0-9b15-423c-a0e0-9b51757d7acd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:11.777683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e192ab0-9b15-423c-a0e0-9b51757d7acd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:11.778106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e192ab0-9b15-423c-a0e0-9b51757d7acd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:11.820952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e13193ae-b413-45e3-a545-aa0d9016d9ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:11.821589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e13193ae-b413-45e3-a545-aa0d9016d9ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:11.828023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e13193ae-b413-45e3-a545-aa0d9016d9ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:11.828487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e13193ae-b413-45e3-a545-aa0d9016d9ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:11.828918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e13193ae-b413-45e3-a545-aa0d9016d9ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:11.829634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e13193ae-b413-45e3-a545-aa0d9016d9ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:11.830088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e13193ae-b413-45e3-a545-aa0d9016d9ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:11.830513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e13193ae-b413-45e3-a545-aa0d9016d9ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:11.902681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e13193ae-b413-45e3-a545-aa0d9016d9ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:11.910445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e13193ae-b413-45e3-a545-aa0d9016d9ca tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.093817 Aug 08 09:11:11.911001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1026/1954] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:11 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:11:11.932217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3e192ab0-9b15-423c-a0e0-9b51757d7acd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:11.940057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3e192ab0-9b15-423c-a0e0-9b51757d7acd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.176056 Aug 08 09:11:11.940612 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 929/1955] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:11 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:12.931730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c25a2a03-574a-4071-9f96-e231cbbe5b4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:12.932322 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c25a2a03-574a-4071-9f96-e231cbbe5b4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:12.938722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25a2a03-574a-4071-9f96-e231cbbe5b4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:12.939198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25a2a03-574a-4071-9f96-e231cbbe5b4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:12.939631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25a2a03-574a-4071-9f96-e231cbbe5b4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:12.940321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25a2a03-574a-4071-9f96-e231cbbe5b4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:12.940778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25a2a03-574a-4071-9f96-e231cbbe5b4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:12.941226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25a2a03-574a-4071-9f96-e231cbbe5b4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:12.961556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-18642a33-0125-4b5c-9483-d06ec2b14f08 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:12.962179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-18642a33-0125-4b5c-9483-d06ec2b14f08 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:12.968544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18642a33-0125-4b5c-9483-d06ec2b14f08 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:12.969032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18642a33-0125-4b5c-9483-d06ec2b14f08 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:12.969507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18642a33-0125-4b5c-9483-d06ec2b14f08 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:12.970212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18642a33-0125-4b5c-9483-d06ec2b14f08 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:12.970682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18642a33-0125-4b5c-9483-d06ec2b14f08 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:12.971118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-18642a33-0125-4b5c-9483-d06ec2b14f08 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:13.002088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c25a2a03-574a-4071-9f96-e231cbbe5b4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:13.010910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c25a2a03-574a-4071-9f96-e231cbbe5b4b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083530 Aug 08 09:11:13.011731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1027/1956] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:12 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:13.103143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-18642a33-0125-4b5c-9483-d06ec2b14f08 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:13.111085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-18642a33-0125-4b5c-9483-d06ec2b14f08 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153644 Aug 08 09:11:13.111647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 930/1957] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:12 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:11:14.032680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b01905de-6a39-4f9c-a8ca-3e9e850ae6c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:14.033442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b01905de-6a39-4f9c-a8ca-3e9e850ae6c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:14.040132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b01905de-6a39-4f9c-a8ca-3e9e850ae6c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:14.040617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b01905de-6a39-4f9c-a8ca-3e9e850ae6c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:14.041092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b01905de-6a39-4f9c-a8ca-3e9e850ae6c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:14.041841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b01905de-6a39-4f9c-a8ca-3e9e850ae6c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:14.042302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b01905de-6a39-4f9c-a8ca-3e9e850ae6c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:14.042735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b01905de-6a39-4f9c-a8ca-3e9e850ae6c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:14.103655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b01905de-6a39-4f9c-a8ca-3e9e850ae6c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:14.111664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b01905de-6a39-4f9c-a8ca-3e9e850ae6c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082931 Aug 08 09:11:14.112224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1028/1958] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:14.132450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-62e64664-9545-4914-a14b-d7563ddc6882 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:14.133247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-62e64664-9545-4914-a14b-d7563ddc6882 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:14.139841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62e64664-9545-4914-a14b-d7563ddc6882 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:14.140332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62e64664-9545-4914-a14b-d7563ddc6882 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:14.140775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62e64664-9545-4914-a14b-d7563ddc6882 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:14.141512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62e64664-9545-4914-a14b-d7563ddc6882 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:14.141977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62e64664-9545-4914-a14b-d7563ddc6882 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:14.142413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62e64664-9545-4914-a14b-d7563ddc6882 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:14.273618 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-62e64664-9545-4914-a14b-d7563ddc6882 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:14.281496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-62e64664-9545-4914-a14b-d7563ddc6882 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153629 Aug 08 09:11:14.282079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 931/1959] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:14 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:15.131764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0a325671-8237-4dfe-9243-6a9eb48af799 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:15.132374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0a325671-8237-4dfe-9243-6a9eb48af799 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:15.139194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a325671-8237-4dfe-9243-6a9eb48af799 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:15.139701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a325671-8237-4dfe-9243-6a9eb48af799 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:15.140138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a325671-8237-4dfe-9243-6a9eb48af799 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:15.140830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a325671-8237-4dfe-9243-6a9eb48af799 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:15.141319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a325671-8237-4dfe-9243-6a9eb48af799 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:15.141751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0a325671-8237-4dfe-9243-6a9eb48af799 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:15.205315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0a325671-8237-4dfe-9243-6a9eb48af799 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:15.213787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0a325671-8237-4dfe-9243-6a9eb48af799 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085897 Aug 08 09:11:15.214354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1029/1960] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:15 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:15.301704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-aaf2a3d3-493b-4615-80cf-b6634ba3b59a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:15.302314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-aaf2a3d3-493b-4615-80cf-b6634ba3b59a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:15.308820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aaf2a3d3-493b-4615-80cf-b6634ba3b59a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:15.309345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aaf2a3d3-493b-4615-80cf-b6634ba3b59a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:15.309779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aaf2a3d3-493b-4615-80cf-b6634ba3b59a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:15.310462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aaf2a3d3-493b-4615-80cf-b6634ba3b59a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:15.310912 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aaf2a3d3-493b-4615-80cf-b6634ba3b59a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:15.311336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aaf2a3d3-493b-4615-80cf-b6634ba3b59a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:15.438524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-aaf2a3d3-493b-4615-80cf-b6634ba3b59a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:15.446884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-aaf2a3d3-493b-4615-80cf-b6634ba3b59a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149015 Aug 08 09:11:15.447448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 932/1961] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:15 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:16.235558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bec2eb02-82cb-402a-87f9-aa5f7c586568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:16.236173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bec2eb02-82cb-402a-87f9-aa5f7c586568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:16.242673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bec2eb02-82cb-402a-87f9-aa5f7c586568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:16.243156 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bec2eb02-82cb-402a-87f9-aa5f7c586568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:16.243594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bec2eb02-82cb-402a-87f9-aa5f7c586568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:16.244285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bec2eb02-82cb-402a-87f9-aa5f7c586568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:16.244741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bec2eb02-82cb-402a-87f9-aa5f7c586568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:16.245187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bec2eb02-82cb-402a-87f9-aa5f7c586568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:16.306548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bec2eb02-82cb-402a-87f9-aa5f7c586568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:16.314327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bec2eb02-82cb-402a-87f9-aa5f7c586568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082685 Aug 08 09:11:16.314886 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1030/1962] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:16.468154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e9262f3e-51da-4e45-8195-dd3bdc802776 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:16.468714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e9262f3e-51da-4e45-8195-dd3bdc802776 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:16.475128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9262f3e-51da-4e45-8195-dd3bdc802776 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:16.475882 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9262f3e-51da-4e45-8195-dd3bdc802776 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:16.476326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9262f3e-51da-4e45-8195-dd3bdc802776 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:16.477019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9262f3e-51da-4e45-8195-dd3bdc802776 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:16.477505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9262f3e-51da-4e45-8195-dd3bdc802776 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:16.477933 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e9262f3e-51da-4e45-8195-dd3bdc802776 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:16.606439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e9262f3e-51da-4e45-8195-dd3bdc802776 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:16.609822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:11:16.614546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e9262f3e-51da-4e45-8195-dd3bdc802776 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150382 Aug 08 09:11:16.625338 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 933/1963] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:16 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:17.334988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8e7fad47-1897-43dd-a2d5-7d808c299390 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:17.335752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8e7fad47-1897-43dd-a2d5-7d808c299390 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:17.342091 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e7fad47-1897-43dd-a2d5-7d808c299390 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:17.342580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e7fad47-1897-43dd-a2d5-7d808c299390 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:17.343024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e7fad47-1897-43dd-a2d5-7d808c299390 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:17.343720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e7fad47-1897-43dd-a2d5-7d808c299390 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:17.344180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e7fad47-1897-43dd-a2d5-7d808c299390 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:17.344632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8e7fad47-1897-43dd-a2d5-7d808c299390 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:17.405855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8e7fad47-1897-43dd-a2d5-7d808c299390 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:17.414196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8e7fad47-1897-43dd-a2d5-7d808c299390 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083006 Aug 08 09:11:17.420674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1031/1964] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:17 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:17.645209 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1b317941-b593-4e38-b45d-91a516d8ec70 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:17.645827 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1b317941-b593-4e38-b45d-91a516d8ec70 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:17.652961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b317941-b593-4e38-b45d-91a516d8ec70 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:17.653496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b317941-b593-4e38-b45d-91a516d8ec70 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:17.653935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b317941-b593-4e38-b45d-91a516d8ec70 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:17.654625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b317941-b593-4e38-b45d-91a516d8ec70 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:17.655081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b317941-b593-4e38-b45d-91a516d8ec70 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:17.655506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b317941-b593-4e38-b45d-91a516d8ec70 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:17.784033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1b317941-b593-4e38-b45d-91a516d8ec70 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:17.791886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1b317941-b593-4e38-b45d-91a516d8ec70 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150568 Aug 08 09:11:17.792440 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 934/1965] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:17 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:18.435666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fe376a99-0a97-4d22-a318-bd620d0c96c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:18.436299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fe376a99-0a97-4d22-a318-bd620d0c96c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:18.442633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe376a99-0a97-4d22-a318-bd620d0c96c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:18.443112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe376a99-0a97-4d22-a318-bd620d0c96c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:18.443546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe376a99-0a97-4d22-a318-bd620d0c96c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:18.444258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe376a99-0a97-4d22-a318-bd620d0c96c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:18.444792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe376a99-0a97-4d22-a318-bd620d0c96c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:18.445242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe376a99-0a97-4d22-a318-bd620d0c96c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:18.507648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fe376a99-0a97-4d22-a318-bd620d0c96c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:18.515848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fe376a99-0a97-4d22-a318-bd620d0c96c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084011 Aug 08 09:11:18.516412 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1032/1966] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:18 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:18.812091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9a40cf58-81a5-45d2-b101-41d6fad64474 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:18.812633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9a40cf58-81a5-45d2-b101-41d6fad64474 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:18.819321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a40cf58-81a5-45d2-b101-41d6fad64474 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:18.819829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a40cf58-81a5-45d2-b101-41d6fad64474 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:18.820269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a40cf58-81a5-45d2-b101-41d6fad64474 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:18.820961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a40cf58-81a5-45d2-b101-41d6fad64474 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:18.821446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a40cf58-81a5-45d2-b101-41d6fad64474 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:18.821873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a40cf58-81a5-45d2-b101-41d6fad64474 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:18.950538 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9a40cf58-81a5-45d2-b101-41d6fad64474 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:18.958714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9a40cf58-81a5-45d2-b101-41d6fad64474 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150578 Aug 08 09:11:18.959278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 935/1967] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:18 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:19.535803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-69085d04-1125-4bc9-ac12-408bea60b17a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:19.536430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-69085d04-1125-4bc9-ac12-408bea60b17a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:19.542964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69085d04-1125-4bc9-ac12-408bea60b17a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:19.543444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69085d04-1125-4bc9-ac12-408bea60b17a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:19.543878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69085d04-1125-4bc9-ac12-408bea60b17a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:19.544556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69085d04-1125-4bc9-ac12-408bea60b17a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:19.545006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69085d04-1125-4bc9-ac12-408bea60b17a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:19.545462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69085d04-1125-4bc9-ac12-408bea60b17a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:19.606631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-69085d04-1125-4bc9-ac12-408bea60b17a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:19.614444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-69085d04-1125-4bc9-ac12-408bea60b17a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082562 Aug 08 09:11:19.614994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1033/1968] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:19.979869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cfa912e6-8ff9-4ae3-8185-4ff31090239b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:19.980485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cfa912e6-8ff9-4ae3-8185-4ff31090239b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:19.986879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cfa912e6-8ff9-4ae3-8185-4ff31090239b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:19.987364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cfa912e6-8ff9-4ae3-8185-4ff31090239b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:19.987802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cfa912e6-8ff9-4ae3-8185-4ff31090239b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:19.988550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cfa912e6-8ff9-4ae3-8185-4ff31090239b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:19.989010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cfa912e6-8ff9-4ae3-8185-4ff31090239b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:19.989468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cfa912e6-8ff9-4ae3-8185-4ff31090239b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:20.120174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cfa912e6-8ff9-4ae3-8185-4ff31090239b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:20.128176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cfa912e6-8ff9-4ae3-8185-4ff31090239b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152935 Aug 08 09:11:20.128741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 936/1969] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:19 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:20.635991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f690944e-685d-428d-9d78-c37622142f97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:20.636874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f690944e-685d-428d-9d78-c37622142f97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:20.643266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f690944e-685d-428d-9d78-c37622142f97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:20.643752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f690944e-685d-428d-9d78-c37622142f97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:20.644195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f690944e-685d-428d-9d78-c37622142f97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:20.644887 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f690944e-685d-428d-9d78-c37622142f97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:20.645377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f690944e-685d-428d-9d78-c37622142f97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:20.645808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f690944e-685d-428d-9d78-c37622142f97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:20.706245 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f690944e-685d-428d-9d78-c37622142f97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:20.714813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f690944e-685d-428d-9d78-c37622142f97 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083134 Aug 08 09:11:20.715373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1034/1970] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:20 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:21.149967 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d704de68-695b-49e4-9183-49885bf232d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:21.150582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d704de68-695b-49e4-9183-49885bf232d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:21.156874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d704de68-695b-49e4-9183-49885bf232d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:21.157393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d704de68-695b-49e4-9183-49885bf232d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:21.157827 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d704de68-695b-49e4-9183-49885bf232d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:21.158518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d704de68-695b-49e4-9183-49885bf232d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:21.158967 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d704de68-695b-49e4-9183-49885bf232d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:21.159390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d704de68-695b-49e4-9183-49885bf232d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:21.289858 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d704de68-695b-49e4-9183-49885bf232d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:21.297667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d704de68-695b-49e4-9183-49885bf232d9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152320 Aug 08 09:11:21.298259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 937/1971] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:21 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:21.735573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-75172562-d1b7-46d4-bba2-4bf61a7f5c01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:21.736122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-75172562-d1b7-46d4-bba2-4bf61a7f5c01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:21.743090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75172562-d1b7-46d4-bba2-4bf61a7f5c01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:21.743575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75172562-d1b7-46d4-bba2-4bf61a7f5c01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:21.744013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75172562-d1b7-46d4-bba2-4bf61a7f5c01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:21.744700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75172562-d1b7-46d4-bba2-4bf61a7f5c01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:21.745177 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75172562-d1b7-46d4-bba2-4bf61a7f5c01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:21.745620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-75172562-d1b7-46d4-bba2-4bf61a7f5c01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:21.809522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-75172562-d1b7-46d4-bba2-4bf61a7f5c01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:21.817663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-75172562-d1b7-46d4-bba2-4bf61a7f5c01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085999 Aug 08 09:11:21.818379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1035/1972] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:21 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:22.319232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6e7878c7-f958-4ff0-9c09-a649b37ae89c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:22.319856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6e7878c7-f958-4ff0-9c09-a649b37ae89c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:22.326451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e7878c7-f958-4ff0-9c09-a649b37ae89c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:22.326942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e7878c7-f958-4ff0-9c09-a649b37ae89c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:22.327389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e7878c7-f958-4ff0-9c09-a649b37ae89c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:22.328089 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e7878c7-f958-4ff0-9c09-a649b37ae89c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:22.328549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e7878c7-f958-4ff0-9c09-a649b37ae89c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:22.328981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e7878c7-f958-4ff0-9c09-a649b37ae89c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:22.456668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6e7878c7-f958-4ff0-9c09-a649b37ae89c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:22.465131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6e7878c7-f958-4ff0-9c09-a649b37ae89c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149891 Aug 08 09:11:22.465715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 938/1973] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:22 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:22.838255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4fcb6588-0f0b-4202-8758-76954610ef82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:22.838858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4fcb6588-0f0b-4202-8758-76954610ef82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:22.845190 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4fcb6588-0f0b-4202-8758-76954610ef82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:22.845671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4fcb6588-0f0b-4202-8758-76954610ef82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:22.846101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4fcb6588-0f0b-4202-8758-76954610ef82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:22.846784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4fcb6588-0f0b-4202-8758-76954610ef82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:22.847235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4fcb6588-0f0b-4202-8758-76954610ef82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:22.847660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4fcb6588-0f0b-4202-8758-76954610ef82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:22.909189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4fcb6588-0f0b-4202-8758-76954610ef82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:22.917653 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4fcb6588-0f0b-4202-8758-76954610ef82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083200 Aug 08 09:11:22.918209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1036/1974] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:23.486196 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b7342ecd-8acf-4bce-b149-75dec97ab43e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:23.486814 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b7342ecd-8acf-4bce-b149-75dec97ab43e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:23.494821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7342ecd-8acf-4bce-b149-75dec97ab43e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:23.495315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7342ecd-8acf-4bce-b149-75dec97ab43e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:23.495755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7342ecd-8acf-4bce-b149-75dec97ab43e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:23.496456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7342ecd-8acf-4bce-b149-75dec97ab43e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:23.496915 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7342ecd-8acf-4bce-b149-75dec97ab43e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:23.497737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b7342ecd-8acf-4bce-b149-75dec97ab43e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:23.636590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b7342ecd-8acf-4bce-b149-75dec97ab43e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:23.645751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b7342ecd-8acf-4bce-b149-75dec97ab43e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.164170 Aug 08 09:11:23.646329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 939/1975] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:23 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:23.939454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-38baef86-235b-4ce6-8ef6-7507869f1315 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:23.940023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-38baef86-235b-4ce6-8ef6-7507869f1315 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:23.946403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38baef86-235b-4ce6-8ef6-7507869f1315 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:23.946879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38baef86-235b-4ce6-8ef6-7507869f1315 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:23.947312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38baef86-235b-4ce6-8ef6-7507869f1315 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:23.947993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38baef86-235b-4ce6-8ef6-7507869f1315 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:23.948444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38baef86-235b-4ce6-8ef6-7507869f1315 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:23.948868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-38baef86-235b-4ce6-8ef6-7507869f1315 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:23.953120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:11:24.011580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-38baef86-235b-4ce6-8ef6-7507869f1315 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:24.019513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-38baef86-235b-4ce6-8ef6-7507869f1315 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084074 Aug 08 09:11:24.020064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1037/1976] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:24.667852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7a6ad7d5-40c6-47cc-a3e4-c4dd1b98dfa8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:24.668567 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7a6ad7d5-40c6-47cc-a3e4-c4dd1b98dfa8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:24.674975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7a6ad7d5-40c6-47cc-a3e4-c4dd1b98dfa8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:24.675465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7a6ad7d5-40c6-47cc-a3e4-c4dd1b98dfa8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:24.675897 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7a6ad7d5-40c6-47cc-a3e4-c4dd1b98dfa8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:24.676582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7a6ad7d5-40c6-47cc-a3e4-c4dd1b98dfa8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:24.677036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7a6ad7d5-40c6-47cc-a3e4-c4dd1b98dfa8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:24.677486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7a6ad7d5-40c6-47cc-a3e4-c4dd1b98dfa8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:24.803327 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7a6ad7d5-40c6-47cc-a3e4-c4dd1b98dfa8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:24.811823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7a6ad7d5-40c6-47cc-a3e4-c4dd1b98dfa8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.147800 Aug 08 09:11:24.812394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 940/1977] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:24 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:25.040815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-77b65ede-972b-4017-8873-db6a613baa7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:25.041415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-77b65ede-972b-4017-8873-db6a613baa7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:25.048175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b65ede-972b-4017-8873-db6a613baa7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:25.048664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b65ede-972b-4017-8873-db6a613baa7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:25.049107 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b65ede-972b-4017-8873-db6a613baa7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:25.049830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b65ede-972b-4017-8873-db6a613baa7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:25.050290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b65ede-972b-4017-8873-db6a613baa7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:25.050726 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b65ede-972b-4017-8873-db6a613baa7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:25.115448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-77b65ede-972b-4017-8873-db6a613baa7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:25.124125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-77b65ede-972b-4017-8873-db6a613baa7f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087744 Aug 08 09:11:25.124680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1038/1978] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:25.833480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e864a282-adf0-4c67-8726-ae2079c51b74 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:25.834148 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e864a282-adf0-4c67-8726-ae2079c51b74 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:25.841195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e864a282-adf0-4c67-8726-ae2079c51b74 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:25.841692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e864a282-adf0-4c67-8726-ae2079c51b74 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:25.842136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e864a282-adf0-4c67-8726-ae2079c51b74 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:25.842834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e864a282-adf0-4c67-8726-ae2079c51b74 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:25.843296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e864a282-adf0-4c67-8726-ae2079c51b74 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:25.843728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e864a282-adf0-4c67-8726-ae2079c51b74 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:25.972742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e864a282-adf0-4c67-8726-ae2079c51b74 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:25.980797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e864a282-adf0-4c67-8726-ae2079c51b74 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151301 Aug 08 09:11:25.981390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 941/1979] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:25 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:26.144817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6660152f-6531-45fb-a728-0aa892d31048 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:26.145461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6660152f-6531-45fb-a728-0aa892d31048 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:26.152568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6660152f-6531-45fb-a728-0aa892d31048 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:26.153045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6660152f-6531-45fb-a728-0aa892d31048 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:26.153515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6660152f-6531-45fb-a728-0aa892d31048 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:26.154197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6660152f-6531-45fb-a728-0aa892d31048 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:26.154644 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6660152f-6531-45fb-a728-0aa892d31048 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:26.155062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6660152f-6531-45fb-a728-0aa892d31048 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:26.216577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6660152f-6531-45fb-a728-0aa892d31048 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:26.224559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6660152f-6531-45fb-a728-0aa892d31048 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083542 Aug 08 09:11:26.225116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1039/1980] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:27.001750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-494f8e30-aba8-48ed-9405-fa85d873bc5b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:27.002390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-494f8e30-aba8-48ed-9405-fa85d873bc5b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:27.008871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-494f8e30-aba8-48ed-9405-fa85d873bc5b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:27.009389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-494f8e30-aba8-48ed-9405-fa85d873bc5b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:27.009834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-494f8e30-aba8-48ed-9405-fa85d873bc5b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:27.010528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-494f8e30-aba8-48ed-9405-fa85d873bc5b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:27.010986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-494f8e30-aba8-48ed-9405-fa85d873bc5b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:27.011672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-494f8e30-aba8-48ed-9405-fa85d873bc5b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:27.141085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-494f8e30-aba8-48ed-9405-fa85d873bc5b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:27.149934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-494f8e30-aba8-48ed-9405-fa85d873bc5b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152101 Aug 08 09:11:27.150500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 942/1981] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:26 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:27.244494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ccb72267-793e-4de2-8d83-bc6313bb00cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:27.245116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ccb72267-793e-4de2-8d83-bc6313bb00cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:27.251503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccb72267-793e-4de2-8d83-bc6313bb00cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:27.252043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccb72267-793e-4de2-8d83-bc6313bb00cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:27.252434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccb72267-793e-4de2-8d83-bc6313bb00cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:27.253127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccb72267-793e-4de2-8d83-bc6313bb00cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:27.253610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccb72267-793e-4de2-8d83-bc6313bb00cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:27.254040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccb72267-793e-4de2-8d83-bc6313bb00cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:27.314826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ccb72267-793e-4de2-8d83-bc6313bb00cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:27.323487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ccb72267-793e-4de2-8d83-bc6313bb00cd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082897 Aug 08 09:11:27.324063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1040/1982] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:27 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:28.171675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-075a7005-38c9-41e2-aa76-085ef96492af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:28.172291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-075a7005-38c9-41e2-aa76-085ef96492af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:28.179441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-075a7005-38c9-41e2-aa76-085ef96492af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:28.180568 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-075a7005-38c9-41e2-aa76-085ef96492af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:28.181080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-075a7005-38c9-41e2-aa76-085ef96492af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:28.181812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-075a7005-38c9-41e2-aa76-085ef96492af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:28.182307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-075a7005-38c9-41e2-aa76-085ef96492af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:28.182639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-075a7005-38c9-41e2-aa76-085ef96492af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:28.313126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-075a7005-38c9-41e2-aa76-085ef96492af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:28.321158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-075a7005-38c9-41e2-aa76-085ef96492af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153357 Aug 08 09:11:28.321744 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 943/1983] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:28 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:28.344454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ba1b38c6-3cb0-41da-8a5d-92cf020b729b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:28.345248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ba1b38c6-3cb0-41da-8a5d-92cf020b729b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:28.352163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba1b38c6-3cb0-41da-8a5d-92cf020b729b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:28.352640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba1b38c6-3cb0-41da-8a5d-92cf020b729b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:28.353075 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba1b38c6-3cb0-41da-8a5d-92cf020b729b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:28.353778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba1b38c6-3cb0-41da-8a5d-92cf020b729b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:28.354230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba1b38c6-3cb0-41da-8a5d-92cf020b729b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:28.354650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ba1b38c6-3cb0-41da-8a5d-92cf020b729b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:28.418502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ba1b38c6-3cb0-41da-8a5d-92cf020b729b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:28.426500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ba1b38c6-3cb0-41da-8a5d-92cf020b729b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085722 Aug 08 09:11:28.427006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1041/1984] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:28 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:29.342149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-13fc8c9c-4de8-4e8b-b1e8-a747ef82b221 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:29.342776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-13fc8c9c-4de8-4e8b-b1e8-a747ef82b221 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:29.349346 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-13fc8c9c-4de8-4e8b-b1e8-a747ef82b221 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:29.349838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-13fc8c9c-4de8-4e8b-b1e8-a747ef82b221 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:29.350282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-13fc8c9c-4de8-4e8b-b1e8-a747ef82b221 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:29.351552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-13fc8c9c-4de8-4e8b-b1e8-a747ef82b221 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:29.352012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-13fc8c9c-4de8-4e8b-b1e8-a747ef82b221 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:29.352446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-13fc8c9c-4de8-4e8b-b1e8-a747ef82b221 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:29.447519 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ac779539-a1bb-4c0b-ab6a-2afda8fd0d32 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:29.448203 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ac779539-a1bb-4c0b-ab6a-2afda8fd0d32 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:29.454551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac779539-a1bb-4c0b-ab6a-2afda8fd0d32 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:29.455035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac779539-a1bb-4c0b-ab6a-2afda8fd0d32 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:29.455475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac779539-a1bb-4c0b-ab6a-2afda8fd0d32 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:29.456168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac779539-a1bb-4c0b-ab6a-2afda8fd0d32 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:29.456626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac779539-a1bb-4c0b-ab6a-2afda8fd0d32 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:29.457051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ac779539-a1bb-4c0b-ab6a-2afda8fd0d32 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:29.482649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-13fc8c9c-4de8-4e8b-b1e8-a747ef82b221 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:29.491058 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-13fc8c9c-4de8-4e8b-b1e8-a747ef82b221 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152767 Aug 08 09:11:29.491628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 944/1985] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:29 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:29.520115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ac779539-a1bb-4c0b-ab6a-2afda8fd0d32 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:29.528841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ac779539-a1bb-4c0b-ab6a-2afda8fd0d32 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085221 Aug 08 09:11:29.529445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1042/1986] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:29 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:11:30.512193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-48dd6873-fc88-4537-995b-6243f8d3dae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:30.512826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-48dd6873-fc88-4537-995b-6243f8d3dae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:30.519234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48dd6873-fc88-4537-995b-6243f8d3dae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:30.519713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48dd6873-fc88-4537-995b-6243f8d3dae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:30.520153 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48dd6873-fc88-4537-995b-6243f8d3dae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:30.520826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48dd6873-fc88-4537-995b-6243f8d3dae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:30.521302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48dd6873-fc88-4537-995b-6243f8d3dae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:30.521725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48dd6873-fc88-4537-995b-6243f8d3dae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:30.550355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b466f485-238b-4c45-8d0d-ec8fefca1bf3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:30.550997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b466f485-238b-4c45-8d0d-ec8fefca1bf3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:30.558031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b466f485-238b-4c45-8d0d-ec8fefca1bf3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:30.558509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b466f485-238b-4c45-8d0d-ec8fefca1bf3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:30.558946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b466f485-238b-4c45-8d0d-ec8fefca1bf3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:30.559638 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b466f485-238b-4c45-8d0d-ec8fefca1bf3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:30.560087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b466f485-238b-4c45-8d0d-ec8fefca1bf3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:30.560507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b466f485-238b-4c45-8d0d-ec8fefca1bf3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:30.638772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b466f485-238b-4c45-8d0d-ec8fefca1bf3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:30.646864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b466f485-238b-4c45-8d0d-ec8fefca1bf3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.100240 Aug 08 09:11:30.647574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1043/1987] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:30 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:11:30.675202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-48dd6873-fc88-4537-995b-6243f8d3dae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:30.683754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-48dd6873-fc88-4537-995b-6243f8d3dae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.175715 Aug 08 09:11:30.684318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 945/1988] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:30 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:31.668079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f5386460-3459-42ad-a416-d6d39c9e5fc9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:31.668603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f5386460-3459-42ad-a416-d6d39c9e5fc9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:31.674946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5386460-3459-42ad-a416-d6d39c9e5fc9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:31.675424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5386460-3459-42ad-a416-d6d39c9e5fc9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:31.675855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5386460-3459-42ad-a416-d6d39c9e5fc9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:31.676536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5386460-3459-42ad-a416-d6d39c9e5fc9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:31.676986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5386460-3459-42ad-a416-d6d39c9e5fc9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:31.677431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f5386460-3459-42ad-a416-d6d39c9e5fc9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:31.704543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-27cfde29-96a3-493b-ae1f-44f6ae75ba46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:31.705178 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-27cfde29-96a3-493b-ae1f-44f6ae75ba46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:31.712032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27cfde29-96a3-493b-ae1f-44f6ae75ba46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:31.712524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27cfde29-96a3-493b-ae1f-44f6ae75ba46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:31.712969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27cfde29-96a3-493b-ae1f-44f6ae75ba46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:31.713715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27cfde29-96a3-493b-ae1f-44f6ae75ba46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:31.714181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27cfde29-96a3-493b-ae1f-44f6ae75ba46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:31.714611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27cfde29-96a3-493b-ae1f-44f6ae75ba46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:31.738904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f5386460-3459-42ad-a416-d6d39c9e5fc9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:31.747391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f5386460-3459-42ad-a416-d6d39c9e5fc9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083386 Aug 08 09:11:31.747955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1044/1989] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:31 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:31.845076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-27cfde29-96a3-493b-ae1f-44f6ae75ba46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:31.853563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-27cfde29-96a3-493b-ae1f-44f6ae75ba46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152882 Aug 08 09:11:31.854128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 946/1990] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:31 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:11:32.768110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3b364d0a-2e25-4dc3-9df1-164ff9dfa352 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:32.768688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3b364d0a-2e25-4dc3-9df1-164ff9dfa352 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:32.775666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b364d0a-2e25-4dc3-9df1-164ff9dfa352 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:32.776144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b364d0a-2e25-4dc3-9df1-164ff9dfa352 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:32.776576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b364d0a-2e25-4dc3-9df1-164ff9dfa352 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:32.777283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b364d0a-2e25-4dc3-9df1-164ff9dfa352 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:32.777828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b364d0a-2e25-4dc3-9df1-164ff9dfa352 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:32.778317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b364d0a-2e25-4dc3-9df1-164ff9dfa352 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:32.838477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3b364d0a-2e25-4dc3-9df1-164ff9dfa352 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:32.846221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3b364d0a-2e25-4dc3-9df1-164ff9dfa352 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082047 Aug 08 09:11:32.847151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1045/1991] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:32.874732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e22fe39a-1771-471a-a5f4-c90d6cd7da59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:32.875349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e22fe39a-1771-471a-a5f4-c90d6cd7da59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:32.882209 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e22fe39a-1771-471a-a5f4-c90d6cd7da59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:32.882697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e22fe39a-1771-471a-a5f4-c90d6cd7da59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:32.883139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e22fe39a-1771-471a-a5f4-c90d6cd7da59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:32.883836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e22fe39a-1771-471a-a5f4-c90d6cd7da59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:32.884298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e22fe39a-1771-471a-a5f4-c90d6cd7da59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:32.884737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e22fe39a-1771-471a-a5f4-c90d6cd7da59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:33.018864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e22fe39a-1771-471a-a5f4-c90d6cd7da59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:33.026983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e22fe39a-1771-471a-a5f4-c90d6cd7da59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.156094 Aug 08 09:11:33.027570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 947/1992] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:32 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:33.867385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d81364db-ffff-4b19-aae6-da364c86ac98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:33.867999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d81364db-ffff-4b19-aae6-da364c86ac98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:33.874336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d81364db-ffff-4b19-aae6-da364c86ac98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:33.874813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d81364db-ffff-4b19-aae6-da364c86ac98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:33.875271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d81364db-ffff-4b19-aae6-da364c86ac98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:33.875958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d81364db-ffff-4b19-aae6-da364c86ac98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:33.876406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d81364db-ffff-4b19-aae6-da364c86ac98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:33.876827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d81364db-ffff-4b19-aae6-da364c86ac98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:33.940831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d81364db-ffff-4b19-aae6-da364c86ac98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:33.948799 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d81364db-ffff-4b19-aae6-da364c86ac98 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085536 Aug 08 09:11:33.949400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1046/1993] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:33 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:34.047767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-72f89ef7-9d5f-47e5-a82b-e540d325fdba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:34.048417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-72f89ef7-9d5f-47e5-a82b-e540d325fdba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:34.055054 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72f89ef7-9d5f-47e5-a82b-e540d325fdba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:34.055545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72f89ef7-9d5f-47e5-a82b-e540d325fdba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:34.055986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72f89ef7-9d5f-47e5-a82b-e540d325fdba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:34.056687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72f89ef7-9d5f-47e5-a82b-e540d325fdba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:34.057167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72f89ef7-9d5f-47e5-a82b-e540d325fdba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:34.057604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-72f89ef7-9d5f-47e5-a82b-e540d325fdba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:34.185867 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-72f89ef7-9d5f-47e5-a82b-e540d325fdba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:34.195050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-72f89ef7-9d5f-47e5-a82b-e540d325fdba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151055 Aug 08 09:11:34.195617 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 948/1994] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:34 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:34.969952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9b508109-3f41-4ee6-be57-cd2d291222c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:34.970560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9b508109-3f41-4ee6-be57-cd2d291222c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:34.977545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b508109-3f41-4ee6-be57-cd2d291222c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:34.978023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b508109-3f41-4ee6-be57-cd2d291222c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:34.978456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b508109-3f41-4ee6-be57-cd2d291222c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:34.979137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b508109-3f41-4ee6-be57-cd2d291222c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:34.979586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b508109-3f41-4ee6-be57-cd2d291222c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:34.980006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b508109-3f41-4ee6-be57-cd2d291222c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:35.039988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9b508109-3f41-4ee6-be57-cd2d291222c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:35.047846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9b508109-3f41-4ee6-be57-cd2d291222c3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081768 Aug 08 09:11:35.048406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1047/1995] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:35.216284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6230ce15-bb77-4484-b065-592d83bdef00 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:35.216905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6230ce15-bb77-4484-b065-592d83bdef00 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:35.223387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6230ce15-bb77-4484-b065-592d83bdef00 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:35.223820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6230ce15-bb77-4484-b065-592d83bdef00 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:35.224260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6230ce15-bb77-4484-b065-592d83bdef00 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:35.224950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6230ce15-bb77-4484-b065-592d83bdef00 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:35.226145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6230ce15-bb77-4484-b065-592d83bdef00 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:35.226595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6230ce15-bb77-4484-b065-592d83bdef00 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:35.606412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6230ce15-bb77-4484-b065-592d83bdef00 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:35.614237 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6230ce15-bb77-4484-b065-592d83bdef00 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.402063 Aug 08 09:11:35.614792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 949/1996] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:35 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:36.068705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f3f053b4-3ad2-4969-a9cd-e2684f87da76 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:36.069550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f3f053b4-3ad2-4969-a9cd-e2684f87da76 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:36.075632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3f053b4-3ad2-4969-a9cd-e2684f87da76 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:36.076116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3f053b4-3ad2-4969-a9cd-e2684f87da76 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:36.076557 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3f053b4-3ad2-4969-a9cd-e2684f87da76 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:36.077269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3f053b4-3ad2-4969-a9cd-e2684f87da76 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:36.077730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3f053b4-3ad2-4969-a9cd-e2684f87da76 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:36.078157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3f053b4-3ad2-4969-a9cd-e2684f87da76 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:36.137782 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f3f053b4-3ad2-4969-a9cd-e2684f87da76 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:36.145752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f3f053b4-3ad2-4969-a9cd-e2684f87da76 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.080898 Aug 08 09:11:36.146317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1048/1997] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:36.635550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-065a6c4e-9f3d-43c2-980e-484091c7e77e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:36.636167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-065a6c4e-9f3d-43c2-980e-484091c7e77e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:36.642649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-065a6c4e-9f3d-43c2-980e-484091c7e77e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:36.643168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-065a6c4e-9f3d-43c2-980e-484091c7e77e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:36.643610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-065a6c4e-9f3d-43c2-980e-484091c7e77e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:36.644299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-065a6c4e-9f3d-43c2-980e-484091c7e77e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:36.644758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-065a6c4e-9f3d-43c2-980e-484091c7e77e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:36.645213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-065a6c4e-9f3d-43c2-980e-484091c7e77e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:36.663632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:11:36.774332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-065a6c4e-9f3d-43c2-980e-484091c7e77e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:36.782197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-065a6c4e-9f3d-43c2-980e-484091c7e77e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150574 Aug 08 09:11:36.782747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 950/1998] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:36 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:37.166813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fb23f88c-2803-4ef3-a19d-383dcf6079f3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:37.167431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fb23f88c-2803-4ef3-a19d-383dcf6079f3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:37.173865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb23f88c-2803-4ef3-a19d-383dcf6079f3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:37.174348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb23f88c-2803-4ef3-a19d-383dcf6079f3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:37.174791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb23f88c-2803-4ef3-a19d-383dcf6079f3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:37.175480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb23f88c-2803-4ef3-a19d-383dcf6079f3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:37.175933 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb23f88c-2803-4ef3-a19d-383dcf6079f3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:37.176359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fb23f88c-2803-4ef3-a19d-383dcf6079f3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:37.240486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fb23f88c-2803-4ef3-a19d-383dcf6079f3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:37.248709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fb23f88c-2803-4ef3-a19d-383dcf6079f3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085822 Aug 08 09:11:37.249297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1049/1999] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:37 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:37.804160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6c75a9a8-9a78-48da-b25d-c4f80aedca33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:37.804705 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6c75a9a8-9a78-48da-b25d-c4f80aedca33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:37.811026 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c75a9a8-9a78-48da-b25d-c4f80aedca33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:37.811511 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c75a9a8-9a78-48da-b25d-c4f80aedca33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:37.811946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c75a9a8-9a78-48da-b25d-c4f80aedca33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:37.812628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c75a9a8-9a78-48da-b25d-c4f80aedca33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:37.813080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c75a9a8-9a78-48da-b25d-c4f80aedca33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:37.813533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6c75a9a8-9a78-48da-b25d-c4f80aedca33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:37.941399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6c75a9a8-9a78-48da-b25d-c4f80aedca33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:37.949371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6c75a9a8-9a78-48da-b25d-c4f80aedca33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149693 Aug 08 09:11:37.949941 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 951/2000] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:37 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:38.270503 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-77431be3-70f7-4505-a4cf-f03407b934d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:38.271115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-77431be3-70f7-4505-a4cf-f03407b934d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:38.278240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77431be3-70f7-4505-a4cf-f03407b934d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:38.279900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77431be3-70f7-4505-a4cf-f03407b934d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:38.279900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77431be3-70f7-4505-a4cf-f03407b934d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:38.279900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77431be3-70f7-4505-a4cf-f03407b934d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:38.280324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77431be3-70f7-4505-a4cf-f03407b934d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:38.280748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77431be3-70f7-4505-a4cf-f03407b934d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:38.341774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-77431be3-70f7-4505-a4cf-f03407b934d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:38.349506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-77431be3-70f7-4505-a4cf-f03407b934d4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082942 Aug 08 09:11:38.350072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1050/2001] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:38 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:38.787874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:11:38.788154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:11:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:11:38.970277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-84c69100-c3e0-48cd-b93d-1cfc0905be97 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:38.971010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-84c69100-c3e0-48cd-b93d-1cfc0905be97 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:38.973227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=52 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:11:38.977906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-84c69100-c3e0-48cd-b93d-1cfc0905be97 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:38.978394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-84c69100-c3e0-48cd-b93d-1cfc0905be97 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:38.978831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-84c69100-c3e0-48cd-b93d-1cfc0905be97 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:38.979524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-84c69100-c3e0-48cd-b93d-1cfc0905be97 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:38.979981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-84c69100-c3e0-48cd-b93d-1cfc0905be97 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:38.980406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-84c69100-c3e0-48cd-b93d-1cfc0905be97 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:39.109427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-84c69100-c3e0-48cd-b93d-1cfc0905be97 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:39.117914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-84c69100-c3e0-48cd-b93d-1cfc0905be97 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151448 Aug 08 09:11:39.118467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 952/2002] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:38 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:39.371336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-382149a3-0ff3-4061-b99a-d00d2a924636 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:39.371949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-382149a3-0ff3-4061-b99a-d00d2a924636 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:39.378312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382149a3-0ff3-4061-b99a-d00d2a924636 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:39.378789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382149a3-0ff3-4061-b99a-d00d2a924636 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:39.379224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382149a3-0ff3-4061-b99a-d00d2a924636 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:39.379900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382149a3-0ff3-4061-b99a-d00d2a924636 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:39.380354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382149a3-0ff3-4061-b99a-d00d2a924636 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:39.380775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-382149a3-0ff3-4061-b99a-d00d2a924636 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:39.441223 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-382149a3-0ff3-4061-b99a-d00d2a924636 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:39.449322 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-382149a3-0ff3-4061-b99a-d00d2a924636 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081779 Aug 08 09:11:39.449875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1051/2003] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:39 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:11:40.138747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fe0f0f5f-d43c-4916-9426-8729beeba91a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:40.139387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fe0f0f5f-d43c-4916-9426-8729beeba91a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:40.145743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe0f0f5f-d43c-4916-9426-8729beeba91a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:40.146225 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe0f0f5f-d43c-4916-9426-8729beeba91a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:40.146658 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe0f0f5f-d43c-4916-9426-8729beeba91a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:40.147983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe0f0f5f-d43c-4916-9426-8729beeba91a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:40.148547 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe0f0f5f-d43c-4916-9426-8729beeba91a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:40.148976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe0f0f5f-d43c-4916-9426-8729beeba91a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:40.274733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fe0f0f5f-d43c-4916-9426-8729beeba91a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:40.282739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fe0f0f5f-d43c-4916-9426-8729beeba91a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148106 Aug 08 09:11:40.283300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 953/2004] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:40 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:40.470101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-443af3b0-dfa0-45f0-86ba-ddf082d7c1b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:40.470720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-443af3b0-dfa0-45f0-86ba-ddf082d7c1b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:40.473044 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=56 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:11:40.478557 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-443af3b0-dfa0-45f0-86ba-ddf082d7c1b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:40.479040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-443af3b0-dfa0-45f0-86ba-ddf082d7c1b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:40.479486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-443af3b0-dfa0-45f0-86ba-ddf082d7c1b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:40.480172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-443af3b0-dfa0-45f0-86ba-ddf082d7c1b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:40.480632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-443af3b0-dfa0-45f0-86ba-ddf082d7c1b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:40.481060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-443af3b0-dfa0-45f0-86ba-ddf082d7c1b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:40.546026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-443af3b0-dfa0-45f0-86ba-ddf082d7c1b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:40.554331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-443af3b0-dfa0-45f0-86ba-ddf082d7c1b2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.088032 Aug 08 09:11:40.554887 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1052/2005] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:40 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:41.304771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-78917512-5255-4b89-81a3-2a56802da45d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:41.305406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-78917512-5255-4b89-81a3-2a56802da45d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:41.312043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78917512-5255-4b89-81a3-2a56802da45d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:41.312540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78917512-5255-4b89-81a3-2a56802da45d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:41.312983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78917512-5255-4b89-81a3-2a56802da45d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:41.313726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78917512-5255-4b89-81a3-2a56802da45d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:41.314193 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78917512-5255-4b89-81a3-2a56802da45d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:41.314628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78917512-5255-4b89-81a3-2a56802da45d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:41.444515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-78917512-5255-4b89-81a3-2a56802da45d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:41.452425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-78917512-5255-4b89-81a3-2a56802da45d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152201 Aug 08 09:11:41.452991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 954/2006] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:41 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:41.575861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1b5311c4-bfca-4a51-98d8-066664e8fdd4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:41.576424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1b5311c4-bfca-4a51-98d8-066664e8fdd4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:41.582770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b5311c4-bfca-4a51-98d8-066664e8fdd4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:41.583256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b5311c4-bfca-4a51-98d8-066664e8fdd4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:41.583699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b5311c4-bfca-4a51-98d8-066664e8fdd4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:41.584384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b5311c4-bfca-4a51-98d8-066664e8fdd4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:41.585732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b5311c4-bfca-4a51-98d8-066664e8fdd4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:41.586235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b5311c4-bfca-4a51-98d8-066664e8fdd4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:41.645770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1b5311c4-bfca-4a51-98d8-066664e8fdd4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:41.649756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:11:41.654422 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1b5311c4-bfca-4a51-98d8-066664e8fdd4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082517 Aug 08 09:11:41.654984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1053/2007] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:41 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:42.474154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-80811766-9582-468d-b848-6971f5dc3859 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:42.474771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-80811766-9582-468d-b848-6971f5dc3859 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:42.486646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80811766-9582-468d-b848-6971f5dc3859 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:42.486646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80811766-9582-468d-b848-6971f5dc3859 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:42.486646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80811766-9582-468d-b848-6971f5dc3859 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:42.486646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80811766-9582-468d-b848-6971f5dc3859 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:42.487183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80811766-9582-468d-b848-6971f5dc3859 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:42.487183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-80811766-9582-468d-b848-6971f5dc3859 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:42.614509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-80811766-9582-468d-b848-6971f5dc3859 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:42.623168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-80811766-9582-468d-b848-6971f5dc3859 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153689 Aug 08 09:11:42.623725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 955/2008] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:42 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:42.674843 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b031fd4c-bfe5-4f41-8423-2edb1acfcfec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:42.675488 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b031fd4c-bfe5-4f41-8423-2edb1acfcfec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:42.682985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b031fd4c-bfe5-4f41-8423-2edb1acfcfec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:42.683466 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b031fd4c-bfe5-4f41-8423-2edb1acfcfec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:42.683901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b031fd4c-bfe5-4f41-8423-2edb1acfcfec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:42.684586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b031fd4c-bfe5-4f41-8423-2edb1acfcfec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:42.685042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b031fd4c-bfe5-4f41-8423-2edb1acfcfec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:42.685500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b031fd4c-bfe5-4f41-8423-2edb1acfcfec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:42.745104 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b031fd4c-bfe5-4f41-8423-2edb1acfcfec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:42.752923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b031fd4c-bfe5-4f41-8423-2edb1acfcfec tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081963 Aug 08 09:11:42.753518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1054/2009] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:42 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:43.644028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-017e5c85-5286-4bc4-8749-3e6e0cd04be7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:43.644626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-017e5c85-5286-4bc4-8749-3e6e0cd04be7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:43.651616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-017e5c85-5286-4bc4-8749-3e6e0cd04be7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:43.652097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-017e5c85-5286-4bc4-8749-3e6e0cd04be7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:43.652525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-017e5c85-5286-4bc4-8749-3e6e0cd04be7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:43.653267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-017e5c85-5286-4bc4-8749-3e6e0cd04be7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:43.653721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-017e5c85-5286-4bc4-8749-3e6e0cd04be7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:43.654145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-017e5c85-5286-4bc4-8749-3e6e0cd04be7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:43.774672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-71d85d52-58c9-4e13-90c3-2a208e10f268 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:43.775323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-71d85d52-58c9-4e13-90c3-2a208e10f268 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:43.780747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-017e5c85-5286-4bc4-8749-3e6e0cd04be7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:43.781784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71d85d52-58c9-4e13-90c3-2a208e10f268 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:43.782271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71d85d52-58c9-4e13-90c3-2a208e10f268 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:43.782916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71d85d52-58c9-4e13-90c3-2a208e10f268 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:43.783630 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71d85d52-58c9-4e13-90c3-2a208e10f268 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:43.784088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71d85d52-58c9-4e13-90c3-2a208e10f268 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:43.784517 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71d85d52-58c9-4e13-90c3-2a208e10f268 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:43.789724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-017e5c85-5286-4bc4-8749-3e6e0cd04be7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149618 Aug 08 09:11:43.790326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 956/2010] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:43 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:43.848422 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-71d85d52-58c9-4e13-90c3-2a208e10f268 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:43.856437 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-71d85d52-58c9-4e13-90c3-2a208e10f268 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086249 Aug 08 09:11:43.857001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1055/2011] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:11:44.810439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fe300a6d-b887-4f6b-9cd5-952d994537f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:44.811792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fe300a6d-b887-4f6b-9cd5-952d994537f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:44.818524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe300a6d-b887-4f6b-9cd5-952d994537f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:44.819176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe300a6d-b887-4f6b-9cd5-952d994537f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:44.819682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe300a6d-b887-4f6b-9cd5-952d994537f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:44.820375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe300a6d-b887-4f6b-9cd5-952d994537f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:44.820829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe300a6d-b887-4f6b-9cd5-952d994537f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:44.821299 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fe300a6d-b887-4f6b-9cd5-952d994537f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:44.877249 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f52e73d3-c863-4391-8926-826697277377 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:44.877969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f52e73d3-c863-4391-8926-826697277377 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:44.884729 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f52e73d3-c863-4391-8926-826697277377 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:44.885262 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f52e73d3-c863-4391-8926-826697277377 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:44.885702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f52e73d3-c863-4391-8926-826697277377 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:44.886395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f52e73d3-c863-4391-8926-826697277377 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:44.886850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f52e73d3-c863-4391-8926-826697277377 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:44.887533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f52e73d3-c863-4391-8926-826697277377 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:44.958689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f52e73d3-c863-4391-8926-826697277377 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:44.967388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f52e73d3-c863-4391-8926-826697277377 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.093945 Aug 08 09:11:44.967957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1056/2012] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:11:44.976116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fe300a6d-b887-4f6b-9cd5-952d994537f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:44.984086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fe300a6d-b887-4f6b-9cd5-952d994537f2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.177450 Aug 08 09:11:44.984652 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 957/2013] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:44 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:45.989303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bb8a5ef7-5dae-43b5-9636-d84fd3723ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:45.989917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bb8a5ef7-5dae-43b5-9636-d84fd3723ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:45.996905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb8a5ef7-5dae-43b5-9636-d84fd3723ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:45.997464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb8a5ef7-5dae-43b5-9636-d84fd3723ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:45.997904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb8a5ef7-5dae-43b5-9636-d84fd3723ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:45.998592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb8a5ef7-5dae-43b5-9636-d84fd3723ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:45.999047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb8a5ef7-5dae-43b5-9636-d84fd3723ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:45.999477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb8a5ef7-5dae-43b5-9636-d84fd3723ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:46.003716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b1e45234-1571-45c5-96ec-beb44b90e810 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:46.004336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b1e45234-1571-45c5-96ec-beb44b90e810 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:46.012892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1e45234-1571-45c5-96ec-beb44b90e810 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:46.013436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1e45234-1571-45c5-96ec-beb44b90e810 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:46.013890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1e45234-1571-45c5-96ec-beb44b90e810 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:46.014625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1e45234-1571-45c5-96ec-beb44b90e810 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:46.015162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1e45234-1571-45c5-96ec-beb44b90e810 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:46.015607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1e45234-1571-45c5-96ec-beb44b90e810 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:46.063764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bb8a5ef7-5dae-43b5-9636-d84fd3723ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:46.072672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bb8a5ef7-5dae-43b5-9636-d84fd3723ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087177 Aug 08 09:11:46.073277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1057/2014] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:46.162427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b1e45234-1571-45c5-96ec-beb44b90e810 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:46.170791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b1e45234-1571-45c5-96ec-beb44b90e810 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.170969 Aug 08 09:11:46.171353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 958/2015] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:45 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:47.094226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-860000f8-243a-49bf-ab70-c9e4419951f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:47.094843 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-860000f8-243a-49bf-ab70-c9e4419951f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:47.101446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-860000f8-243a-49bf-ab70-c9e4419951f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:47.101935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-860000f8-243a-49bf-ab70-c9e4419951f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:47.102377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-860000f8-243a-49bf-ab70-c9e4419951f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:47.103067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-860000f8-243a-49bf-ab70-c9e4419951f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:47.103536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-860000f8-243a-49bf-ab70-c9e4419951f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:47.103964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-860000f8-243a-49bf-ab70-c9e4419951f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:47.164452 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-860000f8-243a-49bf-ab70-c9e4419951f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:47.172254 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-860000f8-243a-49bf-ab70-c9e4419951f8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081890 Aug 08 09:11:47.172812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1058/2016] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:47.191602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e95ea01e-e27f-4546-ae6e-d64791f9022f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:47.192216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e95ea01e-e27f-4546-ae6e-d64791f9022f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:47.199360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e95ea01e-e27f-4546-ae6e-d64791f9022f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:47.199844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e95ea01e-e27f-4546-ae6e-d64791f9022f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:47.200282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e95ea01e-e27f-4546-ae6e-d64791f9022f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:47.200976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e95ea01e-e27f-4546-ae6e-d64791f9022f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:47.201463 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e95ea01e-e27f-4546-ae6e-d64791f9022f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:47.201891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e95ea01e-e27f-4546-ae6e-d64791f9022f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:47.327213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e95ea01e-e27f-4546-ae6e-d64791f9022f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:47.335500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e95ea01e-e27f-4546-ae6e-d64791f9022f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.147659 Aug 08 09:11:47.336068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 959/2017] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:47 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:48.206483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bac3dcfb-63d2-4033-8230-2f7a3eebcc1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:48.206483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bac3dcfb-63d2-4033-8230-2f7a3eebcc1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:48.206483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac3dcfb-63d2-4033-8230-2f7a3eebcc1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:48.206483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac3dcfb-63d2-4033-8230-2f7a3eebcc1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:48.207352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac3dcfb-63d2-4033-8230-2f7a3eebcc1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:48.207352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac3dcfb-63d2-4033-8230-2f7a3eebcc1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:48.207352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac3dcfb-63d2-4033-8230-2f7a3eebcc1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:48.207352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bac3dcfb-63d2-4033-8230-2f7a3eebcc1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:48.269061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bac3dcfb-63d2-4033-8230-2f7a3eebcc1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:48.277739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bac3dcfb-63d2-4033-8230-2f7a3eebcc1c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.088089 Aug 08 09:11:48.278463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1059/2018] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:48.356670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b3824d29-4750-420b-9eb2-f5ea416c1f9c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:48.357316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b3824d29-4750-420b-9eb2-f5ea416c1f9c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:48.363790 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3824d29-4750-420b-9eb2-f5ea416c1f9c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:48.364301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3824d29-4750-420b-9eb2-f5ea416c1f9c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:48.364725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3824d29-4750-420b-9eb2-f5ea416c1f9c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:48.365458 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3824d29-4750-420b-9eb2-f5ea416c1f9c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:48.366051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3824d29-4750-420b-9eb2-f5ea416c1f9c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:48.366651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b3824d29-4750-420b-9eb2-f5ea416c1f9c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:48.493891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b3824d29-4750-420b-9eb2-f5ea416c1f9c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:48.501730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b3824d29-4750-420b-9eb2-f5ea416c1f9c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148936 Aug 08 09:11:48.502293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 960/2019] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:48 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:49.299355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b82f9cff-9793-4ddb-8b43-1a66e60a0741 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:49.299966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b82f9cff-9793-4ddb-8b43-1a66e60a0741 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:49.307452 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b82f9cff-9793-4ddb-8b43-1a66e60a0741 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:49.307931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b82f9cff-9793-4ddb-8b43-1a66e60a0741 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:49.308366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b82f9cff-9793-4ddb-8b43-1a66e60a0741 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:49.309045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b82f9cff-9793-4ddb-8b43-1a66e60a0741 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:49.309527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b82f9cff-9793-4ddb-8b43-1a66e60a0741 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:49.309948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b82f9cff-9793-4ddb-8b43-1a66e60a0741 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:49.370770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b82f9cff-9793-4ddb-8b43-1a66e60a0741 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:49.378583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b82f9cff-9793-4ddb-8b43-1a66e60a0741 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083127 Aug 08 09:11:49.379142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1060/2020] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:49.523960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4529547e-a1ac-4d9b-a70e-34ef3f2e7122 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:49.524577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4529547e-a1ac-4d9b-a70e-34ef3f2e7122 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:49.530962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4529547e-a1ac-4d9b-a70e-34ef3f2e7122 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:49.531451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4529547e-a1ac-4d9b-a70e-34ef3f2e7122 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:49.531892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4529547e-a1ac-4d9b-a70e-34ef3f2e7122 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:49.532583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4529547e-a1ac-4d9b-a70e-34ef3f2e7122 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:49.533042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4529547e-a1ac-4d9b-a70e-34ef3f2e7122 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:49.533497 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4529547e-a1ac-4d9b-a70e-34ef3f2e7122 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:49.664940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4529547e-a1ac-4d9b-a70e-34ef3f2e7122 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:49.672889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4529547e-a1ac-4d9b-a70e-34ef3f2e7122 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.153348 Aug 08 09:11:49.673479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 961/2021] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:49 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:50.399601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-69ef59f2-35ae-4511-a916-2e758d6fea82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:50.400212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-69ef59f2-35ae-4511-a916-2e758d6fea82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:50.406595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69ef59f2-35ae-4511-a916-2e758d6fea82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:50.407078 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69ef59f2-35ae-4511-a916-2e758d6fea82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:50.407516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69ef59f2-35ae-4511-a916-2e758d6fea82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:50.408200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69ef59f2-35ae-4511-a916-2e758d6fea82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:50.408649 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69ef59f2-35ae-4511-a916-2e758d6fea82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:50.409071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-69ef59f2-35ae-4511-a916-2e758d6fea82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:50.469870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-69ef59f2-35ae-4511-a916-2e758d6fea82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:50.477866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-69ef59f2-35ae-4511-a916-2e758d6fea82 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082207 Aug 08 09:11:50.478424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1061/2022] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:50 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:50.692991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3b0787a5-862f-4593-81e4-301e48fe755e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:50.693632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3b0787a5-862f-4593-81e4-301e48fe755e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:50.700675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b0787a5-862f-4593-81e4-301e48fe755e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:50.701165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b0787a5-862f-4593-81e4-301e48fe755e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:50.701626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b0787a5-862f-4593-81e4-301e48fe755e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:50.702311 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b0787a5-862f-4593-81e4-301e48fe755e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:50.702768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b0787a5-862f-4593-81e4-301e48fe755e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:50.703194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3b0787a5-862f-4593-81e4-301e48fe755e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:50.828390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3b0787a5-862f-4593-81e4-301e48fe755e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:50.837417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3b0787a5-862f-4593-81e4-301e48fe755e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148152 Aug 08 09:11:50.837987 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 962/2023] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:50 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:51.499199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7ea742fe-7529-4bf6-8c4c-1ed87a5d14fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:51.499753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7ea742fe-7529-4bf6-8c4c-1ed87a5d14fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:51.506043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea742fe-7529-4bf6-8c4c-1ed87a5d14fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:51.506643 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea742fe-7529-4bf6-8c4c-1ed87a5d14fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:51.507229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea742fe-7529-4bf6-8c4c-1ed87a5d14fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:51.507915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea742fe-7529-4bf6-8c4c-1ed87a5d14fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:51.508375 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea742fe-7529-4bf6-8c4c-1ed87a5d14fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:51.508797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ea742fe-7529-4bf6-8c4c-1ed87a5d14fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:51.572991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7ea742fe-7529-4bf6-8c4c-1ed87a5d14fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:51.580936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7ea742fe-7529-4bf6-8c4c-1ed87a5d14fc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085657 Aug 08 09:11:51.581542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1062/2024] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:51 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:51.858030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5baffc3a-36cf-4163-a404-bd0f871bd3f6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:51.858584 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5baffc3a-36cf-4163-a404-bd0f871bd3f6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:51.864955 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5baffc3a-36cf-4163-a404-bd0f871bd3f6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:51.865486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5baffc3a-36cf-4163-a404-bd0f871bd3f6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:51.866130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5baffc3a-36cf-4163-a404-bd0f871bd3f6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:51.866942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5baffc3a-36cf-4163-a404-bd0f871bd3f6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:51.867405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5baffc3a-36cf-4163-a404-bd0f871bd3f6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:51.867836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5baffc3a-36cf-4163-a404-bd0f871bd3f6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:51.995812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5baffc3a-36cf-4163-a404-bd0f871bd3f6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:52.003762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5baffc3a-36cf-4163-a404-bd0f871bd3f6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149659 Aug 08 09:11:52.004318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 963/2025] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:51 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:52.030375 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:11:52.030527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:11:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:11:52.601916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f13699d3-b8ed-4791-a2d5-bdb79569f7b5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:52.602568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f13699d3-b8ed-4791-a2d5-bdb79569f7b5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:52.608849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f13699d3-b8ed-4791-a2d5-bdb79569f7b5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:52.609377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f13699d3-b8ed-4791-a2d5-bdb79569f7b5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:52.609822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f13699d3-b8ed-4791-a2d5-bdb79569f7b5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:52.610510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f13699d3-b8ed-4791-a2d5-bdb79569f7b5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:52.610967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f13699d3-b8ed-4791-a2d5-bdb79569f7b5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:52.611399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f13699d3-b8ed-4791-a2d5-bdb79569f7b5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:52.673263 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f13699d3-b8ed-4791-a2d5-bdb79569f7b5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:52.681684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f13699d3-b8ed-4791-a2d5-bdb79569f7b5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083928 Aug 08 09:11:52.682253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1063/2026] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:52 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:53.024588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-45eadb36-d691-4cce-8313-f10490d5bf1c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:53.025245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-45eadb36-d691-4cce-8313-f10490d5bf1c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:53.031617 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45eadb36-d691-4cce-8313-f10490d5bf1c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:53.032096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45eadb36-d691-4cce-8313-f10490d5bf1c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:53.032528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45eadb36-d691-4cce-8313-f10490d5bf1c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:53.033238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45eadb36-d691-4cce-8313-f10490d5bf1c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:53.033689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45eadb36-d691-4cce-8313-f10490d5bf1c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:53.034111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45eadb36-d691-4cce-8313-f10490d5bf1c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:53.164880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-45eadb36-d691-4cce-8313-f10490d5bf1c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:53.172747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-45eadb36-d691-4cce-8313-f10490d5bf1c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151991 Aug 08 09:11:53.173331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 964/2027] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:53 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:53.703229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-19d43b4c-3cf6-4d86-bba1-72afe126e409 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:53.703844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-19d43b4c-3cf6-4d86-bba1-72afe126e409 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:53.711084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19d43b4c-3cf6-4d86-bba1-72afe126e409 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:53.711574 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19d43b4c-3cf6-4d86-bba1-72afe126e409 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:53.712015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19d43b4c-3cf6-4d86-bba1-72afe126e409 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:53.712732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19d43b4c-3cf6-4d86-bba1-72afe126e409 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:53.713271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19d43b4c-3cf6-4d86-bba1-72afe126e409 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:53.713722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-19d43b4c-3cf6-4d86-bba1-72afe126e409 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:53.775031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-19d43b4c-3cf6-4d86-bba1-72afe126e409 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:53.782930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-19d43b4c-3cf6-4d86-bba1-72afe126e409 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083546 Aug 08 09:11:53.783486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1064/2028] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:53 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:54.194792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c61f217f-564c-420b-a155-4c8b0aebeeec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:54.195408 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c61f217f-564c-420b-a155-4c8b0aebeeec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:54.201856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c61f217f-564c-420b-a155-4c8b0aebeeec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:54.202337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c61f217f-564c-420b-a155-4c8b0aebeeec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:54.202771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c61f217f-564c-420b-a155-4c8b0aebeeec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:54.203462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c61f217f-564c-420b-a155-4c8b0aebeeec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:54.203921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c61f217f-564c-420b-a155-4c8b0aebeeec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:54.204353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c61f217f-564c-420b-a155-4c8b0aebeeec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:54.334377 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c61f217f-564c-420b-a155-4c8b0aebeeec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:54.342329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c61f217f-564c-420b-a155-4c8b0aebeeec tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152208 Aug 08 09:11:54.342891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 965/2029] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:54 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:54.803382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a8ecdce0-f5cd-47c1-a284-314dd811d2f2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:54.804003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a8ecdce0-f5cd-47c1-a284-314dd811d2f2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:54.810367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8ecdce0-f5cd-47c1-a284-314dd811d2f2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:54.811059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8ecdce0-f5cd-47c1-a284-314dd811d2f2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:54.811295 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8ecdce0-f5cd-47c1-a284-314dd811d2f2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:54.812005 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8ecdce0-f5cd-47c1-a284-314dd811d2f2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:54.812463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8ecdce0-f5cd-47c1-a284-314dd811d2f2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:54.812892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a8ecdce0-f5cd-47c1-a284-314dd811d2f2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:54.877011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a8ecdce0-f5cd-47c1-a284-314dd811d2f2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:54.885062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a8ecdce0-f5cd-47c1-a284-314dd811d2f2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085613 Aug 08 09:11:54.885659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1065/2030] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:54 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:55.363776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-151545b6-11c3-4120-966f-e8ce700454e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:55.364391 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-151545b6-11c3-4120-966f-e8ce700454e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:55.371084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-151545b6-11c3-4120-966f-e8ce700454e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:55.371570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-151545b6-11c3-4120-966f-e8ce700454e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:55.372040 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-151545b6-11c3-4120-966f-e8ce700454e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:55.372726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-151545b6-11c3-4120-966f-e8ce700454e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:55.373199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-151545b6-11c3-4120-966f-e8ce700454e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:55.373628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-151545b6-11c3-4120-966f-e8ce700454e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:55.500467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-151545b6-11c3-4120-966f-e8ce700454e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:55.508954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-151545b6-11c3-4120-966f-e8ce700454e1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.149419 Aug 08 09:11:55.509565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 966/2031] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:55 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:55.905839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3d503ae1-0b26-45c3-a782-786b62cef906 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:55.906459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3d503ae1-0b26-45c3-a782-786b62cef906 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:55.912824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d503ae1-0b26-45c3-a782-786b62cef906 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:55.913345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d503ae1-0b26-45c3-a782-786b62cef906 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:55.913794 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d503ae1-0b26-45c3-a782-786b62cef906 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:55.914486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d503ae1-0b26-45c3-a782-786b62cef906 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:55.914947 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d503ae1-0b26-45c3-a782-786b62cef906 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:55.915379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d503ae1-0b26-45c3-a782-786b62cef906 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:55.976056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3d503ae1-0b26-45c3-a782-786b62cef906 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:55.983850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3d503ae1-0b26-45c3-a782-786b62cef906 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081884 Aug 08 09:11:55.984406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1066/2032] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:56.530333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c5736ce8-f75d-4aac-b88a-5abf3d4d67ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:56.530873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c5736ce8-f75d-4aac-b88a-5abf3d4d67ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:56.537229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5736ce8-f75d-4aac-b88a-5abf3d4d67ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:56.537799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5736ce8-f75d-4aac-b88a-5abf3d4d67ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:56.538264 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5736ce8-f75d-4aac-b88a-5abf3d4d67ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:56.538947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5736ce8-f75d-4aac-b88a-5abf3d4d67ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:56.539399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5736ce8-f75d-4aac-b88a-5abf3d4d67ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:56.539823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c5736ce8-f75d-4aac-b88a-5abf3d4d67ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:56.543744 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:11:56.671823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c5736ce8-f75d-4aac-b88a-5abf3d4d67ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:56.680472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c5736ce8-f75d-4aac-b88a-5abf3d4d67ae tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154062 Aug 08 09:11:56.681034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 967/2033] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:56 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:57.004158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ea42526d-a962-4a88-aa70-a8ddb9feb5d1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:57.004884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ea42526d-a962-4a88-aa70-a8ddb9feb5d1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:57.011448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ea42526d-a962-4a88-aa70-a8ddb9feb5d1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:57.011927 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ea42526d-a962-4a88-aa70-a8ddb9feb5d1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:57.012363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ea42526d-a962-4a88-aa70-a8ddb9feb5d1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:57.013325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ea42526d-a962-4a88-aa70-a8ddb9feb5d1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:57.013779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ea42526d-a962-4a88-aa70-a8ddb9feb5d1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:57.014202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ea42526d-a962-4a88-aa70-a8ddb9feb5d1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:57.074566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ea42526d-a962-4a88-aa70-a8ddb9feb5d1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:57.082399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ea42526d-a962-4a88-aa70-a8ddb9feb5d1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082047 Aug 08 09:11:57.082957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1067/2034] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:57.701014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6436c474-8ba1-4de6-87f1-0036b8357b80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:57.701616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6436c474-8ba1-4de6-87f1-0036b8357b80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:57.708062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6436c474-8ba1-4de6-87f1-0036b8357b80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:57.708547 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6436c474-8ba1-4de6-87f1-0036b8357b80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:57.708982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6436c474-8ba1-4de6-87f1-0036b8357b80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:57.709707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6436c474-8ba1-4de6-87f1-0036b8357b80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:57.710164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6436c474-8ba1-4de6-87f1-0036b8357b80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:57.710588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6436c474-8ba1-4de6-87f1-0036b8357b80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:57.839545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6436c474-8ba1-4de6-87f1-0036b8357b80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:57.847458 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6436c474-8ba1-4de6-87f1-0036b8357b80 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.150377 Aug 08 09:11:57.848011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 968/2035] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:57 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:58.104861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-497ca83e-b986-45e0-addc-00dc131f99d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:58.105441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-497ca83e-b986-45e0-addc-00dc131f99d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:58.111895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-497ca83e-b986-45e0-addc-00dc131f99d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:58.112382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-497ca83e-b986-45e0-addc-00dc131f99d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:58.112821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-497ca83e-b986-45e0-addc-00dc131f99d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:58.113552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-497ca83e-b986-45e0-addc-00dc131f99d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:58.114011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-497ca83e-b986-45e0-addc-00dc131f99d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:58.114468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-497ca83e-b986-45e0-addc-00dc131f99d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:58.179666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-497ca83e-b986-45e0-addc-00dc131f99d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:58.187651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-497ca83e-b986-45e0-addc-00dc131f99d3 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086664 Aug 08 09:11:58.195758 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1068/2036] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:58.868222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7bdd7109-43d1-45a5-a2ae-0e4c310d9af0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:58.868834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7bdd7109-43d1-45a5-a2ae-0e4c310d9af0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:58.875234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7bdd7109-43d1-45a5-a2ae-0e4c310d9af0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:58.875716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7bdd7109-43d1-45a5-a2ae-0e4c310d9af0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:58.876150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7bdd7109-43d1-45a5-a2ae-0e4c310d9af0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:58.876838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7bdd7109-43d1-45a5-a2ae-0e4c310d9af0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:58.877332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7bdd7109-43d1-45a5-a2ae-0e4c310d9af0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:58.877752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7bdd7109-43d1-45a5-a2ae-0e4c310d9af0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:59.003998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7bdd7109-43d1-45a5-a2ae-0e4c310d9af0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:59.013072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7bdd7109-43d1-45a5-a2ae-0e4c310d9af0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148638 Aug 08 09:11:59.013664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 969/2037] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:58 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:11:59.214274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e364a464-51b7-4ed4-a4d3-879ec4dc3f85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:11:59.214848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e364a464-51b7-4ed4-a4d3-879ec4dc3f85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:11:59.221241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e364a464-51b7-4ed4-a4d3-879ec4dc3f85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:59.221730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e364a464-51b7-4ed4-a4d3-879ec4dc3f85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:59.222166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e364a464-51b7-4ed4-a4d3-879ec4dc3f85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:59.222849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e364a464-51b7-4ed4-a4d3-879ec4dc3f85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:11:59.223304 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e364a464-51b7-4ed4-a4d3-879ec4dc3f85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:11:59.223759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e364a464-51b7-4ed4-a4d3-879ec4dc3f85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:11:59.286651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e364a464-51b7-4ed4-a4d3-879ec4dc3f85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:11:59.294485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e364a464-51b7-4ed4-a4d3-879ec4dc3f85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084150 Aug 08 09:11:59.295042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1069/2038] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:11:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:00.034523 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0eef3417-defc-47a0-91f7-f8e99e42ed6c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:00.035131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0eef3417-defc-47a0-91f7-f8e99e42ed6c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:00.042245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eef3417-defc-47a0-91f7-f8e99e42ed6c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:00.042736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eef3417-defc-47a0-91f7-f8e99e42ed6c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:00.043191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eef3417-defc-47a0-91f7-f8e99e42ed6c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:00.043877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eef3417-defc-47a0-91f7-f8e99e42ed6c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:00.044337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eef3417-defc-47a0-91f7-f8e99e42ed6c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:00.044770 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0eef3417-defc-47a0-91f7-f8e99e42ed6c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:00.177695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0eef3417-defc-47a0-91f7-f8e99e42ed6c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:00.186340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0eef3417-defc-47a0-91f7-f8e99e42ed6c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.155691 Aug 08 09:12:00.186931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 970/2039] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:00 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:00.315311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e03c9b92-51a3-4dd7-ba4a-b035c74bdeb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:00.316011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e03c9b92-51a3-4dd7-ba4a-b035c74bdeb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:00.323146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e03c9b92-51a3-4dd7-ba4a-b035c74bdeb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:00.323634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e03c9b92-51a3-4dd7-ba4a-b035c74bdeb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:00.324074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e03c9b92-51a3-4dd7-ba4a-b035c74bdeb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:00.324822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e03c9b92-51a3-4dd7-ba4a-b035c74bdeb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:00.325309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e03c9b92-51a3-4dd7-ba4a-b035c74bdeb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:00.325738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e03c9b92-51a3-4dd7-ba4a-b035c74bdeb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:00.343586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:00.385453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e03c9b92-51a3-4dd7-ba4a-b035c74bdeb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:00.393358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e03c9b92-51a3-4dd7-ba4a-b035c74bdeb0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081847 Aug 08 09:12:00.393917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1070/2040] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:00 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:01.207230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-87698b42-0dea-4c6f-861f-2e69c5c28ad6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:01.207851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-87698b42-0dea-4c6f-861f-2e69c5c28ad6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:01.214966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87698b42-0dea-4c6f-861f-2e69c5c28ad6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:01.215456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87698b42-0dea-4c6f-861f-2e69c5c28ad6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:01.215898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87698b42-0dea-4c6f-861f-2e69c5c28ad6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:01.216593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87698b42-0dea-4c6f-861f-2e69c5c28ad6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:01.217056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87698b42-0dea-4c6f-861f-2e69c5c28ad6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:01.217514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87698b42-0dea-4c6f-861f-2e69c5c28ad6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:01.346493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-87698b42-0dea-4c6f-861f-2e69c5c28ad6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:01.354543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-87698b42-0dea-4c6f-861f-2e69c5c28ad6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151237 Aug 08 09:12:01.355105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 971/2041] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:01 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:01.414667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8bd7d285-476e-48f9-b8c5-f3c5392ad3c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:01.415450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8bd7d285-476e-48f9-b8c5-f3c5392ad3c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:01.421872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8bd7d285-476e-48f9-b8c5-f3c5392ad3c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:01.422358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8bd7d285-476e-48f9-b8c5-f3c5392ad3c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:01.422791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8bd7d285-476e-48f9-b8c5-f3c5392ad3c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:01.423479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8bd7d285-476e-48f9-b8c5-f3c5392ad3c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:01.423935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8bd7d285-476e-48f9-b8c5-f3c5392ad3c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:01.424359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8bd7d285-476e-48f9-b8c5-f3c5392ad3c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:01.487738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8bd7d285-476e-48f9-b8c5-f3c5392ad3c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:01.496431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8bd7d285-476e-48f9-b8c5-f3c5392ad3c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085644 Aug 08 09:12:01.497057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1071/2042] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:01 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:02.375535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e41ff86d-aca3-491d-99de-7545320522ee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:02.376160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e41ff86d-aca3-491d-99de-7545320522ee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:02.382577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e41ff86d-aca3-491d-99de-7545320522ee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:02.383057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e41ff86d-aca3-491d-99de-7545320522ee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:02.383492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e41ff86d-aca3-491d-99de-7545320522ee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:02.384179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e41ff86d-aca3-491d-99de-7545320522ee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:02.384631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e41ff86d-aca3-491d-99de-7545320522ee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:02.385054 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e41ff86d-aca3-491d-99de-7545320522ee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:02.515020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e41ff86d-aca3-491d-99de-7545320522ee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:02.518189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-50b878e7-9257-4b0f-a6e8-33134f8b92c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:02.518800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-50b878e7-9257-4b0f-a6e8-33134f8b92c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:02.523535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e41ff86d-aca3-491d-99de-7545320522ee tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151902 Aug 08 09:12:02.524108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 972/2043] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:02 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:02.525764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50b878e7-9257-4b0f-a6e8-33134f8b92c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:02.526298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50b878e7-9257-4b0f-a6e8-33134f8b92c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:02.526742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50b878e7-9257-4b0f-a6e8-33134f8b92c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:02.527452 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50b878e7-9257-4b0f-a6e8-33134f8b92c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:02.527908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50b878e7-9257-4b0f-a6e8-33134f8b92c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:02.528334 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-50b878e7-9257-4b0f-a6e8-33134f8b92c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:02.589302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-50b878e7-9257-4b0f-a6e8-33134f8b92c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:02.597102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-50b878e7-9257-4b0f-a6e8-33134f8b92c7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082911 Aug 08 09:12:02.597687 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1072/2044] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:02 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:03.543962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-985768d9-7b0e-44cc-89be-c6f80262710b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:03.544496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-985768d9-7b0e-44cc-89be-c6f80262710b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:03.551014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-985768d9-7b0e-44cc-89be-c6f80262710b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:03.551514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-985768d9-7b0e-44cc-89be-c6f80262710b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:03.551949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-985768d9-7b0e-44cc-89be-c6f80262710b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:03.552638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-985768d9-7b0e-44cc-89be-c6f80262710b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:03.553419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-985768d9-7b0e-44cc-89be-c6f80262710b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:03.553885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-985768d9-7b0e-44cc-89be-c6f80262710b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:03.618430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-84342ec0-d486-4239-9a1e-35c477c8bd36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:03.619166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-84342ec0-d486-4239-9a1e-35c477c8bd36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:03.625557 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84342ec0-d486-4239-9a1e-35c477c8bd36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:03.626047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84342ec0-d486-4239-9a1e-35c477c8bd36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:03.626484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84342ec0-d486-4239-9a1e-35c477c8bd36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:03.627169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84342ec0-d486-4239-9a1e-35c477c8bd36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:03.627626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84342ec0-d486-4239-9a1e-35c477c8bd36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:03.628056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84342ec0-d486-4239-9a1e-35c477c8bd36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:03.706088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-84342ec0-d486-4239-9a1e-35c477c8bd36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:03.716211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-84342ec0-d486-4239-9a1e-35c477c8bd36 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.102032 Aug 08 09:12:03.747904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1073/2045] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:03.748206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-985768d9-7b0e-44cc-89be-c6f80262710b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:03.748206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-985768d9-7b0e-44cc-89be-c6f80262710b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.189819 Aug 08 09:12:03.748206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 973/2046] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:03 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:04.740093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-15018356-5a96-4ac8-8051-3acabd0465a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:04.741413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-15018356-5a96-4ac8-8051-3acabd0465a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:04.747926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15018356-5a96-4ac8-8051-3acabd0465a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:04.748420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15018356-5a96-4ac8-8051-3acabd0465a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:04.748866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15018356-5a96-4ac8-8051-3acabd0465a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:04.749586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15018356-5a96-4ac8-8051-3acabd0465a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:04.750052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15018356-5a96-4ac8-8051-3acabd0465a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:04.750486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15018356-5a96-4ac8-8051-3acabd0465a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:04.751365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ae0f9344-c5da-438b-86f2-2eda49f66f8f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:04.752011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ae0f9344-c5da-438b-86f2-2eda49f66f8f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:04.759063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae0f9344-c5da-438b-86f2-2eda49f66f8f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:04.759551 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae0f9344-c5da-438b-86f2-2eda49f66f8f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:04.759995 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae0f9344-c5da-438b-86f2-2eda49f66f8f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:04.760691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae0f9344-c5da-438b-86f2-2eda49f66f8f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:04.761173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae0f9344-c5da-438b-86f2-2eda49f66f8f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:04.761605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ae0f9344-c5da-438b-86f2-2eda49f66f8f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:04.834891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-15018356-5a96-4ac8-8051-3acabd0465a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:04.842849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-15018356-5a96-4ac8-8051-3acabd0465a0 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.106515 Aug 08 09:12:04.843594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1074/2047] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:04.904986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ae0f9344-c5da-438b-86f2-2eda49f66f8f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:04.913578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ae0f9344-c5da-438b-86f2-2eda49f66f8f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.165970 Aug 08 09:12:04.914144 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 974/2048] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:04 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:05.863692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ccdf9c9e-fd98-4d2c-b634-a1d4520cc722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:05.864290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ccdf9c9e-fd98-4d2c-b634-a1d4520cc722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:05.871607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccdf9c9e-fd98-4d2c-b634-a1d4520cc722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:05.872090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccdf9c9e-fd98-4d2c-b634-a1d4520cc722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:05.872522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccdf9c9e-fd98-4d2c-b634-a1d4520cc722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:05.873294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccdf9c9e-fd98-4d2c-b634-a1d4520cc722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:05.873748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccdf9c9e-fd98-4d2c-b634-a1d4520cc722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:05.874171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ccdf9c9e-fd98-4d2c-b634-a1d4520cc722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:05.935166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e0f35c0f-b59a-4ca4-bc47-01c0f8977925 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:05.935583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ccdf9c9e-fd98-4d2c-b634-a1d4520cc722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:05.935925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e0f35c0f-b59a-4ca4-bc47-01c0f8977925 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:05.942379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e0f35c0f-b59a-4ca4-bc47-01c0f8977925 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:05.943053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ccdf9c9e-fd98-4d2c-b634-a1d4520cc722 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083198 Aug 08 09:12:05.943175 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e0f35c0f-b59a-4ca4-bc47-01c0f8977925 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:05.943573 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e0f35c0f-b59a-4ca4-bc47-01c0f8977925 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:05.944036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1075/2049] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:05 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:05.944671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e0f35c0f-b59a-4ca4-bc47-01c0f8977925 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:05.945168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e0f35c0f-b59a-4ca4-bc47-01c0f8977925 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:05.945615 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e0f35c0f-b59a-4ca4-bc47-01c0f8977925 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:06.082249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e0f35c0f-b59a-4ca4-bc47-01c0f8977925 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:06.090703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e0f35c0f-b59a-4ca4-bc47-01c0f8977925 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.159533 Aug 08 09:12:06.091264 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 975/2050] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:05 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:06.963485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c2c679a4-0504-4412-8a3c-d84bbdbcbea6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:06.964100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c2c679a4-0504-4412-8a3c-d84bbdbcbea6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:06.970537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c679a4-0504-4412-8a3c-d84bbdbcbea6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:06.971027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c679a4-0504-4412-8a3c-d84bbdbcbea6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:06.971475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c679a4-0504-4412-8a3c-d84bbdbcbea6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:06.972163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c679a4-0504-4412-8a3c-d84bbdbcbea6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:06.972625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c679a4-0504-4412-8a3c-d84bbdbcbea6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:06.973055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c2c679a4-0504-4412-8a3c-d84bbdbcbea6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:07.074668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c2c679a4-0504-4412-8a3c-d84bbdbcbea6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:07.082573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c2c679a4-0504-4412-8a3c-d84bbdbcbea6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.123245 Aug 08 09:12:07.083139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1076/2051] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:06 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:07.111829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b1dfde21-8795-411d-8756-2d53ea22f042 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:07.112590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b1dfde21-8795-411d-8756-2d53ea22f042 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:07.120464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1dfde21-8795-411d-8756-2d53ea22f042 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:07.120954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1dfde21-8795-411d-8756-2d53ea22f042 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:07.121422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1dfde21-8795-411d-8756-2d53ea22f042 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:07.122121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1dfde21-8795-411d-8756-2d53ea22f042 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:07.122581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1dfde21-8795-411d-8756-2d53ea22f042 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:07.123009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b1dfde21-8795-411d-8756-2d53ea22f042 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:07.353634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b1dfde21-8795-411d-8756-2d53ea22f042 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:07.361582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ed4ca6af-fd14-4f1a-b13b-9954230b7ba3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:07.362172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ed4ca6af-fd14-4f1a-b13b-9954230b7ba3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:07.364786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b1dfde21-8795-411d-8756-2d53ea22f042 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.256719 Aug 08 09:12:07.365399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 976/2052] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:07 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:07.369040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed4ca6af-fd14-4f1a-b13b-9954230b7ba3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:07.369765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed4ca6af-fd14-4f1a-b13b-9954230b7ba3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:07.370394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed4ca6af-fd14-4f1a-b13b-9954230b7ba3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:07.371257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-26f1f01d-6341-4440-9892-0090ed1eb755 req-2708ee6f-63cc-414d-8abc-975e9ee3fb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae15222-d37a-43e4-bf78-a97c7c3d16c8", "tag": "bffdad13-f65d-4d9b-830d-d0bb55adc8d7"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 09:12:07.371442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed4ca6af-fd14-4f1a-b13b-9954230b7ba3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:07.372043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed4ca6af-fd14-4f1a-b13b-9954230b7ba3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:07.372642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ed4ca6af-fd14-4f1a-b13b-9954230b7ba3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:07.382939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-26f1f01d-6341-4440-9892-0090ed1eb755 req-2708ee6f-63cc-414d-8abc-975e9ee3fb80 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:07.383670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-26f1f01d-6341-4440-9892-0090ed1eb755 req-2708ee6f-63cc-414d-8abc-975e9ee3fb80 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:07.384130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-26f1f01d-6341-4440-9892-0090ed1eb755 req-2708ee6f-63cc-414d-8abc-975e9ee3fb80 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:07.396351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-26f1f01d-6341-4440-9892-0090ed1eb755 req-2708ee6f-63cc-414d-8abc-975e9ee3fb80 service nova] Creating event network-changed:bffdad13-f65d-4d9b-830d-d0bb55adc8d7 for instance cae15222-d37a-43e4-bf78-a97c7c3d16c8 on hv-cinder-83697 Aug 08 09:12:07.403828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ed4ca6af-fd14-4f1a-b13b-9954230b7ba3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Going to try to terminate instance {{(pid=124673) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 09:12:07.404467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-26f1f01d-6341-4440-9892-0090ed1eb755 req-2708ee6f-63cc-414d-8abc-975e9ee3fb80 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037813 Aug 08 09:12:07.405287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 977/2053] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 09:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 09:12:07.690823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ed4ca6af-fd14-4f1a-b13b-9954230b7ba3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 204 len: 0 microversion: 2.1 time: 0.332740 Aug 08 09:12:07.691404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1077/2054] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 09:12:07 2022] DELETE /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 09:12:07.701419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e33afdcd-1df3-4b2a-b79d-c54782012e44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:07.702169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e33afdcd-1df3-4b2a-b79d-c54782012e44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:07.708798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e33afdcd-1df3-4b2a-b79d-c54782012e44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:07.709333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e33afdcd-1df3-4b2a-b79d-c54782012e44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:07.709769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e33afdcd-1df3-4b2a-b79d-c54782012e44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:07.711236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e33afdcd-1df3-4b2a-b79d-c54782012e44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:07.711723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e33afdcd-1df3-4b2a-b79d-c54782012e44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:07.712152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e33afdcd-1df3-4b2a-b79d-c54782012e44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:07.869411 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e33afdcd-1df3-4b2a-b79d-c54782012e44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:07.877245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e33afdcd-1df3-4b2a-b79d-c54782012e44 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1577 microversion: 2.1 time: 0.180863 Aug 08 09:12:07.877935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 978/2055] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:07 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:08.104700 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e6b1ef5f-8882-4200-82ab-f8b92759f89a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:08.111031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e6b1ef5f-8882-4200-82ab-f8b92759f89a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:08.114288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6b1ef5f-8882-4200-82ab-f8b92759f89a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:08.114782 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6b1ef5f-8882-4200-82ab-f8b92759f89a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:08.115227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6b1ef5f-8882-4200-82ab-f8b92759f89a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:08.116089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6b1ef5f-8882-4200-82ab-f8b92759f89a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:08.116543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6b1ef5f-8882-4200-82ab-f8b92759f89a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:08.117405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e6b1ef5f-8882-4200-82ab-f8b92759f89a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:08.183155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e6b1ef5f-8882-4200-82ab-f8b92759f89a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:08.191635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e6b1ef5f-8882-4200-82ab-f8b92759f89a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.091959 Aug 08 09:12:08.192194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1078/2056] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:08 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:08.388230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-661d8785-b042-4af1-b31b-9c3546068378 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:08.388956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-661d8785-b042-4af1-b31b-9c3546068378 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:08.395590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-661d8785-b042-4af1-b31b-9c3546068378 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:08.396168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-661d8785-b042-4af1-b31b-9c3546068378 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:08.396613 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-661d8785-b042-4af1-b31b-9c3546068378 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:08.397355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-661d8785-b042-4af1-b31b-9c3546068378 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:08.398357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-661d8785-b042-4af1-b31b-9c3546068378 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:08.398970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-661d8785-b042-4af1-b31b-9c3546068378 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:08.568730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-661d8785-b042-4af1-b31b-9c3546068378 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:08.577603 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-661d8785-b042-4af1-b31b-9c3546068378 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.193478 Aug 08 09:12:08.578181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 979/2057] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:08 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:08.899337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ab0428b2-8ad0-4727-8fb5-ddf3b2693196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:08.899950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ab0428b2-8ad0-4727-8fb5-ddf3b2693196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:08.905869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab0428b2-8ad0-4727-8fb5-ddf3b2693196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:08.906291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab0428b2-8ad0-4727-8fb5-ddf3b2693196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:08.906732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab0428b2-8ad0-4727-8fb5-ddf3b2693196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:08.907415 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab0428b2-8ad0-4727-8fb5-ddf3b2693196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:08.907876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab0428b2-8ad0-4727-8fb5-ddf3b2693196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:08.908302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab0428b2-8ad0-4727-8fb5-ddf3b2693196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:09.113550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ab0428b2-8ad0-4727-8fb5-ddf3b2693196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:09.121480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ab0428b2-8ad0-4727-8fb5-ddf3b2693196 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1458 microversion: 2.1 time: 0.226435 Aug 08 09:12:09.122058 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1079/2058] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:08 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1458 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:09.214309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-059e0280-3f0e-49b5-aec8-7097be111137 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:09.214887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-059e0280-3f0e-49b5-aec8-7097be111137 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:09.216831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=56 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:09.221522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-059e0280-3f0e-49b5-aec8-7097be111137 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:09.222002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-059e0280-3f0e-49b5-aec8-7097be111137 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:09.222467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-059e0280-3f0e-49b5-aec8-7097be111137 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:09.223152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-059e0280-3f0e-49b5-aec8-7097be111137 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:09.223601 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-059e0280-3f0e-49b5-aec8-7097be111137 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:09.224022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-059e0280-3f0e-49b5-aec8-7097be111137 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:09.286043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-059e0280-3f0e-49b5-aec8-7097be111137 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:09.294821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-059e0280-3f0e-49b5-aec8-7097be111137 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085132 Aug 08 09:12:09.295369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 980/2059] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:09.423118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-8ca4eb7b-246b-46cc-a108-654c4007b05b req-bec02237-3ea3-418a-a9f2-283405868377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae15222-d37a-43e4-bf78-a97c7c3d16c8", "name": "network-vif-deleted", "tag": "bffdad13-f65d-4d9b-830d-d0bb55adc8d7"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 09:12:09.433053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-8ca4eb7b-246b-46cc-a108-654c4007b05b req-bec02237-3ea3-418a-a9f2-283405868377 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:09.433571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-8ca4eb7b-246b-46cc-a108-654c4007b05b req-bec02237-3ea3-418a-a9f2-283405868377 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:09.434010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-8ca4eb7b-246b-46cc-a108-654c4007b05b req-bec02237-3ea3-418a-a9f2-283405868377 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:09.446285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-8ca4eb7b-246b-46cc-a108-654c4007b05b req-bec02237-3ea3-418a-a9f2-283405868377 service nova] Creating event network-vif-deleted:bffdad13-f65d-4d9b-830d-d0bb55adc8d7 for instance cae15222-d37a-43e4-bf78-a97c7c3d16c8 on hv-cinder-83697 Aug 08 09:12:09.451287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-8ca4eb7b-246b-46cc-a108-654c4007b05b req-bec02237-3ea3-418a-a9f2-283405868377 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031855 Aug 08 09:12:09.451887 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1080/2060] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 09:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 09:12:09.598731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-73c59976-e31c-48fb-8413-e58546f14bf7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:09.599318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-73c59976-e31c-48fb-8413-e58546f14bf7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:09.606295 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73c59976-e31c-48fb-8413-e58546f14bf7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:09.606782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73c59976-e31c-48fb-8413-e58546f14bf7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:09.607227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73c59976-e31c-48fb-8413-e58546f14bf7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:09.607924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73c59976-e31c-48fb-8413-e58546f14bf7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:09.608384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73c59976-e31c-48fb-8413-e58546f14bf7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:09.608810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73c59976-e31c-48fb-8413-e58546f14bf7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:09.740248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-73c59976-e31c-48fb-8413-e58546f14bf7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:09.748834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-73c59976-e31c-48fb-8413-e58546f14bf7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.154076 Aug 08 09:12:09.749448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 981/2061] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:09 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:10.149326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-43047838-a32d-4398-bdea-558be4b290e9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:10.150027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-43047838-a32d-4398-bdea-558be4b290e9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:10.156076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43047838-a32d-4398-bdea-558be4b290e9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:10.156561 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43047838-a32d-4398-bdea-558be4b290e9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:10.156997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43047838-a32d-4398-bdea-558be4b290e9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:10.157717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43047838-a32d-4398-bdea-558be4b290e9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:10.158175 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43047838-a32d-4398-bdea-558be4b290e9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:10.158602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43047838-a32d-4398-bdea-558be4b290e9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:10.220948 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-43047838-a32d-4398-bdea-558be4b290e9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:10.228878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-43047838-a32d-4398-bdea-558be4b290e9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084370 Aug 08 09:12:10.229473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1081/2062] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:10 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:10.314534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-22561c97-56fb-4f15-ad1b-4943ed86fcba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:10.315151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-22561c97-56fb-4f15-ad1b-4943ed86fcba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:10.321365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22561c97-56fb-4f15-ad1b-4943ed86fcba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:10.321851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22561c97-56fb-4f15-ad1b-4943ed86fcba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:10.322293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22561c97-56fb-4f15-ad1b-4943ed86fcba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:10.322985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22561c97-56fb-4f15-ad1b-4943ed86fcba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:10.323445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22561c97-56fb-4f15-ad1b-4943ed86fcba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:10.323873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-22561c97-56fb-4f15-ad1b-4943ed86fcba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:10.383738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-22561c97-56fb-4f15-ad1b-4943ed86fcba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:10.391993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-22561c97-56fb-4f15-ad1b-4943ed86fcba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081267 Aug 08 09:12:10.392587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 982/2063] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:10 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:10.770979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3342946e-cf82-4f3d-a32d-c5fc9724956b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:10.771527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3342946e-cf82-4f3d-a32d-c5fc9724956b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:10.774229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:10.778853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3342946e-cf82-4f3d-a32d-c5fc9724956b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:10.779345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3342946e-cf82-4f3d-a32d-c5fc9724956b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:10.779823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3342946e-cf82-4f3d-a32d-c5fc9724956b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:10.780516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3342946e-cf82-4f3d-a32d-c5fc9724956b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:10.780976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3342946e-cf82-4f3d-a32d-c5fc9724956b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:10.781440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3342946e-cf82-4f3d-a32d-c5fc9724956b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:10.914168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3342946e-cf82-4f3d-a32d-c5fc9724956b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:10.922163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3342946e-cf82-4f3d-a32d-c5fc9724956b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.155193 Aug 08 09:12:10.922731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1082/2064] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:10 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:11.250040 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f3b6eb81-e8ce-4f45-b421-de46ab62a3ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:11.250647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f3b6eb81-e8ce-4f45-b421-de46ab62a3ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:11.256981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f3b6eb81-e8ce-4f45-b421-de46ab62a3ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:11.257493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f3b6eb81-e8ce-4f45-b421-de46ab62a3ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:11.257929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f3b6eb81-e8ce-4f45-b421-de46ab62a3ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:11.259254 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f3b6eb81-e8ce-4f45-b421-de46ab62a3ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:11.259705 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f3b6eb81-e8ce-4f45-b421-de46ab62a3ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:11.260131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f3b6eb81-e8ce-4f45-b421-de46ab62a3ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:11.321319 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f3b6eb81-e8ce-4f45-b421-de46ab62a3ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:11.328820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f3b6eb81-e8ce-4f45-b421-de46ab62a3ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082630 Aug 08 09:12:11.329411 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 983/2065] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:11 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:11.413040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-707f744c-7a59-4c02-96a7-7b1c9b3cd507 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:11.413703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-707f744c-7a59-4c02-96a7-7b1c9b3cd507 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:11.420122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707f744c-7a59-4c02-96a7-7b1c9b3cd507 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:11.420605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707f744c-7a59-4c02-96a7-7b1c9b3cd507 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:11.421041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707f744c-7a59-4c02-96a7-7b1c9b3cd507 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:11.421761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707f744c-7a59-4c02-96a7-7b1c9b3cd507 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:11.422218 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707f744c-7a59-4c02-96a7-7b1c9b3cd507 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:11.422644 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-707f744c-7a59-4c02-96a7-7b1c9b3cd507 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:11.482931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-707f744c-7a59-4c02-96a7-7b1c9b3cd507 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:11.490761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-707f744c-7a59-4c02-96a7-7b1c9b3cd507 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081519 Aug 08 09:12:11.491320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1083/2066] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:11 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:11.942907 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d55443c5-8d61-47a1-813a-30924bbd5c6f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:11.943525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d55443c5-8d61-47a1-813a-30924bbd5c6f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:11.949660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d55443c5-8d61-47a1-813a-30924bbd5c6f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:11.950150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d55443c5-8d61-47a1-813a-30924bbd5c6f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:11.950589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d55443c5-8d61-47a1-813a-30924bbd5c6f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:11.951287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d55443c5-8d61-47a1-813a-30924bbd5c6f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:11.951750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d55443c5-8d61-47a1-813a-30924bbd5c6f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:11.952179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d55443c5-8d61-47a1-813a-30924bbd5c6f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:11.971943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:12.082895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d55443c5-8d61-47a1-813a-30924bbd5c6f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:12.091270 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d55443c5-8d61-47a1-813a-30924bbd5c6f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152229 Aug 08 09:12:12.091838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 984/2067] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:11 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:12.349403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-41e573f9-642a-4875-84e4-6c70f1cc6863 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:12.350020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-41e573f9-642a-4875-84e4-6c70f1cc6863 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:12.356327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-41e573f9-642a-4875-84e4-6c70f1cc6863 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:12.356806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-41e573f9-642a-4875-84e4-6c70f1cc6863 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:12.357274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-41e573f9-642a-4875-84e4-6c70f1cc6863 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:12.357956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-41e573f9-642a-4875-84e4-6c70f1cc6863 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:12.358410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-41e573f9-642a-4875-84e4-6c70f1cc6863 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:12.358833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-41e573f9-642a-4875-84e4-6c70f1cc6863 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:12.422224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-41e573f9-642a-4875-84e4-6c70f1cc6863 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:12.429853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-41e573f9-642a-4875-84e4-6c70f1cc6863 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084299 Aug 08 09:12:12.431130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1084/2068] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:12 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:12.511960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dc2d871c-e3be-49d6-bb5c-57c1740cb1e5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:12.512572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dc2d871c-e3be-49d6-bb5c-57c1740cb1e5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:12.519207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc2d871c-e3be-49d6-bb5c-57c1740cb1e5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:12.519694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc2d871c-e3be-49d6-bb5c-57c1740cb1e5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:12.520128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc2d871c-e3be-49d6-bb5c-57c1740cb1e5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:12.520808 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc2d871c-e3be-49d6-bb5c-57c1740cb1e5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:12.521284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc2d871c-e3be-49d6-bb5c-57c1740cb1e5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:12.521707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc2d871c-e3be-49d6-bb5c-57c1740cb1e5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:12.583323 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dc2d871c-e3be-49d6-bb5c-57c1740cb1e5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:12.591124 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dc2d871c-e3be-49d6-bb5c-57c1740cb1e5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083160 Aug 08 09:12:12.591681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 985/2069] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:12 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:13.111771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3f9e62ef-3856-4428-b107-5702128f3f84 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:13.112386 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3f9e62ef-3856-4428-b107-5702128f3f84 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:13.118467 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9e62ef-3856-4428-b107-5702128f3f84 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:13.118950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9e62ef-3856-4428-b107-5702128f3f84 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:13.119390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9e62ef-3856-4428-b107-5702128f3f84 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:13.120073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9e62ef-3856-4428-b107-5702128f3f84 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:13.120531 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9e62ef-3856-4428-b107-5702128f3f84 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:13.120957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3f9e62ef-3856-4428-b107-5702128f3f84 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:13.250626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3f9e62ef-3856-4428-b107-5702128f3f84 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:13.258972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3f9e62ef-3856-4428-b107-5702128f3f84 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151034 Aug 08 09:12:13.259724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1085/2070] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:13 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:13.452385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-03ffe737-5d8f-42ef-8edd-c8f63700fedb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:13.452999 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-03ffe737-5d8f-42ef-8edd-c8f63700fedb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:13.459019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03ffe737-5d8f-42ef-8edd-c8f63700fedb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:13.459513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03ffe737-5d8f-42ef-8edd-c8f63700fedb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:13.459959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03ffe737-5d8f-42ef-8edd-c8f63700fedb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:13.460651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03ffe737-5d8f-42ef-8edd-c8f63700fedb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:13.461115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03ffe737-5d8f-42ef-8edd-c8f63700fedb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:13.461666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-03ffe737-5d8f-42ef-8edd-c8f63700fedb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:13.522786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-03ffe737-5d8f-42ef-8edd-c8f63700fedb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:13.530233 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-03ffe737-5d8f-42ef-8edd-c8f63700fedb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081708 Aug 08 09:12:13.530786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 986/2071] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:13 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:13.611383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5db127d2-1048-4c4d-be3c-e71fafd6d3e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:13.611993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5db127d2-1048-4c4d-be3c-e71fafd6d3e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:13.619092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5db127d2-1048-4c4d-be3c-e71fafd6d3e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:13.619565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5db127d2-1048-4c4d-be3c-e71fafd6d3e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:13.619996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5db127d2-1048-4c4d-be3c-e71fafd6d3e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:13.620673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5db127d2-1048-4c4d-be3c-e71fafd6d3e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:13.621123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5db127d2-1048-4c4d-be3c-e71fafd6d3e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:13.621565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5db127d2-1048-4c4d-be3c-e71fafd6d3e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:13.625436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:13.682015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5db127d2-1048-4c4d-be3c-e71fafd6d3e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:13.690213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5db127d2-1048-4c4d-be3c-e71fafd6d3e8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082622 Aug 08 09:12:13.690773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1086/2072] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:14.280294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-de8740d5-8e53-462a-80e6-336eca78b437 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:14.280907 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-de8740d5-8e53-462a-80e6-336eca78b437 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:14.286877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de8740d5-8e53-462a-80e6-336eca78b437 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:14.287365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de8740d5-8e53-462a-80e6-336eca78b437 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:14.287803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de8740d5-8e53-462a-80e6-336eca78b437 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:14.288490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de8740d5-8e53-462a-80e6-336eca78b437 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:14.288951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de8740d5-8e53-462a-80e6-336eca78b437 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:14.290029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de8740d5-8e53-462a-80e6-336eca78b437 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:14.414972 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-de8740d5-8e53-462a-80e6-336eca78b437 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:14.423094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-de8740d5-8e53-462a-80e6-336eca78b437 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.146672 Aug 08 09:12:14.423667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 987/2073] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:14 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:14.551072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a818335f-c22a-4609-9584-fdeb8efda1df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:14.551646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a818335f-c22a-4609-9584-fdeb8efda1df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:14.558198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a818335f-c22a-4609-9584-fdeb8efda1df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:14.558689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a818335f-c22a-4609-9584-fdeb8efda1df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:14.559131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a818335f-c22a-4609-9584-fdeb8efda1df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:14.559828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a818335f-c22a-4609-9584-fdeb8efda1df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:14.560286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a818335f-c22a-4609-9584-fdeb8efda1df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:14.560757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a818335f-c22a-4609-9584-fdeb8efda1df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:14.622724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a818335f-c22a-4609-9584-fdeb8efda1df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:14.630172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a818335f-c22a-4609-9584-fdeb8efda1df tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083081 Aug 08 09:12:14.630738 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1087/2074] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:14 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:14.712072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-23761943-7d73-47f3-b16f-ac47ec691e1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:14.712828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-23761943-7d73-47f3-b16f-ac47ec691e1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:14.719172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23761943-7d73-47f3-b16f-ac47ec691e1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:14.719660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23761943-7d73-47f3-b16f-ac47ec691e1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:14.720098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23761943-7d73-47f3-b16f-ac47ec691e1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:14.720789 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23761943-7d73-47f3-b16f-ac47ec691e1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:14.721288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23761943-7d73-47f3-b16f-ac47ec691e1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:14.721718 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-23761943-7d73-47f3-b16f-ac47ec691e1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:14.782564 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-23761943-7d73-47f3-b16f-ac47ec691e1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:14.790471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-23761943-7d73-47f3-b16f-ac47ec691e1f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082978 Aug 08 09:12:14.791036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 988/2075] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:15.443871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0f2b9148-5d31-4bf8-9a61-c14a3ceb6e3b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:15.444512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0f2b9148-5d31-4bf8-9a61-c14a3ceb6e3b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:15.450890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f2b9148-5d31-4bf8-9a61-c14a3ceb6e3b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:15.451372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f2b9148-5d31-4bf8-9a61-c14a3ceb6e3b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:15.451811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f2b9148-5d31-4bf8-9a61-c14a3ceb6e3b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:15.452492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f2b9148-5d31-4bf8-9a61-c14a3ceb6e3b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:15.452954 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f2b9148-5d31-4bf8-9a61-c14a3ceb6e3b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:15.453410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f2b9148-5d31-4bf8-9a61-c14a3ceb6e3b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:15.578968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0f2b9148-5d31-4bf8-9a61-c14a3ceb6e3b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:15.587543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0f2b9148-5d31-4bf8-9a61-c14a3ceb6e3b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.147495 Aug 08 09:12:15.588102 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1088/2076] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:15 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:15.651645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a4f00b53-1c05-4644-9556-58777d66498a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:15.652257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a4f00b53-1c05-4644-9556-58777d66498a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:15.658207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4f00b53-1c05-4644-9556-58777d66498a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:15.658696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4f00b53-1c05-4644-9556-58777d66498a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:15.659142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4f00b53-1c05-4644-9556-58777d66498a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:15.659835 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4f00b53-1c05-4644-9556-58777d66498a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:15.660293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4f00b53-1c05-4644-9556-58777d66498a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:15.660725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a4f00b53-1c05-4644-9556-58777d66498a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:15.723128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a4f00b53-1c05-4644-9556-58777d66498a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:15.730564 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a4f00b53-1c05-4644-9556-58777d66498a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083007 Aug 08 09:12:15.731125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 989/2077] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:15 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:15.811439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ab3b6900-d570-433e-a7c2-456bb3a73735 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:15.812049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ab3b6900-d570-433e-a7c2-456bb3a73735 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:15.818348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3b6900-d570-433e-a7c2-456bb3a73735 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:15.818821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3b6900-d570-433e-a7c2-456bb3a73735 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:15.819252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3b6900-d570-433e-a7c2-456bb3a73735 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:15.819930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3b6900-d570-433e-a7c2-456bb3a73735 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:15.820380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3b6900-d570-433e-a7c2-456bb3a73735 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:15.821423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab3b6900-d570-433e-a7c2-456bb3a73735 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:15.880656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ab3b6900-d570-433e-a7c2-456bb3a73735 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:15.889564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ab3b6900-d570-433e-a7c2-456bb3a73735 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081969 Aug 08 09:12:15.890128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1089/2078] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:15 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:16.608596 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b9141e94-fa96-41a1-8d87-41a80cf3bec4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:16.609123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b9141e94-fa96-41a1-8d87-41a80cf3bec4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:16.615068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9141e94-fa96-41a1-8d87-41a80cf3bec4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:16.615554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9141e94-fa96-41a1-8d87-41a80cf3bec4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:16.615993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9141e94-fa96-41a1-8d87-41a80cf3bec4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:16.616689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9141e94-fa96-41a1-8d87-41a80cf3bec4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:16.617163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9141e94-fa96-41a1-8d87-41a80cf3bec4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:16.617621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b9141e94-fa96-41a1-8d87-41a80cf3bec4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:16.743106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b9141e94-fa96-41a1-8d87-41a80cf3bec4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:16.751151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b9141e94-fa96-41a1-8d87-41a80cf3bec4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.146473 Aug 08 09:12:16.751475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dcf896d1-f49a-4a5b-937b-9d8ee149679b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:16.751725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 990/2079] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:16 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:16.752100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dcf896d1-f49a-4a5b-937b-9d8ee149679b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:16.758619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcf896d1-f49a-4a5b-937b-9d8ee149679b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:16.759109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcf896d1-f49a-4a5b-937b-9d8ee149679b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:16.759547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcf896d1-f49a-4a5b-937b-9d8ee149679b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:16.760238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcf896d1-f49a-4a5b-937b-9d8ee149679b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:16.760696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcf896d1-f49a-4a5b-937b-9d8ee149679b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:16.761128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcf896d1-f49a-4a5b-937b-9d8ee149679b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:16.821603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-dcf896d1-f49a-4a5b-937b-9d8ee149679b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:16.829055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dcf896d1-f49a-4a5b-937b-9d8ee149679b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081462 Aug 08 09:12:16.829646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1090/2080] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:16 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:16.910160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bf1696b1-51df-48c5-b64a-0c76f1c67c2b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:16.910778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bf1696b1-51df-48c5-b64a-0c76f1c67c2b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:16.916902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf1696b1-51df-48c5-b64a-0c76f1c67c2b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:16.917414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf1696b1-51df-48c5-b64a-0c76f1c67c2b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:16.917857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf1696b1-51df-48c5-b64a-0c76f1c67c2b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:16.918546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf1696b1-51df-48c5-b64a-0c76f1c67c2b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:16.919003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf1696b1-51df-48c5-b64a-0c76f1c67c2b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:16.919436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bf1696b1-51df-48c5-b64a-0c76f1c67c2b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:16.982814 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bf1696b1-51df-48c5-b64a-0c76f1c67c2b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:16.990699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bf1696b1-51df-48c5-b64a-0c76f1c67c2b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084383 Aug 08 09:12:16.991256 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 991/2081] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:17.772613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8625dfe2-d6a1-4e24-8022-4a9115b2bace tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:17.773186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8625dfe2-d6a1-4e24-8022-4a9115b2bace tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:17.779985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8625dfe2-d6a1-4e24-8022-4a9115b2bace tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:17.780541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8625dfe2-d6a1-4e24-8022-4a9115b2bace tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:17.780977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8625dfe2-d6a1-4e24-8022-4a9115b2bace tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:17.781679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8625dfe2-d6a1-4e24-8022-4a9115b2bace tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:17.782131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8625dfe2-d6a1-4e24-8022-4a9115b2bace tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:17.782553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8625dfe2-d6a1-4e24-8022-4a9115b2bace tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:17.851104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5a658e73-d649-453d-a3ad-be9540eb9a8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:17.851884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5a658e73-d649-453d-a3ad-be9540eb9a8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:17.858488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a658e73-d649-453d-a3ad-be9540eb9a8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:17.858845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a658e73-d649-453d-a3ad-be9540eb9a8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:17.859286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a658e73-d649-453d-a3ad-be9540eb9a8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:17.860194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a658e73-d649-453d-a3ad-be9540eb9a8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:17.860672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a658e73-d649-453d-a3ad-be9540eb9a8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:17.861089 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5a658e73-d649-453d-a3ad-be9540eb9a8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:17.932367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5a658e73-d649-453d-a3ad-be9540eb9a8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:17.936162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8625dfe2-d6a1-4e24-8022-4a9115b2bace tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:17.939834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5a658e73-d649-453d-a3ad-be9540eb9a8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.092608 Aug 08 09:12:17.944931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 992/2082] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:17 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:17.945112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8625dfe2-d6a1-4e24-8022-4a9115b2bace tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.175463 Aug 08 09:12:17.945112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1091/2083] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:17 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:18.011881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-54239b67-4894-44f6-a763-a6bf8ad3e7dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:18.012494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-54239b67-4894-44f6-a763-a6bf8ad3e7dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:18.018595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54239b67-4894-44f6-a763-a6bf8ad3e7dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:18.019084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54239b67-4894-44f6-a763-a6bf8ad3e7dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:18.019527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54239b67-4894-44f6-a763-a6bf8ad3e7dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:18.020218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54239b67-4894-44f6-a763-a6bf8ad3e7dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:18.020679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54239b67-4894-44f6-a763-a6bf8ad3e7dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:18.021110 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-54239b67-4894-44f6-a763-a6bf8ad3e7dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:18.080999 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-54239b67-4894-44f6-a763-a6bf8ad3e7dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:18.089355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-54239b67-4894-44f6-a763-a6bf8ad3e7dd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081714 Aug 08 09:12:18.089923 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 993/2084] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:18 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:18.960189 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5379105c-50ee-4d78-b4aa-18834f979f3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:18.960815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5379105c-50ee-4d78-b4aa-18834f979f3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:18.965786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f54d5e17-fb4e-411a-89f8-9b9db4c40a5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:18.966413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f54d5e17-fb4e-411a-89f8-9b9db4c40a5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:18.968285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5379105c-50ee-4d78-b4aa-18834f979f3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:18.968776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5379105c-50ee-4d78-b4aa-18834f979f3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:18.969247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5379105c-50ee-4d78-b4aa-18834f979f3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:18.969942 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5379105c-50ee-4d78-b4aa-18834f979f3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:18.970399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5379105c-50ee-4d78-b4aa-18834f979f3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:18.970825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5379105c-50ee-4d78-b4aa-18834f979f3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:18.972743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f54d5e17-fb4e-411a-89f8-9b9db4c40a5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:18.973258 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f54d5e17-fb4e-411a-89f8-9b9db4c40a5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:18.973700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f54d5e17-fb4e-411a-89f8-9b9db4c40a5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:18.974396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f54d5e17-fb4e-411a-89f8-9b9db4c40a5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:18.974853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f54d5e17-fb4e-411a-89f8-9b9db4c40a5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:18.975278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f54d5e17-fb4e-411a-89f8-9b9db4c40a5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:19.060356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5379105c-50ee-4d78-b4aa-18834f979f3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:19.067868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5379105c-50ee-4d78-b4aa-18834f979f3d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.111574 Aug 08 09:12:19.068426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1092/2085] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:18 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:19.110207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-623b9638-2c68-405a-b69e-ba0aa5ea92ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:19.110818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-623b9638-2c68-405a-b69e-ba0aa5ea92ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:19.116629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-623b9638-2c68-405a-b69e-ba0aa5ea92ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:19.117112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-623b9638-2c68-405a-b69e-ba0aa5ea92ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:19.117704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-623b9638-2c68-405a-b69e-ba0aa5ea92ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:19.118414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-623b9638-2c68-405a-b69e-ba0aa5ea92ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:19.118865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-623b9638-2c68-405a-b69e-ba0aa5ea92ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:19.119290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-623b9638-2c68-405a-b69e-ba0aa5ea92ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:19.129597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f54d5e17-fb4e-411a-89f8-9b9db4c40a5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:19.138902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f54d5e17-fb4e-411a-89f8-9b9db4c40a5c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.177193 Aug 08 09:12:19.139533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 994/2086] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:18 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:19.183059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-623b9638-2c68-405a-b69e-ba0aa5ea92ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:19.190946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-623b9638-2c68-405a-b69e-ba0aa5ea92ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084601 Aug 08 09:12:19.191495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1093/2087] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:19 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:20.089411 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-238dbe51-44f0-408d-856d-e4119b29bbdb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:20.090071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-238dbe51-44f0-408d-856d-e4119b29bbdb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:20.097118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-238dbe51-44f0-408d-856d-e4119b29bbdb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:20.097630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-238dbe51-44f0-408d-856d-e4119b29bbdb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:20.098063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-238dbe51-44f0-408d-856d-e4119b29bbdb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:20.098748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-238dbe51-44f0-408d-856d-e4119b29bbdb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:20.099200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-238dbe51-44f0-408d-856d-e4119b29bbdb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:20.099623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-238dbe51-44f0-408d-856d-e4119b29bbdb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:20.159938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f1db7fd0-8d45-48fb-aa38-cb44b862cad2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:20.160551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f1db7fd0-8d45-48fb-aa38-cb44b862cad2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:20.167252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1db7fd0-8d45-48fb-aa38-cb44b862cad2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:20.167739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1db7fd0-8d45-48fb-aa38-cb44b862cad2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:20.168210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1db7fd0-8d45-48fb-aa38-cb44b862cad2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:20.168909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1db7fd0-8d45-48fb-aa38-cb44b862cad2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:20.169035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-238dbe51-44f0-408d-856d-e4119b29bbdb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:20.169391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1db7fd0-8d45-48fb-aa38-cb44b862cad2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:20.169819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f1db7fd0-8d45-48fb-aa38-cb44b862cad2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:20.176627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-238dbe51-44f0-408d-856d-e4119b29bbdb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.091774 Aug 08 09:12:20.177231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 995/2088] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:20 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:20.212191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3950a638-9af5-4d62-a4d8-7dc2bba1b02a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:20.212830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3950a638-9af5-4d62-a4d8-7dc2bba1b02a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:20.219009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3950a638-9af5-4d62-a4d8-7dc2bba1b02a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:20.219501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3950a638-9af5-4d62-a4d8-7dc2bba1b02a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:20.219945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3950a638-9af5-4d62-a4d8-7dc2bba1b02a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:20.220644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3950a638-9af5-4d62-a4d8-7dc2bba1b02a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:20.221106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3950a638-9af5-4d62-a4d8-7dc2bba1b02a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:20.221559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3950a638-9af5-4d62-a4d8-7dc2bba1b02a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:20.292207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3950a638-9af5-4d62-a4d8-7dc2bba1b02a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:20.300294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3950a638-9af5-4d62-a4d8-7dc2bba1b02a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.092448 Aug 08 09:12:20.300859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 996/2089] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:20 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:20.321975 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f1db7fd0-8d45-48fb-aa38-cb44b862cad2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:20.329891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f1db7fd0-8d45-48fb-aa38-cb44b862cad2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.173854 Aug 08 09:12:20.330449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1094/2090] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:20 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:21.198229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-36761823-2d28-4a35-a503-3f461700ec62 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:21.198838 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-36761823-2d28-4a35-a503-3f461700ec62 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:21.205457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36761823-2d28-4a35-a503-3f461700ec62 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:21.205931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36761823-2d28-4a35-a503-3f461700ec62 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:21.206366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36761823-2d28-4a35-a503-3f461700ec62 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:21.207052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36761823-2d28-4a35-a503-3f461700ec62 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:21.207505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36761823-2d28-4a35-a503-3f461700ec62 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:21.207928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-36761823-2d28-4a35-a503-3f461700ec62 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:21.271198 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-36761823-2d28-4a35-a503-3f461700ec62 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:21.279383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-36761823-2d28-4a35-a503-3f461700ec62 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085356 Aug 08 09:12:21.279943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 997/2091] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:21 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:21.322041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-42897a32-e0d5-4b78-a1ea-fa17eef8d4d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:21.322655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-42897a32-e0d5-4b78-a1ea-fa17eef8d4d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:21.328953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42897a32-e0d5-4b78-a1ea-fa17eef8d4d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:21.329468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42897a32-e0d5-4b78-a1ea-fa17eef8d4d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:21.329910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42897a32-e0d5-4b78-a1ea-fa17eef8d4d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:21.330601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42897a32-e0d5-4b78-a1ea-fa17eef8d4d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:21.331053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42897a32-e0d5-4b78-a1ea-fa17eef8d4d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:21.331479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-42897a32-e0d5-4b78-a1ea-fa17eef8d4d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:21.351466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-842dc44f-c337-4614-8219-2ee12c0a0fcb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:21.352104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-842dc44f-c337-4614-8219-2ee12c0a0fcb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:21.358013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-842dc44f-c337-4614-8219-2ee12c0a0fcb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:21.358506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-842dc44f-c337-4614-8219-2ee12c0a0fcb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:21.358947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-842dc44f-c337-4614-8219-2ee12c0a0fcb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:21.359638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-842dc44f-c337-4614-8219-2ee12c0a0fcb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:21.360098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-842dc44f-c337-4614-8219-2ee12c0a0fcb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:21.360528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-842dc44f-c337-4614-8219-2ee12c0a0fcb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:21.394692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-42897a32-e0d5-4b78-a1ea-fa17eef8d4d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:21.403360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-42897a32-e0d5-4b78-a1ea-fa17eef8d4d7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085564 Aug 08 09:12:21.403944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1095/2092] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:21 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:21.736799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-842dc44f-c337-4614-8219-2ee12c0a0fcb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:21.745553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-842dc44f-c337-4614-8219-2ee12c0a0fcb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.397830 Aug 08 09:12:21.746127 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 998/2093] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:21 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:22.301256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ce1a3c26-55b8-45d0-bf49-9359bf3ba648 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:22.301899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ce1a3c26-55b8-45d0-bf49-9359bf3ba648 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:22.308018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce1a3c26-55b8-45d0-bf49-9359bf3ba648 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:22.308500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce1a3c26-55b8-45d0-bf49-9359bf3ba648 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:22.308939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce1a3c26-55b8-45d0-bf49-9359bf3ba648 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:22.309659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce1a3c26-55b8-45d0-bf49-9359bf3ba648 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:22.310120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce1a3c26-55b8-45d0-bf49-9359bf3ba648 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:22.310549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ce1a3c26-55b8-45d0-bf49-9359bf3ba648 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:22.372059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ce1a3c26-55b8-45d0-bf49-9359bf3ba648 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:22.379513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ce1a3c26-55b8-45d0-bf49-9359bf3ba648 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082116 Aug 08 09:12:22.380063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1096/2094] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:22 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:22.424188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-89bb7155-f703-452e-8b02-a5ecd2812696 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:22.424868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-89bb7155-f703-452e-8b02-a5ecd2812696 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:22.431830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89bb7155-f703-452e-8b02-a5ecd2812696 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:22.432321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89bb7155-f703-452e-8b02-a5ecd2812696 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:22.435335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89bb7155-f703-452e-8b02-a5ecd2812696 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:22.435335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89bb7155-f703-452e-8b02-a5ecd2812696 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:22.435335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89bb7155-f703-452e-8b02-a5ecd2812696 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:22.435335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89bb7155-f703-452e-8b02-a5ecd2812696 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:22.495310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-89bb7155-f703-452e-8b02-a5ecd2812696 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:22.503303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-89bb7155-f703-452e-8b02-a5ecd2812696 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083000 Aug 08 09:12:22.503810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 999/2095] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:22.766222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-048dd1ac-76fb-4d8d-b165-d1312631e5a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:22.766758 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-048dd1ac-76fb-4d8d-b165-d1312631e5a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:22.772641 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-048dd1ac-76fb-4d8d-b165-d1312631e5a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:22.773124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-048dd1ac-76fb-4d8d-b165-d1312631e5a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:22.773622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-048dd1ac-76fb-4d8d-b165-d1312631e5a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:22.774544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-048dd1ac-76fb-4d8d-b165-d1312631e5a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:22.775003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-048dd1ac-76fb-4d8d-b165-d1312631e5a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:22.775426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-048dd1ac-76fb-4d8d-b165-d1312631e5a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:22.902477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-048dd1ac-76fb-4d8d-b165-d1312631e5a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:22.910297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-048dd1ac-76fb-4d8d-b165-d1312631e5a6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.148302 Aug 08 09:12:22.910860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1097/2096] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:22 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:23.400518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-12f77b63-d66f-44b9-abbd-bcb3b7d22985 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:23.401318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-12f77b63-d66f-44b9-abbd-bcb3b7d22985 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:23.409020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12f77b63-d66f-44b9-abbd-bcb3b7d22985 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:23.409876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12f77b63-d66f-44b9-abbd-bcb3b7d22985 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:23.410346 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12f77b63-d66f-44b9-abbd-bcb3b7d22985 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:23.411197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12f77b63-d66f-44b9-abbd-bcb3b7d22985 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:23.411666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12f77b63-d66f-44b9-abbd-bcb3b7d22985 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:23.412143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-12f77b63-d66f-44b9-abbd-bcb3b7d22985 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:23.485963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-12f77b63-d66f-44b9-abbd-bcb3b7d22985 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:23.494235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-12f77b63-d66f-44b9-abbd-bcb3b7d22985 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.097729 Aug 08 09:12:23.495130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1000/2097] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:23 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:23.524576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fc1b92c0-2699-4d74-93a7-268d12167a1e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:23.525242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fc1b92c0-2699-4d74-93a7-268d12167a1e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:23.531677 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1b92c0-2699-4d74-93a7-268d12167a1e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:23.532166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1b92c0-2699-4d74-93a7-268d12167a1e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:23.532626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1b92c0-2699-4d74-93a7-268d12167a1e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:23.533357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1b92c0-2699-4d74-93a7-268d12167a1e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:23.533813 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1b92c0-2699-4d74-93a7-268d12167a1e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:23.534240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc1b92c0-2699-4d74-93a7-268d12167a1e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:23.602825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fc1b92c0-2699-4d74-93a7-268d12167a1e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:23.610876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fc1b92c0-2699-4d74-93a7-268d12167a1e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.090407 Aug 08 09:12:23.611446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1098/2098] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:23.931069 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-52594c44-83ba-4d61-8811-518f8127c28c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:23.931802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-52594c44-83ba-4d61-8811-518f8127c28c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:23.937868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52594c44-83ba-4d61-8811-518f8127c28c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:23.938290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52594c44-83ba-4d61-8811-518f8127c28c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:23.938723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52594c44-83ba-4d61-8811-518f8127c28c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:23.939413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52594c44-83ba-4d61-8811-518f8127c28c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:23.939869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52594c44-83ba-4d61-8811-518f8127c28c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:23.940292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52594c44-83ba-4d61-8811-518f8127c28c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:23.944333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:24.077310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-52594c44-83ba-4d61-8811-518f8127c28c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:24.087871 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-52594c44-83ba-4d61-8811-518f8127c28c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.160684 Aug 08 09:12:24.088442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1001/2099] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:23 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:24.515393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-32e195e8-1f58-44dd-be6d-1bae8ff5cbce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:24.515962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-32e195e8-1f58-44dd-be6d-1bae8ff5cbce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:24.522084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32e195e8-1f58-44dd-be6d-1bae8ff5cbce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:24.522573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32e195e8-1f58-44dd-be6d-1bae8ff5cbce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:24.523024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32e195e8-1f58-44dd-be6d-1bae8ff5cbce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:24.524293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32e195e8-1f58-44dd-be6d-1bae8ff5cbce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:24.524852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32e195e8-1f58-44dd-be6d-1bae8ff5cbce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:24.525511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-32e195e8-1f58-44dd-be6d-1bae8ff5cbce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:24.587359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-32e195e8-1f58-44dd-be6d-1bae8ff5cbce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:24.594807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-32e195e8-1f58-44dd-be6d-1bae8ff5cbce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083617 Aug 08 09:12:24.595370 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1099/2100] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:24 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:24.633721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d1bda482-0365-45e9-8ef2-6a05bccc7eb7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:24.634345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d1bda482-0365-45e9-8ef2-6a05bccc7eb7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:24.640958 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1bda482-0365-45e9-8ef2-6a05bccc7eb7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:24.641494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1bda482-0365-45e9-8ef2-6a05bccc7eb7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:24.641934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1bda482-0365-45e9-8ef2-6a05bccc7eb7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:24.642627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1bda482-0365-45e9-8ef2-6a05bccc7eb7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:24.643088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1bda482-0365-45e9-8ef2-6a05bccc7eb7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:24.643517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d1bda482-0365-45e9-8ef2-6a05bccc7eb7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:24.703539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d1bda482-0365-45e9-8ef2-6a05bccc7eb7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:24.711466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d1bda482-0365-45e9-8ef2-6a05bccc7eb7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082097 Aug 08 09:12:24.712029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1002/2101] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:24 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:25.120353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-db5e0afe-3030-406b-aee5-bcb70c347d51 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:25.120966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-db5e0afe-3030-406b-aee5-bcb70c347d51 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:25.127097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-db5e0afe-3030-406b-aee5-bcb70c347d51 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:25.127588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-db5e0afe-3030-406b-aee5-bcb70c347d51 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:25.128032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-db5e0afe-3030-406b-aee5-bcb70c347d51 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:25.128759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-db5e0afe-3030-406b-aee5-bcb70c347d51 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:25.129255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-db5e0afe-3030-406b-aee5-bcb70c347d51 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:25.129689 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-db5e0afe-3030-406b-aee5-bcb70c347d51 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:25.259764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-db5e0afe-3030-406b-aee5-bcb70c347d51 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:25.267900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-db5e0afe-3030-406b-aee5-bcb70c347d51 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.151963 Aug 08 09:12:25.268456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1100/2102] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:25 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:25.615599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-329b88cb-bbe5-4d20-b309-1239c1ade199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:25.616241 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-329b88cb-bbe5-4d20-b309-1239c1ade199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:25.622339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-329b88cb-bbe5-4d20-b309-1239c1ade199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:25.622820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-329b88cb-bbe5-4d20-b309-1239c1ade199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:25.623254 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-329b88cb-bbe5-4d20-b309-1239c1ade199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:25.623936 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-329b88cb-bbe5-4d20-b309-1239c1ade199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:25.624388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-329b88cb-bbe5-4d20-b309-1239c1ade199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:25.624811 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-329b88cb-bbe5-4d20-b309-1239c1ade199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:25.686170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-329b88cb-bbe5-4d20-b309-1239c1ade199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:25.693569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-329b88cb-bbe5-4d20-b309-1239c1ade199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081794 Aug 08 09:12:25.694122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1003/2103] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:25 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:25.731976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bd405acb-9b83-4fd8-81a2-049603e967cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:25.732628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bd405acb-9b83-4fd8-81a2-049603e967cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:25.739043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd405acb-9b83-4fd8-81a2-049603e967cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:25.739524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd405acb-9b83-4fd8-81a2-049603e967cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:25.739962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd405acb-9b83-4fd8-81a2-049603e967cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:25.740645 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd405acb-9b83-4fd8-81a2-049603e967cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:25.741100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd405acb-9b83-4fd8-81a2-049603e967cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:25.741551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bd405acb-9b83-4fd8-81a2-049603e967cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:25.803170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bd405acb-9b83-4fd8-81a2-049603e967cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:25.811186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bd405acb-9b83-4fd8-81a2-049603e967cf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082820 Aug 08 09:12:25.812135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1101/2104] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:26.288694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-75a501cd-aaf0-418f-8ff1-afe59492d32c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:26.289406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-75a501cd-aaf0-418f-8ff1-afe59492d32c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:26.295486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75a501cd-aaf0-418f-8ff1-afe59492d32c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:26.300321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75a501cd-aaf0-418f-8ff1-afe59492d32c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:26.300321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75a501cd-aaf0-418f-8ff1-afe59492d32c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:26.300321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75a501cd-aaf0-418f-8ff1-afe59492d32c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:26.300321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75a501cd-aaf0-418f-8ff1-afe59492d32c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:26.300807 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-75a501cd-aaf0-418f-8ff1-afe59492d32c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:26.428414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-75a501cd-aaf0-418f-8ff1-afe59492d32c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:26.437063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-75a501cd-aaf0-418f-8ff1-afe59492d32c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.152306 Aug 08 09:12:26.437664 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1004/2105] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:26 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:26.714429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cf056886-35da-47fa-a684-9b38bfe4141f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:26.715037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cf056886-35da-47fa-a684-9b38bfe4141f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:26.720872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf056886-35da-47fa-a684-9b38bfe4141f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:26.721378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf056886-35da-47fa-a684-9b38bfe4141f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:26.721845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf056886-35da-47fa-a684-9b38bfe4141f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:26.722525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf056886-35da-47fa-a684-9b38bfe4141f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:26.722967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf056886-35da-47fa-a684-9b38bfe4141f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:26.723384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf056886-35da-47fa-a684-9b38bfe4141f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:26.784290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cf056886-35da-47fa-a684-9b38bfe4141f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:26.787602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:26.792359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cf056886-35da-47fa-a684-9b38bfe4141f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081747 Aug 08 09:12:26.792915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1102/2106] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:26 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:26.831682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-29ae20c0-98ba-4d43-b42d-b56fa06b21c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:26.832297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-29ae20c0-98ba-4d43-b42d-b56fa06b21c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:26.840341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-29ae20c0-98ba-4d43-b42d-b56fa06b21c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:26.840830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-29ae20c0-98ba-4d43-b42d-b56fa06b21c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:26.841307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-29ae20c0-98ba-4d43-b42d-b56fa06b21c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:26.842005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-29ae20c0-98ba-4d43-b42d-b56fa06b21c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:26.842467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-29ae20c0-98ba-4d43-b42d-b56fa06b21c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:26.842896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-29ae20c0-98ba-4d43-b42d-b56fa06b21c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:26.903763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-29ae20c0-98ba-4d43-b42d-b56fa06b21c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:26.911577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-29ae20c0-98ba-4d43-b42d-b56fa06b21c1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083788 Aug 08 09:12:26.912136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1005/2107] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:27.458827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-45bb1286-1620-4c5e-b158-ef5d1e2199b6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:27.459442 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-45bb1286-1620-4c5e-b158-ef5d1e2199b6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:27.465921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45bb1286-1620-4c5e-b158-ef5d1e2199b6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:27.466397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45bb1286-1620-4c5e-b158-ef5d1e2199b6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:27.466834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45bb1286-1620-4c5e-b158-ef5d1e2199b6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:27.467511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45bb1286-1620-4c5e-b158-ef5d1e2199b6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:27.467961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45bb1286-1620-4c5e-b158-ef5d1e2199b6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:27.468382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-45bb1286-1620-4c5e-b158-ef5d1e2199b6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:27.602299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-45bb1286-1620-4c5e-b158-ef5d1e2199b6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:27.610224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-45bb1286-1620-4c5e-b158-ef5d1e2199b6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1560 microversion: 2.1 time: 0.155349 Aug 08 09:12:27.610778 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1103/2108] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:27 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:27.817097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bed20142-7b87-4e29-8e40-1a544820b3c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:27.817656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bed20142-7b87-4e29-8e40-1a544820b3c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:27.823649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bed20142-7b87-4e29-8e40-1a544820b3c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:27.824144 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bed20142-7b87-4e29-8e40-1a544820b3c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:27.824586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bed20142-7b87-4e29-8e40-1a544820b3c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:27.825381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bed20142-7b87-4e29-8e40-1a544820b3c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:27.825846 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bed20142-7b87-4e29-8e40-1a544820b3c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:27.826278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bed20142-7b87-4e29-8e40-1a544820b3c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:27.889167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bed20142-7b87-4e29-8e40-1a544820b3c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:27.896697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bed20142-7b87-4e29-8e40-1a544820b3c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083586 Aug 08 09:12:27.897271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1006/2109] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:27 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:27.932015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c334771f-e8c9-472e-a343-c92642650645 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:27.932619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c334771f-e8c9-472e-a343-c92642650645 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:27.939010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c334771f-e8c9-472e-a343-c92642650645 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:27.939490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c334771f-e8c9-472e-a343-c92642650645 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:27.939922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c334771f-e8c9-472e-a343-c92642650645 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:27.940599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c334771f-e8c9-472e-a343-c92642650645 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:27.941046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c334771f-e8c9-472e-a343-c92642650645 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:27.941490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c334771f-e8c9-472e-a343-c92642650645 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:28.001591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c334771f-e8c9-472e-a343-c92642650645 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:28.010097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c334771f-e8c9-472e-a343-c92642650645 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081921 Aug 08 09:12:28.010650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1104/2110] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:27 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:28.631929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-67894f25-8449-4ec1-ae79-bbec81cd0039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:28.632556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-67894f25-8449-4ec1-ae79-bbec81cd0039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:28.639549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67894f25-8449-4ec1-ae79-bbec81cd0039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:28.640340 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67894f25-8449-4ec1-ae79-bbec81cd0039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:28.640852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67894f25-8449-4ec1-ae79-bbec81cd0039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:28.641608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67894f25-8449-4ec1-ae79-bbec81cd0039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:28.642074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67894f25-8449-4ec1-ae79-bbec81cd0039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:28.642510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67894f25-8449-4ec1-ae79-bbec81cd0039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:28.698378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-129d7c86-2f87-4e93-a4fd-12e6adfea18c req-5044c922-f012-4b72-9094-ac96d71f3730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a22a3234-6e6a-4901-a390-8e621ef8134f", "name": "network-vif-deleted", "tag": "7af76892-bfb7-446e-acfa-8d90f914ba2f"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 09:12:28.708174 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-129d7c86-2f87-4e93-a4fd-12e6adfea18c req-5044c922-f012-4b72-9094-ac96d71f3730 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:28.708658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-129d7c86-2f87-4e93-a4fd-12e6adfea18c req-5044c922-f012-4b72-9094-ac96d71f3730 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:28.709093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-129d7c86-2f87-4e93-a4fd-12e6adfea18c req-5044c922-f012-4b72-9094-ac96d71f3730 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:28.716305 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-67894f25-8449-4ec1-ae79-bbec81cd0039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:28.720746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-129d7c86-2f87-4e93-a4fd-12e6adfea18c req-5044c922-f012-4b72-9094-ac96d71f3730 service nova] Creating event network-vif-deleted:7af76892-bfb7-446e-acfa-8d90f914ba2f for instance a22a3234-6e6a-4901-a390-8e621ef8134f on hv-cinder-83697 Aug 08 09:12:28.724715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-67894f25-8449-4ec1-ae79-bbec81cd0039 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1518 microversion: 2.1 time: 0.096638 Aug 08 09:12:28.727006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1007/2111] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:28 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1518 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:28.727138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-129d7c86-2f87-4e93-a4fd-12e6adfea18c req-5044c922-f012-4b72-9094-ac96d71f3730 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032541 Aug 08 09:12:28.727138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1105/2112] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 09:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 09:12:28.918781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c583f61c-04ee-4507-8c32-d0246f20fb25 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:28.919381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c583f61c-04ee-4507-8c32-d0246f20fb25 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:28.931094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c583f61c-04ee-4507-8c32-d0246f20fb25 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:28.931598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c583f61c-04ee-4507-8c32-d0246f20fb25 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:28.932046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c583f61c-04ee-4507-8c32-d0246f20fb25 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:28.932757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c583f61c-04ee-4507-8c32-d0246f20fb25 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:28.933249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c583f61c-04ee-4507-8c32-d0246f20fb25 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:28.933691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c583f61c-04ee-4507-8c32-d0246f20fb25 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:28.994878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c583f61c-04ee-4507-8c32-d0246f20fb25 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:29.002351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c583f61c-04ee-4507-8c32-d0246f20fb25 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087963 Aug 08 09:12:29.002909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1008/2113] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:28 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:29.031831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b5201de6-1fc8-4217-8e6d-be2a03d2db34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:29.032532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b5201de6-1fc8-4217-8e6d-be2a03d2db34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:29.038550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5201de6-1fc8-4217-8e6d-be2a03d2db34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:29.039553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5201de6-1fc8-4217-8e6d-be2a03d2db34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:29.040149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5201de6-1fc8-4217-8e6d-be2a03d2db34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:29.040916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5201de6-1fc8-4217-8e6d-be2a03d2db34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:29.041407 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5201de6-1fc8-4217-8e6d-be2a03d2db34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:29.041833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b5201de6-1fc8-4217-8e6d-be2a03d2db34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:29.105810 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b5201de6-1fc8-4217-8e6d-be2a03d2db34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:29.113751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b5201de6-1fc8-4217-8e6d-be2a03d2db34 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086501 Aug 08 09:12:29.114324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1106/2114] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:29 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:29.746185 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1cb1f206-1953-46fe-9490-a13a9f2a8b59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:29.746750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1cb1f206-1953-46fe-9490-a13a9f2a8b59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:29.752629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cb1f206-1953-46fe-9490-a13a9f2a8b59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:29.753105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cb1f206-1953-46fe-9490-a13a9f2a8b59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:29.753569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cb1f206-1953-46fe-9490-a13a9f2a8b59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:29.754252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cb1f206-1953-46fe-9490-a13a9f2a8b59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:29.754703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cb1f206-1953-46fe-9490-a13a9f2a8b59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:29.755123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cb1f206-1953-46fe-9490-a13a9f2a8b59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:29.816014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1cb1f206-1953-46fe-9490-a13a9f2a8b59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:29.824621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1cb1f206-1953-46fe-9490-a13a9f2a8b59 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082392 Aug 08 09:12:29.825206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1009/2115] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:29 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:30.024174 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-aed2fa29-000c-4042-a236-58555cf66c68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:30.024679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-aed2fa29-000c-4042-a236-58555cf66c68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:30.031028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aed2fa29-000c-4042-a236-58555cf66c68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:30.031510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aed2fa29-000c-4042-a236-58555cf66c68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:30.031945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aed2fa29-000c-4042-a236-58555cf66c68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:30.032656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aed2fa29-000c-4042-a236-58555cf66c68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:30.033108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aed2fa29-000c-4042-a236-58555cf66c68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:30.033625 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aed2fa29-000c-4042-a236-58555cf66c68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:30.093307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-aed2fa29-000c-4042-a236-58555cf66c68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:30.100673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-aed2fa29-000c-4042-a236-58555cf66c68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.080718 Aug 08 09:12:30.101240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1107/2116] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:30 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:30.134441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a1331fca-088d-4732-b773-283e24078aa4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:30.135053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a1331fca-088d-4732-b773-283e24078aa4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:30.141748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1331fca-088d-4732-b773-283e24078aa4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:30.142239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1331fca-088d-4732-b773-283e24078aa4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:30.142680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1331fca-088d-4732-b773-283e24078aa4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:30.143404 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1331fca-088d-4732-b773-283e24078aa4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:30.144347 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1331fca-088d-4732-b773-283e24078aa4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:30.144781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a1331fca-088d-4732-b773-283e24078aa4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:30.206549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a1331fca-088d-4732-b773-283e24078aa4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:30.215040 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a1331fca-088d-4732-b773-283e24078aa4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084984 Aug 08 09:12:30.215606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1010/2117] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:30 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:30.844847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9360fe39-2fde-4a38-b47b-a6b9e3e9a7cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:30.845409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9360fe39-2fde-4a38-b47b-a6b9e3e9a7cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:30.851301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9360fe39-2fde-4a38-b47b-a6b9e3e9a7cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:30.852384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9360fe39-2fde-4a38-b47b-a6b9e3e9a7cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:30.852826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9360fe39-2fde-4a38-b47b-a6b9e3e9a7cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:30.853541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9360fe39-2fde-4a38-b47b-a6b9e3e9a7cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:30.854001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9360fe39-2fde-4a38-b47b-a6b9e3e9a7cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:30.854438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9360fe39-2fde-4a38-b47b-a6b9e3e9a7cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:30.917977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9360fe39-2fde-4a38-b47b-a6b9e3e9a7cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:30.925710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9360fe39-2fde-4a38-b47b-a6b9e3e9a7cb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.084846 Aug 08 09:12:30.926276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1108/2118] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:30 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:31.121213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-44e6d857-4e7f-4382-936a-dc9a1b927e06 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:31.121841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-44e6d857-4e7f-4382-936a-dc9a1b927e06 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:31.127685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44e6d857-4e7f-4382-936a-dc9a1b927e06 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:31.128168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44e6d857-4e7f-4382-936a-dc9a1b927e06 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:31.128604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44e6d857-4e7f-4382-936a-dc9a1b927e06 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:31.129324 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44e6d857-4e7f-4382-936a-dc9a1b927e06 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:31.129791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44e6d857-4e7f-4382-936a-dc9a1b927e06 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:31.130205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44e6d857-4e7f-4382-936a-dc9a1b927e06 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:31.191332 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-44e6d857-4e7f-4382-936a-dc9a1b927e06 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:31.199470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-44e6d857-4e7f-4382-936a-dc9a1b927e06 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082306 Aug 08 09:12:31.200031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1011/2119] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:31 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:31.235900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-71e1db5d-4085-4626-82de-4b0ecd032529 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:31.236507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-71e1db5d-4085-4626-82de-4b0ecd032529 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:31.242952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e1db5d-4085-4626-82de-4b0ecd032529 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:31.243440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e1db5d-4085-4626-82de-4b0ecd032529 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:31.243872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e1db5d-4085-4626-82de-4b0ecd032529 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:31.244550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e1db5d-4085-4626-82de-4b0ecd032529 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:31.244997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e1db5d-4085-4626-82de-4b0ecd032529 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:31.245440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-71e1db5d-4085-4626-82de-4b0ecd032529 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:31.308806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-71e1db5d-4085-4626-82de-4b0ecd032529 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:31.316908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-71e1db5d-4085-4626-82de-4b0ecd032529 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084733 Aug 08 09:12:31.317510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1109/2120] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:31 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:31.947202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8b9e080b-7605-43bc-bd9d-38f2b7b201fc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:31.947812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8b9e080b-7605-43bc-bd9d-38f2b7b201fc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:31.953803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b9e080b-7605-43bc-bd9d-38f2b7b201fc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:31.954281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b9e080b-7605-43bc-bd9d-38f2b7b201fc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:31.954713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b9e080b-7605-43bc-bd9d-38f2b7b201fc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:31.955394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b9e080b-7605-43bc-bd9d-38f2b7b201fc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:31.955845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b9e080b-7605-43bc-bd9d-38f2b7b201fc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:31.956272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8b9e080b-7605-43bc-bd9d-38f2b7b201fc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:32.017684 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8b9e080b-7605-43bc-bd9d-38f2b7b201fc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:32.026867 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8b9e080b-7605-43bc-bd9d-38f2b7b201fc tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083393 Aug 08 09:12:32.027589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1012/2121] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:31 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:32.220451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c6908bbc-c1f2-46a1-8dc7-dc994445c160 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:32.220981 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c6908bbc-c1f2-46a1-8dc7-dc994445c160 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:32.227434 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6908bbc-c1f2-46a1-8dc7-dc994445c160 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:32.227912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6908bbc-c1f2-46a1-8dc7-dc994445c160 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:32.228345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6908bbc-c1f2-46a1-8dc7-dc994445c160 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:32.229022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6908bbc-c1f2-46a1-8dc7-dc994445c160 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:32.229493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6908bbc-c1f2-46a1-8dc7-dc994445c160 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:32.229915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c6908bbc-c1f2-46a1-8dc7-dc994445c160 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:32.292439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c6908bbc-c1f2-46a1-8dc7-dc994445c160 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:32.299797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c6908bbc-c1f2-46a1-8dc7-dc994445c160 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083235 Aug 08 09:12:32.300339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1110/2122] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:32 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:32.338723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2a624842-c987-4486-ad5d-d94385bfff1a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:32.339334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2a624842-c987-4486-ad5d-d94385bfff1a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:32.345710 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a624842-c987-4486-ad5d-d94385bfff1a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:32.346192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a624842-c987-4486-ad5d-d94385bfff1a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:32.346629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a624842-c987-4486-ad5d-d94385bfff1a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:32.347319 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a624842-c987-4486-ad5d-d94385bfff1a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:32.347777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a624842-c987-4486-ad5d-d94385bfff1a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:32.348201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a624842-c987-4486-ad5d-d94385bfff1a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:32.409513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2a624842-c987-4486-ad5d-d94385bfff1a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:32.418918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2a624842-c987-4486-ad5d-d94385bfff1a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084385 Aug 08 09:12:32.419357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1013/2123] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:33.047761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dc504d45-3194-4f1c-a4fb-567e89b7bd2d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:33.048370 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dc504d45-3194-4f1c-a4fb-567e89b7bd2d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:33.054333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc504d45-3194-4f1c-a4fb-567e89b7bd2d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:33.055374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc504d45-3194-4f1c-a4fb-567e89b7bd2d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:33.055851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc504d45-3194-4f1c-a4fb-567e89b7bd2d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:33.056560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc504d45-3194-4f1c-a4fb-567e89b7bd2d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:33.057012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc504d45-3194-4f1c-a4fb-567e89b7bd2d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:33.057466 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dc504d45-3194-4f1c-a4fb-567e89b7bd2d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:33.118988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-dc504d45-3194-4f1c-a4fb-567e89b7bd2d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:33.127050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dc504d45-3194-4f1c-a4fb-567e89b7bd2d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083085 Aug 08 09:12:33.127616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1111/2124] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:33 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:33.320346 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-be2c2327-2b12-4bbf-a0df-47a1f8651d31 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:33.321211 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-be2c2327-2b12-4bbf-a0df-47a1f8651d31 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:33.327238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be2c2327-2b12-4bbf-a0df-47a1f8651d31 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:33.327721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be2c2327-2b12-4bbf-a0df-47a1f8651d31 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:33.328154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be2c2327-2b12-4bbf-a0df-47a1f8651d31 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:33.328842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be2c2327-2b12-4bbf-a0df-47a1f8651d31 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:33.329330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be2c2327-2b12-4bbf-a0df-47a1f8651d31 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:33.329754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-be2c2327-2b12-4bbf-a0df-47a1f8651d31 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:33.391009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-be2c2327-2b12-4bbf-a0df-47a1f8651d31 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:33.398473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-be2c2327-2b12-4bbf-a0df-47a1f8651d31 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082059 Aug 08 09:12:33.399170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1014/2125] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:33 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:33.452186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d125e983-cad2-4333-a099-ed3fad535b01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:33.452796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d125e983-cad2-4333-a099-ed3fad535b01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:33.459356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d125e983-cad2-4333-a099-ed3fad535b01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:33.459851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d125e983-cad2-4333-a099-ed3fad535b01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:33.460299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d125e983-cad2-4333-a099-ed3fad535b01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:33.461004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d125e983-cad2-4333-a099-ed3fad535b01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:33.461753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d125e983-cad2-4333-a099-ed3fad535b01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:33.462197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d125e983-cad2-4333-a099-ed3fad535b01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:33.525634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d125e983-cad2-4333-a099-ed3fad535b01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:33.533549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d125e983-cad2-4333-a099-ed3fad535b01 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085105 Aug 08 09:12:33.534117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1112/2126] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:33 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:34.147563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f26b35de-f38a-48e9-8c52-503eb16e50b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:34.148172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f26b35de-f38a-48e9-8c52-503eb16e50b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:34.154993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f26b35de-f38a-48e9-8c52-503eb16e50b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:34.155474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f26b35de-f38a-48e9-8c52-503eb16e50b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:34.155907 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f26b35de-f38a-48e9-8c52-503eb16e50b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:34.156593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f26b35de-f38a-48e9-8c52-503eb16e50b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:34.157046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f26b35de-f38a-48e9-8c52-503eb16e50b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:34.157496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f26b35de-f38a-48e9-8c52-503eb16e50b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:34.218550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f26b35de-f38a-48e9-8c52-503eb16e50b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:34.226321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f26b35de-f38a-48e9-8c52-503eb16e50b4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082722 Aug 08 09:12:34.227007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1015/2127] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:34 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:34.420595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fcbea7a9-4205-4493-a550-e0136d7ca19f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:34.421634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fcbea7a9-4205-4493-a550-e0136d7ca19f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:34.428980 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcbea7a9-4205-4493-a550-e0136d7ca19f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:34.430060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcbea7a9-4205-4493-a550-e0136d7ca19f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:34.430621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcbea7a9-4205-4493-a550-e0136d7ca19f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:34.431560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcbea7a9-4205-4493-a550-e0136d7ca19f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:34.432362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcbea7a9-4205-4493-a550-e0136d7ca19f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:34.432949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fcbea7a9-4205-4493-a550-e0136d7ca19f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:34.510430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fcbea7a9-4205-4493-a550-e0136d7ca19f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:34.518170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fcbea7a9-4205-4493-a550-e0136d7ca19f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.102644 Aug 08 09:12:34.518731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1113/2128] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:34 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:34.554164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-34fbd352-1b95-491b-a210-8502e28bc506 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:34.555368 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-34fbd352-1b95-491b-a210-8502e28bc506 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:34.561757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34fbd352-1b95-491b-a210-8502e28bc506 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:34.562316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34fbd352-1b95-491b-a210-8502e28bc506 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:34.562756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34fbd352-1b95-491b-a210-8502e28bc506 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:34.563447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34fbd352-1b95-491b-a210-8502e28bc506 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:34.563904 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34fbd352-1b95-491b-a210-8502e28bc506 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:34.564333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-34fbd352-1b95-491b-a210-8502e28bc506 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:34.624778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-34fbd352-1b95-491b-a210-8502e28bc506 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:34.632588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-34fbd352-1b95-491b-a210-8502e28bc506 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082228 Aug 08 09:12:34.633734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1016/2129] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:35.246981 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b4c36b97-6e46-474f-8a64-9b5cb9f0e7c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:35.247621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b4c36b97-6e46-474f-8a64-9b5cb9f0e7c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:35.253578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4c36b97-6e46-474f-8a64-9b5cb9f0e7c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:35.254060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4c36b97-6e46-474f-8a64-9b5cb9f0e7c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:35.254496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4c36b97-6e46-474f-8a64-9b5cb9f0e7c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:35.255179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4c36b97-6e46-474f-8a64-9b5cb9f0e7c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:35.255636 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4c36b97-6e46-474f-8a64-9b5cb9f0e7c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:35.256064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b4c36b97-6e46-474f-8a64-9b5cb9f0e7c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:35.319549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b4c36b97-6e46-474f-8a64-9b5cb9f0e7c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:35.327418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b4c36b97-6e46-474f-8a64-9b5cb9f0e7c9 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.084348 Aug 08 09:12:35.327972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1114/2130] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:35 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:35.538892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-310627ba-e2bb-4d0b-a761-bccd16a19848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:35.540046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-310627ba-e2bb-4d0b-a761-bccd16a19848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:35.545975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-310627ba-e2bb-4d0b-a761-bccd16a19848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:35.546456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-310627ba-e2bb-4d0b-a761-bccd16a19848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:35.546891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-310627ba-e2bb-4d0b-a761-bccd16a19848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:35.547590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-310627ba-e2bb-4d0b-a761-bccd16a19848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:35.548028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-310627ba-e2bb-4d0b-a761-bccd16a19848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:35.548447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-310627ba-e2bb-4d0b-a761-bccd16a19848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:35.611937 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-310627ba-e2bb-4d0b-a761-bccd16a19848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:35.615278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:35.620306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-310627ba-e2bb-4d0b-a761-bccd16a19848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085486 Aug 08 09:12:35.620866 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1017/2131] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:35 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:35.653939 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ad6b68ed-c787-4447-8868-031714a82675 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:35.654556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ad6b68ed-c787-4447-8868-031714a82675 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:35.660752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad6b68ed-c787-4447-8868-031714a82675 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:35.661259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad6b68ed-c787-4447-8868-031714a82675 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:35.661698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad6b68ed-c787-4447-8868-031714a82675 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:35.662378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad6b68ed-c787-4447-8868-031714a82675 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:35.662824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad6b68ed-c787-4447-8868-031714a82675 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:35.663242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ad6b68ed-c787-4447-8868-031714a82675 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:35.723052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ad6b68ed-c787-4447-8868-031714a82675 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:35.731660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ad6b68ed-c787-4447-8868-031714a82675 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081515 Aug 08 09:12:35.732225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1115/2132] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:35 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:36.348546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0e09049f-149c-4cb1-a3d0-0a6784b677b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:36.349111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0e09049f-149c-4cb1-a3d0-0a6784b677b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:36.356097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e09049f-149c-4cb1-a3d0-0a6784b677b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:36.356586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e09049f-149c-4cb1-a3d0-0a6784b677b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:36.357106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e09049f-149c-4cb1-a3d0-0a6784b677b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:36.357826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e09049f-149c-4cb1-a3d0-0a6784b677b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:36.358289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e09049f-149c-4cb1-a3d0-0a6784b677b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:36.358722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0e09049f-149c-4cb1-a3d0-0a6784b677b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:36.422026 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0e09049f-149c-4cb1-a3d0-0a6784b677b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:36.429998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0e09049f-149c-4cb1-a3d0-0a6784b677b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.085444 Aug 08 09:12:36.430560 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1018/2133] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:36 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:36.641602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4b17d35f-0d7b-4195-9dd5-c2c9ff2e92a7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:36.642248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4b17d35f-0d7b-4195-9dd5-c2c9ff2e92a7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:36.648248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b17d35f-0d7b-4195-9dd5-c2c9ff2e92a7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:36.648733 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b17d35f-0d7b-4195-9dd5-c2c9ff2e92a7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:36.649187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b17d35f-0d7b-4195-9dd5-c2c9ff2e92a7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:36.649879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b17d35f-0d7b-4195-9dd5-c2c9ff2e92a7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:36.650329 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b17d35f-0d7b-4195-9dd5-c2c9ff2e92a7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:36.650846 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4b17d35f-0d7b-4195-9dd5-c2c9ff2e92a7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:36.713839 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4b17d35f-0d7b-4195-9dd5-c2c9ff2e92a7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:36.721210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4b17d35f-0d7b-4195-9dd5-c2c9ff2e92a7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083669 Aug 08 09:12:36.721771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1116/2134] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:36 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:36.752367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-47597349-fc86-48ce-b330-59285387e713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:36.752986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-47597349-fc86-48ce-b330-59285387e713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:36.759763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47597349-fc86-48ce-b330-59285387e713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:36.760268 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47597349-fc86-48ce-b330-59285387e713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:36.760706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47597349-fc86-48ce-b330-59285387e713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:36.761428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47597349-fc86-48ce-b330-59285387e713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:36.761889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47597349-fc86-48ce-b330-59285387e713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:36.762317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-47597349-fc86-48ce-b330-59285387e713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:36.822403 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-47597349-fc86-48ce-b330-59285387e713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:36.830471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-47597349-fc86-48ce-b330-59285387e713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081935 Aug 08 09:12:36.831037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1019/2135] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:37.450339 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-97b52c69-9bc0-4e8b-8c3e-4de0551a919f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:37.450991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-97b52c69-9bc0-4e8b-8c3e-4de0551a919f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:37.457232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b52c69-9bc0-4e8b-8c3e-4de0551a919f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:37.457669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b52c69-9bc0-4e8b-8c3e-4de0551a919f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:37.458112 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b52c69-9bc0-4e8b-8c3e-4de0551a919f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:37.458829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b52c69-9bc0-4e8b-8c3e-4de0551a919f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:37.459300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b52c69-9bc0-4e8b-8c3e-4de0551a919f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:37.459869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-97b52c69-9bc0-4e8b-8c3e-4de0551a919f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:37.520620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-97b52c69-9bc0-4e8b-8c3e-4de0551a919f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:37.529137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-97b52c69-9bc0-4e8b-8c3e-4de0551a919f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082970 Aug 08 09:12:37.529710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1117/2136] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:37 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:37.741595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7e32c64c-f402-4db3-9eb5-88fe0ef43198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:37.742123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7e32c64c-f402-4db3-9eb5-88fe0ef43198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:37.748492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e32c64c-f402-4db3-9eb5-88fe0ef43198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:37.748969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e32c64c-f402-4db3-9eb5-88fe0ef43198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:37.749437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e32c64c-f402-4db3-9eb5-88fe0ef43198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:37.750238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e32c64c-f402-4db3-9eb5-88fe0ef43198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:37.750575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e32c64c-f402-4db3-9eb5-88fe0ef43198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:37.750996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7e32c64c-f402-4db3-9eb5-88fe0ef43198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:37.811902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7e32c64c-f402-4db3-9eb5-88fe0ef43198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:37.819286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7e32c64c-f402-4db3-9eb5-88fe0ef43198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081715 Aug 08 09:12:37.819837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1020/2137] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:37 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:37.850595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-54160cf4-e4fa-4165-9230-3a158d73ccef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:37.851209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-54160cf4-e4fa-4165-9230-3a158d73ccef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:37.857983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54160cf4-e4fa-4165-9230-3a158d73ccef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:37.858467 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54160cf4-e4fa-4165-9230-3a158d73ccef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:37.858906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54160cf4-e4fa-4165-9230-3a158d73ccef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:37.859593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54160cf4-e4fa-4165-9230-3a158d73ccef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:37.860049 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54160cf4-e4fa-4165-9230-3a158d73ccef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:37.860479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54160cf4-e4fa-4165-9230-3a158d73ccef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:37.925057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-54160cf4-e4fa-4165-9230-3a158d73ccef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:37.933055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-54160cf4-e4fa-4165-9230-3a158d73ccef tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086216 Aug 08 09:12:37.933649 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1118/2138] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:37 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:38.550331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e3d40fa9-a226-4823-9897-32305ec426bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:38.550864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e3d40fa9-a226-4823-9897-32305ec426bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:38.557566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3d40fa9-a226-4823-9897-32305ec426bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:38.558044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3d40fa9-a226-4823-9897-32305ec426bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:38.558473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3d40fa9-a226-4823-9897-32305ec426bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:38.559159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3d40fa9-a226-4823-9897-32305ec426bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:38.559601 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3d40fa9-a226-4823-9897-32305ec426bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:38.560023 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e3d40fa9-a226-4823-9897-32305ec426bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:38.620976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e3d40fa9-a226-4823-9897-32305ec426bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:38.628769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e3d40fa9-a226-4823-9897-32305ec426bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082419 Aug 08 09:12:38.629750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1021/2139] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:38 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:38.840406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b75d54f8-3ff9-4b2a-85be-a6dd2674ccb2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:38.841027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b75d54f8-3ff9-4b2a-85be-a6dd2674ccb2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:38.847090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b75d54f8-3ff9-4b2a-85be-a6dd2674ccb2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:38.847577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b75d54f8-3ff9-4b2a-85be-a6dd2674ccb2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:38.848018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b75d54f8-3ff9-4b2a-85be-a6dd2674ccb2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:38.848705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b75d54f8-3ff9-4b2a-85be-a6dd2674ccb2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:38.849179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b75d54f8-3ff9-4b2a-85be-a6dd2674ccb2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:38.849615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b75d54f8-3ff9-4b2a-85be-a6dd2674ccb2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:38.910805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b75d54f8-3ff9-4b2a-85be-a6dd2674ccb2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:38.918867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b75d54f8-3ff9-4b2a-85be-a6dd2674ccb2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082961 Aug 08 09:12:38.919461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1119/2140] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:38 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:38.953554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0aef1c26-7d70-41f0-9d63-255e31160ecc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:38.954173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0aef1c26-7d70-41f0-9d63-255e31160ecc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:38.960588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aef1c26-7d70-41f0-9d63-255e31160ecc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:38.961077 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aef1c26-7d70-41f0-9d63-255e31160ecc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:38.961552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aef1c26-7d70-41f0-9d63-255e31160ecc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:38.962776 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aef1c26-7d70-41f0-9d63-255e31160ecc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:38.963243 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aef1c26-7d70-41f0-9d63-255e31160ecc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:38.963825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0aef1c26-7d70-41f0-9d63-255e31160ecc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:39.023966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0aef1c26-7d70-41f0-9d63-255e31160ecc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:39.032534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0aef1c26-7d70-41f0-9d63-255e31160ecc tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082840 Aug 08 09:12:39.033092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1022/2141] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:38 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:39.650298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-126457e5-6f01-4efb-ab15-0fe2dc2e49fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:39.651017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-126457e5-6f01-4efb-ab15-0fe2dc2e49fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:39.656830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-126457e5-6f01-4efb-ab15-0fe2dc2e49fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:39.657352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-126457e5-6f01-4efb-ab15-0fe2dc2e49fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:39.657786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-126457e5-6f01-4efb-ab15-0fe2dc2e49fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:39.658490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-126457e5-6f01-4efb-ab15-0fe2dc2e49fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:39.658940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-126457e5-6f01-4efb-ab15-0fe2dc2e49fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:39.659360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-126457e5-6f01-4efb-ab15-0fe2dc2e49fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:39.663392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:39.724135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-126457e5-6f01-4efb-ab15-0fe2dc2e49fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:39.732587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-126457e5-6f01-4efb-ab15-0fe2dc2e49fb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.086629 Aug 08 09:12:39.733138 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1120/2142] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:39 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:39.939076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0dd71ade-5a41-4880-85cb-4160912252d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:39.939688 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0dd71ade-5a41-4880-85cb-4160912252d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:39.941747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=86 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:39.946620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0dd71ade-5a41-4880-85cb-4160912252d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:39.947373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0dd71ade-5a41-4880-85cb-4160912252d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:39.947828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0dd71ade-5a41-4880-85cb-4160912252d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:39.948513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0dd71ade-5a41-4880-85cb-4160912252d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:39.948969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0dd71ade-5a41-4880-85cb-4160912252d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:39.949430 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0dd71ade-5a41-4880-85cb-4160912252d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:40.011760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0dd71ade-5a41-4880-85cb-4160912252d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:40.019651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0dd71ade-5a41-4880-85cb-4160912252d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084458 Aug 08 09:12:40.020205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1023/2143] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:39 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:40.053628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8b6d286b-bf95-48fb-8f79-713e2614df00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:40.054238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8b6d286b-bf95-48fb-8f79-713e2614df00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:40.061136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b6d286b-bf95-48fb-8f79-713e2614df00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:40.061646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b6d286b-bf95-48fb-8f79-713e2614df00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:40.062077 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b6d286b-bf95-48fb-8f79-713e2614df00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:40.062786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b6d286b-bf95-48fb-8f79-713e2614df00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:40.063235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b6d286b-bf95-48fb-8f79-713e2614df00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:40.063658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8b6d286b-bf95-48fb-8f79-713e2614df00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:40.124023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8b6d286b-bf95-48fb-8f79-713e2614df00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:40.131924 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8b6d286b-bf95-48fb-8f79-713e2614df00 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082411 Aug 08 09:12:40.132489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1121/2144] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:40 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:40.752630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-28383160-69c1-4b60-a01e-398f3492f920 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:40.753291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-28383160-69c1-4b60-a01e-398f3492f920 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:40.759226 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28383160-69c1-4b60-a01e-398f3492f920 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:40.759707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28383160-69c1-4b60-a01e-398f3492f920 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:40.760135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28383160-69c1-4b60-a01e-398f3492f920 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:40.760819 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28383160-69c1-4b60-a01e-398f3492f920 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:40.761326 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28383160-69c1-4b60-a01e-398f3492f920 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:40.761751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-28383160-69c1-4b60-a01e-398f3492f920 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:40.822503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-28383160-69c1-4b60-a01e-398f3492f920 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:40.830447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-28383160-69c1-4b60-a01e-398f3492f920 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.081731 Aug 08 09:12:40.831001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1024/2145] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:40 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:41.041804 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c3591048-3d3b-41ae-aec7-c02f99b13b65 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:41.042418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c3591048-3d3b-41ae-aec7-c02f99b13b65 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:41.044273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=80 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:41.048893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3591048-3d3b-41ae-aec7-c02f99b13b65 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:41.049450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3591048-3d3b-41ae-aec7-c02f99b13b65 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:41.055654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3591048-3d3b-41ae-aec7-c02f99b13b65 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:41.055654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3591048-3d3b-41ae-aec7-c02f99b13b65 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:41.055654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3591048-3d3b-41ae-aec7-c02f99b13b65 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:41.055654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c3591048-3d3b-41ae-aec7-c02f99b13b65 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:41.116566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c3591048-3d3b-41ae-aec7-c02f99b13b65 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:41.124089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c3591048-3d3b-41ae-aec7-c02f99b13b65 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086754 Aug 08 09:12:41.124650 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1122/2146] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:41 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:41.153806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-288523eb-d8e8-4e9e-8a69-998e7c8d93ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:41.154419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-288523eb-d8e8-4e9e-8a69-998e7c8d93ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:41.160811 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-288523eb-d8e8-4e9e-8a69-998e7c8d93ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:41.161336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-288523eb-d8e8-4e9e-8a69-998e7c8d93ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:41.161773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-288523eb-d8e8-4e9e-8a69-998e7c8d93ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:41.162468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-288523eb-d8e8-4e9e-8a69-998e7c8d93ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:41.162925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-288523eb-d8e8-4e9e-8a69-998e7c8d93ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:41.163353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-288523eb-d8e8-4e9e-8a69-998e7c8d93ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:41.223698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-288523eb-d8e8-4e9e-8a69-998e7c8d93ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:41.232159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-288523eb-d8e8-4e9e-8a69-998e7c8d93ac tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083236 Aug 08 09:12:41.232713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1025/2147] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:41 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:41.850861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2d093bdc-1db0-420f-99b0-183191e442bf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:41.851398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2d093bdc-1db0-420f-99b0-183191e442bf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:41.857450 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d093bdc-1db0-420f-99b0-183191e442bf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:41.857940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d093bdc-1db0-420f-99b0-183191e442bf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:41.858384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d093bdc-1db0-420f-99b0-183191e442bf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:41.859070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d093bdc-1db0-420f-99b0-183191e442bf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:41.859527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d093bdc-1db0-420f-99b0-183191e442bf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:41.859957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d093bdc-1db0-420f-99b0-183191e442bf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:41.920520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2d093bdc-1db0-420f-99b0-183191e442bf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:41.928347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2d093bdc-1db0-420f-99b0-183191e442bf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.081439 Aug 08 09:12:41.928940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1123/2148] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:41 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:42.148178 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0d82127b-6059-4406-ab88-e5ee41965125 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:42.148794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0d82127b-6059-4406-ab88-e5ee41965125 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:42.154893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d82127b-6059-4406-ab88-e5ee41965125 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:42.155487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d82127b-6059-4406-ab88-e5ee41965125 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:42.155799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d82127b-6059-4406-ab88-e5ee41965125 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:42.156492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d82127b-6059-4406-ab88-e5ee41965125 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:42.156943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d82127b-6059-4406-ab88-e5ee41965125 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:42.157389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0d82127b-6059-4406-ab88-e5ee41965125 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:42.220447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0d82127b-6059-4406-ab88-e5ee41965125 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:42.228516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0d82127b-6059-4406-ab88-e5ee41965125 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087760 Aug 08 09:12:42.229075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1026/2149] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:42 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:42.252869 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6afab896-16d2-46c4-8525-2077a073a9a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:42.253515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6afab896-16d2-46c4-8525-2077a073a9a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:42.259781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6afab896-16d2-46c4-8525-2077a073a9a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:42.260262 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6afab896-16d2-46c4-8525-2077a073a9a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:42.260703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6afab896-16d2-46c4-8525-2077a073a9a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:42.261412 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6afab896-16d2-46c4-8525-2077a073a9a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:42.261870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6afab896-16d2-46c4-8525-2077a073a9a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:42.262298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6afab896-16d2-46c4-8525-2077a073a9a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:42.326008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6afab896-16d2-46c4-8525-2077a073a9a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:42.333777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6afab896-16d2-46c4-8525-2077a073a9a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084672 Aug 08 09:12:42.334341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1124/2150] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:42 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:42.949824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c6837314-0ece-4e90-97d2-7ab4fe49a4c0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:42.950439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c6837314-0ece-4e90-97d2-7ab4fe49a4c0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:42.956317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6837314-0ece-4e90-97d2-7ab4fe49a4c0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:42.956800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6837314-0ece-4e90-97d2-7ab4fe49a4c0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:42.957271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6837314-0ece-4e90-97d2-7ab4fe49a4c0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:42.957964 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6837314-0ece-4e90-97d2-7ab4fe49a4c0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:42.958420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6837314-0ece-4e90-97d2-7ab4fe49a4c0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:42.958849 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6837314-0ece-4e90-97d2-7ab4fe49a4c0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:43.019538 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c6837314-0ece-4e90-97d2-7ab4fe49a4c0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:43.028800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c6837314-0ece-4e90-97d2-7ab4fe49a4c0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082926 Aug 08 09:12:43.029393 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1027/2151] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:42 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:43.248126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8f0d0ef0-8b3a-47da-bd66-bb6353ee06b5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:43.248657 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8f0d0ef0-8b3a-47da-bd66-bb6353ee06b5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:43.254706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f0d0ef0-8b3a-47da-bd66-bb6353ee06b5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:43.255279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f0d0ef0-8b3a-47da-bd66-bb6353ee06b5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:43.255604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f0d0ef0-8b3a-47da-bd66-bb6353ee06b5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:43.256288 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f0d0ef0-8b3a-47da-bd66-bb6353ee06b5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:43.256737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f0d0ef0-8b3a-47da-bd66-bb6353ee06b5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:43.257177 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f0d0ef0-8b3a-47da-bd66-bb6353ee06b5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:43.318027 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8f0d0ef0-8b3a-47da-bd66-bb6353ee06b5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:43.326420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8f0d0ef0-8b3a-47da-bd66-bb6353ee06b5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082194 Aug 08 09:12:43.326977 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1125/2152] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:43 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:43.354648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ebf257d8-997a-4e58-9b14-693b67f0617f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:43.355255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ebf257d8-997a-4e58-9b14-693b67f0617f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:43.361592 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf257d8-997a-4e58-9b14-693b67f0617f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:43.362072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf257d8-997a-4e58-9b14-693b67f0617f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:43.362501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf257d8-997a-4e58-9b14-693b67f0617f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:43.363183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf257d8-997a-4e58-9b14-693b67f0617f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:43.363636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf257d8-997a-4e58-9b14-693b67f0617f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:43.364057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf257d8-997a-4e58-9b14-693b67f0617f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:43.424982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ebf257d8-997a-4e58-9b14-693b67f0617f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:43.433708 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ebf257d8-997a-4e58-9b14-693b67f0617f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083014 Aug 08 09:12:43.434287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1028/2153] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:44.049571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f7d943b6-ad42-4dd0-9f0e-c439bd90bae6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:44.050220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f7d943b6-ad42-4dd0-9f0e-c439bd90bae6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:44.056845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7d943b6-ad42-4dd0-9f0e-c439bd90bae6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:44.057366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7d943b6-ad42-4dd0-9f0e-c439bd90bae6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:44.057810 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7d943b6-ad42-4dd0-9f0e-c439bd90bae6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:44.058502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7d943b6-ad42-4dd0-9f0e-c439bd90bae6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:44.058962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7d943b6-ad42-4dd0-9f0e-c439bd90bae6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:44.059511 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7d943b6-ad42-4dd0-9f0e-c439bd90bae6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:44.124563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f7d943b6-ad42-4dd0-9f0e-c439bd90bae6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:44.132501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f7d943b6-ad42-4dd0-9f0e-c439bd90bae6 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.086934 Aug 08 09:12:44.133060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1126/2154] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:44 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:44.347793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5dcf64bf-2665-4ffc-9174-623105418f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:44.348342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5dcf64bf-2665-4ffc-9174-623105418f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:44.355123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5dcf64bf-2665-4ffc-9174-623105418f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:44.355694 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5dcf64bf-2665-4ffc-9174-623105418f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:44.356047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5dcf64bf-2665-4ffc-9174-623105418f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:44.356741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5dcf64bf-2665-4ffc-9174-623105418f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:44.357224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5dcf64bf-2665-4ffc-9174-623105418f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:44.357653 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5dcf64bf-2665-4ffc-9174-623105418f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:44.419540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5dcf64bf-2665-4ffc-9174-623105418f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:44.427273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5dcf64bf-2665-4ffc-9174-623105418f93 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083399 Aug 08 09:12:44.427833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1029/2155] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:44 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:44.455130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-08f90544-d75d-4f92-9110-ba51f68e4ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:44.455744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-08f90544-d75d-4f92-9110-ba51f68e4ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:44.462759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08f90544-d75d-4f92-9110-ba51f68e4ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:44.463363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08f90544-d75d-4f92-9110-ba51f68e4ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:44.463805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08f90544-d75d-4f92-9110-ba51f68e4ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:44.464495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08f90544-d75d-4f92-9110-ba51f68e4ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:44.464953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08f90544-d75d-4f92-9110-ba51f68e4ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:44.465488 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08f90544-d75d-4f92-9110-ba51f68e4ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:44.529500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-08f90544-d75d-4f92-9110-ba51f68e4ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:44.537646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-08f90544-d75d-4f92-9110-ba51f68e4ab2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086423 Aug 08 09:12:44.538206 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1127/2156] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:45.153513 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-93663077-3cc6-4521-b944-d01ff06f9ae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:45.154126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-93663077-3cc6-4521-b944-d01ff06f9ae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:45.159963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93663077-3cc6-4521-b944-d01ff06f9ae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:45.160444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93663077-3cc6-4521-b944-d01ff06f9ae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:45.160878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93663077-3cc6-4521-b944-d01ff06f9ae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:45.161615 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93663077-3cc6-4521-b944-d01ff06f9ae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:45.162071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93663077-3cc6-4521-b944-d01ff06f9ae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:45.162494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-93663077-3cc6-4521-b944-d01ff06f9ae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:45.223149 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-93663077-3cc6-4521-b944-d01ff06f9ae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:45.231641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-93663077-3cc6-4521-b944-d01ff06f9ae8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082258 Aug 08 09:12:45.232202 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1030/2157] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:45 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:45.448362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d5456342-dea8-4972-a8b8-896821e440d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:45.448982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d5456342-dea8-4972-a8b8-896821e440d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:45.454943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5456342-dea8-4972-a8b8-896821e440d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:45.455430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5456342-dea8-4972-a8b8-896821e440d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:45.455943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5456342-dea8-4972-a8b8-896821e440d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:45.456581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5456342-dea8-4972-a8b8-896821e440d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:45.457041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5456342-dea8-4972-a8b8-896821e440d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:45.457563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5456342-dea8-4972-a8b8-896821e440d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:45.522134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d5456342-dea8-4972-a8b8-896821e440d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:45.531056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d5456342-dea8-4972-a8b8-896821e440d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087020 Aug 08 09:12:45.531639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1128/2158] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:45 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:45.560141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-175c8549-3d7a-4f37-8b73-08bc59e9a86d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:45.560934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-175c8549-3d7a-4f37-8b73-08bc59e9a86d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:45.567637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175c8549-3d7a-4f37-8b73-08bc59e9a86d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:45.568128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175c8549-3d7a-4f37-8b73-08bc59e9a86d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:45.568565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175c8549-3d7a-4f37-8b73-08bc59e9a86d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:45.569573 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175c8549-3d7a-4f37-8b73-08bc59e9a86d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:45.570124 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175c8549-3d7a-4f37-8b73-08bc59e9a86d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:45.570780 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175c8549-3d7a-4f37-8b73-08bc59e9a86d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:45.635910 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-175c8549-3d7a-4f37-8b73-08bc59e9a86d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:45.646946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-175c8549-3d7a-4f37-8b73-08bc59e9a86d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.090774 Aug 08 09:12:45.658092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1031/2159] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:46.251952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-35eef928-1edf-4e24-9b80-984181c278af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:46.252663 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-35eef928-1edf-4e24-9b80-984181c278af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:46.258728 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35eef928-1edf-4e24-9b80-984181c278af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:46.259284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35eef928-1edf-4e24-9b80-984181c278af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:46.259862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35eef928-1edf-4e24-9b80-984181c278af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:46.260543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35eef928-1edf-4e24-9b80-984181c278af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:46.261028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35eef928-1edf-4e24-9b80-984181c278af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:46.261473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35eef928-1edf-4e24-9b80-984181c278af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:46.322311 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-35eef928-1edf-4e24-9b80-984181c278af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:46.330321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-35eef928-1edf-4e24-9b80-984181c278af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082349 Aug 08 09:12:46.330884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1129/2160] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:46 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:46.551837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f87966ab-9008-4372-8751-344fec7fe2ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:46.552379 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f87966ab-9008-4372-8751-344fec7fe2ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:46.558385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f87966ab-9008-4372-8751-344fec7fe2ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:46.558905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f87966ab-9008-4372-8751-344fec7fe2ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:46.559353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f87966ab-9008-4372-8751-344fec7fe2ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:46.560050 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f87966ab-9008-4372-8751-344fec7fe2ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:46.560510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f87966ab-9008-4372-8751-344fec7fe2ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:46.561084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f87966ab-9008-4372-8751-344fec7fe2ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:46.621944 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f87966ab-9008-4372-8751-344fec7fe2ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:46.629372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f87966ab-9008-4372-8751-344fec7fe2ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081539 Aug 08 09:12:46.629938 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1032/2161] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:46 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:46.668327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f0a34c40-97e5-488f-8a11-0aa00093246f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:46.669234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f0a34c40-97e5-488f-8a11-0aa00093246f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:46.675317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0a34c40-97e5-488f-8a11-0aa00093246f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:46.675795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0a34c40-97e5-488f-8a11-0aa00093246f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:46.676225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0a34c40-97e5-488f-8a11-0aa00093246f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:46.676905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0a34c40-97e5-488f-8a11-0aa00093246f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:46.677385 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0a34c40-97e5-488f-8a11-0aa00093246f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:46.677812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0a34c40-97e5-488f-8a11-0aa00093246f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:46.740099 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f0a34c40-97e5-488f-8a11-0aa00093246f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:46.748204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f0a34c40-97e5-488f-8a11-0aa00093246f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083770 Aug 08 09:12:46.748751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1130/2162] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:46 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:47.351884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2c938ecb-92fd-49a4-a354-cc3eaf4a2da3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:47.352496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2c938ecb-92fd-49a4-a354-cc3eaf4a2da3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:47.358607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c938ecb-92fd-49a4-a354-cc3eaf4a2da3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:47.359100 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c938ecb-92fd-49a4-a354-cc3eaf4a2da3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:47.359540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c938ecb-92fd-49a4-a354-cc3eaf4a2da3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:47.360232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c938ecb-92fd-49a4-a354-cc3eaf4a2da3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:47.360691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c938ecb-92fd-49a4-a354-cc3eaf4a2da3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:47.361120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2c938ecb-92fd-49a4-a354-cc3eaf4a2da3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:47.425676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2c938ecb-92fd-49a4-a354-cc3eaf4a2da3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:47.434914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2c938ecb-92fd-49a4-a354-cc3eaf4a2da3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.086094 Aug 08 09:12:47.435469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1033/2163] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:47 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:47.657571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0e9e8e7d-4150-4dea-8a22-74fa0683fc34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:47.658205 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0e9e8e7d-4150-4dea-8a22-74fa0683fc34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:47.664071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e9e8e7d-4150-4dea-8a22-74fa0683fc34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:47.664549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e9e8e7d-4150-4dea-8a22-74fa0683fc34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:47.664983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e9e8e7d-4150-4dea-8a22-74fa0683fc34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:47.665759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e9e8e7d-4150-4dea-8a22-74fa0683fc34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:47.666212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e9e8e7d-4150-4dea-8a22-74fa0683fc34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:47.666638 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e9e8e7d-4150-4dea-8a22-74fa0683fc34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:47.727825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0e9e8e7d-4150-4dea-8a22-74fa0683fc34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:47.735710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0e9e8e7d-4150-4dea-8a22-74fa0683fc34 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081955 Aug 08 09:12:47.736259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1131/2164] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:47 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:47.768043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-98d88bc4-1323-4331-97ec-35ea0e125a02 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:47.768647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-98d88bc4-1323-4331-97ec-35ea0e125a02 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:47.774990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98d88bc4-1323-4331-97ec-35ea0e125a02 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:47.775470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98d88bc4-1323-4331-97ec-35ea0e125a02 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:47.775900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98d88bc4-1323-4331-97ec-35ea0e125a02 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:47.776582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98d88bc4-1323-4331-97ec-35ea0e125a02 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:47.777033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98d88bc4-1323-4331-97ec-35ea0e125a02 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:47.777504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-98d88bc4-1323-4331-97ec-35ea0e125a02 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:47.795843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:47.839469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-98d88bc4-1323-4331-97ec-35ea0e125a02 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:47.847310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-98d88bc4-1323-4331-97ec-35ea0e125a02 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083338 Aug 08 09:12:47.847876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1034/2165] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:48.455505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9f985fb0-9ca2-475f-802d-91ddec9f09ed tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:48.456125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9f985fb0-9ca2-475f-802d-91ddec9f09ed tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:48.462120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f985fb0-9ca2-475f-802d-91ddec9f09ed tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:48.462601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f985fb0-9ca2-475f-802d-91ddec9f09ed tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:48.463037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f985fb0-9ca2-475f-802d-91ddec9f09ed tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:48.463719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f985fb0-9ca2-475f-802d-91ddec9f09ed tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:48.464176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f985fb0-9ca2-475f-802d-91ddec9f09ed tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:48.464601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f985fb0-9ca2-475f-802d-91ddec9f09ed tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:48.528182 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9f985fb0-9ca2-475f-802d-91ddec9f09ed tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:48.536355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9f985fb0-9ca2-475f-802d-91ddec9f09ed tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.084676 Aug 08 09:12:48.536912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1132/2166] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:48 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:48.755865 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-123894d0-fb31-4db6-8dfe-4326e3c301fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:48.756944 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-123894d0-fb31-4db6-8dfe-4326e3c301fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:48.762493 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-123894d0-fb31-4db6-8dfe-4326e3c301fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:48.763140 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-123894d0-fb31-4db6-8dfe-4326e3c301fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:48.763589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-123894d0-fb31-4db6-8dfe-4326e3c301fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:48.764544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-123894d0-fb31-4db6-8dfe-4326e3c301fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:48.765002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-123894d0-fb31-4db6-8dfe-4326e3c301fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:48.765465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-123894d0-fb31-4db6-8dfe-4326e3c301fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:48.827086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-123894d0-fb31-4db6-8dfe-4326e3c301fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:48.834485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-123894d0-fb31-4db6-8dfe-4326e3c301fc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082593 Aug 08 09:12:48.835047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1035/2167] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:48 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:48.867656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-52329160-1de1-4573-9ea6-d332421569ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:48.868301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-52329160-1de1-4573-9ea6-d332421569ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:48.874791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-52329160-1de1-4573-9ea6-d332421569ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:48.875276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-52329160-1de1-4573-9ea6-d332421569ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:48.875719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-52329160-1de1-4573-9ea6-d332421569ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:48.876403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-52329160-1de1-4573-9ea6-d332421569ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:48.876860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-52329160-1de1-4573-9ea6-d332421569ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:48.877331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-52329160-1de1-4573-9ea6-d332421569ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:48.937176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-52329160-1de1-4573-9ea6-d332421569ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:48.944959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-52329160-1de1-4573-9ea6-d332421569ba tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081156 Aug 08 09:12:48.945552 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1133/2168] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:49.557668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c007ff01-06fc-483b-8383-51b380e8b991 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:49.558286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c007ff01-06fc-483b-8383-51b380e8b991 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:49.564803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c007ff01-06fc-483b-8383-51b380e8b991 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:49.565328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c007ff01-06fc-483b-8383-51b380e8b991 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:49.565766 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c007ff01-06fc-483b-8383-51b380e8b991 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:49.566462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c007ff01-06fc-483b-8383-51b380e8b991 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:49.566919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c007ff01-06fc-483b-8383-51b380e8b991 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:49.567351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c007ff01-06fc-483b-8383-51b380e8b991 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:49.628641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c007ff01-06fc-483b-8383-51b380e8b991 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:49.636558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c007ff01-06fc-483b-8383-51b380e8b991 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082762 Aug 08 09:12:49.637748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1036/2169] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:49 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:49.854664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-08c64298-c089-4326-942b-80622406c67f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:49.855280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-08c64298-c089-4326-942b-80622406c67f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:49.861745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c64298-c089-4326-942b-80622406c67f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:49.862235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c64298-c089-4326-942b-80622406c67f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:49.862680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c64298-c089-4326-942b-80622406c67f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:49.863366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c64298-c089-4326-942b-80622406c67f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:49.863825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c64298-c089-4326-942b-80622406c67f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:49.864252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-08c64298-c089-4326-942b-80622406c67f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:49.930078 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-08c64298-c089-4326-942b-80622406c67f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:49.938492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-08c64298-c089-4326-942b-80622406c67f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087767 Aug 08 09:12:49.939060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1134/2170] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:49 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:49.966222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-069a9cd8-b618-4874-ac17-d6319714017a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:49.966844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-069a9cd8-b618-4874-ac17-d6319714017a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:49.973586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-069a9cd8-b618-4874-ac17-d6319714017a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:49.974153 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-069a9cd8-b618-4874-ac17-d6319714017a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:49.978909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-069a9cd8-b618-4874-ac17-d6319714017a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:49.978909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-069a9cd8-b618-4874-ac17-d6319714017a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:49.978909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-069a9cd8-b618-4874-ac17-d6319714017a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:49.978909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-069a9cd8-b618-4874-ac17-d6319714017a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:50.037781 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-069a9cd8-b618-4874-ac17-d6319714017a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:50.046643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-069a9cd8-b618-4874-ac17-d6319714017a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084371 Aug 08 09:12:50.047203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1037/2171] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:50.658278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-753d99b2-974f-4563-ae6a-3e96eef1d633 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:50.658889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-753d99b2-974f-4563-ae6a-3e96eef1d633 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:50.664759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-753d99b2-974f-4563-ae6a-3e96eef1d633 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:50.665276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-753d99b2-974f-4563-ae6a-3e96eef1d633 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:50.665726 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-753d99b2-974f-4563-ae6a-3e96eef1d633 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:50.666408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-753d99b2-974f-4563-ae6a-3e96eef1d633 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:50.666867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-753d99b2-974f-4563-ae6a-3e96eef1d633 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:50.667294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-753d99b2-974f-4563-ae6a-3e96eef1d633 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:50.726916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-753d99b2-974f-4563-ae6a-3e96eef1d633 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:50.734769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-753d99b2-974f-4563-ae6a-3e96eef1d633 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.080317 Aug 08 09:12:50.735323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1135/2172] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:50 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:50.959409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7af64ec7-1141-4567-b385-00e80e9f5bf9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:50.959953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7af64ec7-1141-4567-b385-00e80e9f5bf9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:50.966498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7af64ec7-1141-4567-b385-00e80e9f5bf9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:50.967074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7af64ec7-1141-4567-b385-00e80e9f5bf9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:50.967414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7af64ec7-1141-4567-b385-00e80e9f5bf9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:50.968108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7af64ec7-1141-4567-b385-00e80e9f5bf9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:50.968574 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7af64ec7-1141-4567-b385-00e80e9f5bf9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:50.969007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7af64ec7-1141-4567-b385-00e80e9f5bf9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:51.030087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7af64ec7-1141-4567-b385-00e80e9f5bf9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:51.037433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7af64ec7-1141-4567-b385-00e80e9f5bf9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081954 Aug 08 09:12:51.038001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1038/2173] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:50 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:51.066214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-20bda79d-cd54-4118-a2d1-deb6d149167f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:51.066828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-20bda79d-cd54-4118-a2d1-deb6d149167f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:51.073173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-20bda79d-cd54-4118-a2d1-deb6d149167f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:51.073675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-20bda79d-cd54-4118-a2d1-deb6d149167f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:51.074122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-20bda79d-cd54-4118-a2d1-deb6d149167f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:51.074809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-20bda79d-cd54-4118-a2d1-deb6d149167f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:51.075266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-20bda79d-cd54-4118-a2d1-deb6d149167f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:51.075693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-20bda79d-cd54-4118-a2d1-deb6d149167f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:51.139715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-20bda79d-cd54-4118-a2d1-deb6d149167f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:51.143222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:12:51.147945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-20bda79d-cd54-4118-a2d1-deb6d149167f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085519 Aug 08 09:12:51.148720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1136/2174] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:51 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:51.754917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a2ee57d8-5d60-4037-9af4-4ced5b003b88 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:51.755532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a2ee57d8-5d60-4037-9af4-4ced5b003b88 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:51.761588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2ee57d8-5d60-4037-9af4-4ced5b003b88 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:51.762734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2ee57d8-5d60-4037-9af4-4ced5b003b88 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:51.763172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2ee57d8-5d60-4037-9af4-4ced5b003b88 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:51.763869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2ee57d8-5d60-4037-9af4-4ced5b003b88 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:51.764593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2ee57d8-5d60-4037-9af4-4ced5b003b88 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:51.765025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2ee57d8-5d60-4037-9af4-4ced5b003b88 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:51.826456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a2ee57d8-5d60-4037-9af4-4ced5b003b88 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:51.834798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a2ee57d8-5d60-4037-9af4-4ced5b003b88 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083755 Aug 08 09:12:51.835361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1039/2175] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:51 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:52.058681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-73351492-dac2-4d81-b418-328a42fb996d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:52.059806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-73351492-dac2-4d81-b418-328a42fb996d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:52.066131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73351492-dac2-4d81-b418-328a42fb996d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:52.066617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73351492-dac2-4d81-b418-328a42fb996d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:52.067163 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73351492-dac2-4d81-b418-328a42fb996d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:52.067726 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73351492-dac2-4d81-b418-328a42fb996d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:52.068181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73351492-dac2-4d81-b418-328a42fb996d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:52.068607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-73351492-dac2-4d81-b418-328a42fb996d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:52.129523 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-73351492-dac2-4d81-b418-328a42fb996d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:52.136981 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-73351492-dac2-4d81-b418-328a42fb996d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082204 Aug 08 09:12:52.137565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1137/2176] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:52 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:52.169811 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b0f89d3c-d021-4d61-9e1f-38f7114d8423 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:52.170415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b0f89d3c-d021-4d61-9e1f-38f7114d8423 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:52.176785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b0f89d3c-d021-4d61-9e1f-38f7114d8423 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:52.177297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b0f89d3c-d021-4d61-9e1f-38f7114d8423 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:52.177731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b0f89d3c-d021-4d61-9e1f-38f7114d8423 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:52.178418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b0f89d3c-d021-4d61-9e1f-38f7114d8423 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:52.178881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b0f89d3c-d021-4d61-9e1f-38f7114d8423 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:52.179303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b0f89d3c-d021-4d61-9e1f-38f7114d8423 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:52.239065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b0f89d3c-d021-4d61-9e1f-38f7114d8423 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:52.247453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b0f89d3c-d021-4d61-9e1f-38f7114d8423 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082099 Aug 08 09:12:52.248007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1040/2177] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:52 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:52.855347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9f3d6467-c09c-4e28-aeff-2a79329ad96e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:52.856048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9f3d6467-c09c-4e28-aeff-2a79329ad96e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:52.862146 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f3d6467-c09c-4e28-aeff-2a79329ad96e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:52.862628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f3d6467-c09c-4e28-aeff-2a79329ad96e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:52.863065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f3d6467-c09c-4e28-aeff-2a79329ad96e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:52.863773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f3d6467-c09c-4e28-aeff-2a79329ad96e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:52.864315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f3d6467-c09c-4e28-aeff-2a79329ad96e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:52.864645 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9f3d6467-c09c-4e28-aeff-2a79329ad96e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:52.927426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9f3d6467-c09c-4e28-aeff-2a79329ad96e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:52.935361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9f3d6467-c09c-4e28-aeff-2a79329ad96e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083831 Aug 08 09:12:52.935918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1138/2178] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:52 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:53.158048 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2bf2f288-ac81-439e-82e9-15b9c993f814 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:53.158688 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2bf2f288-ac81-439e-82e9-15b9c993f814 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:53.164630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bf2f288-ac81-439e-82e9-15b9c993f814 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:53.165108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bf2f288-ac81-439e-82e9-15b9c993f814 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:53.165572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bf2f288-ac81-439e-82e9-15b9c993f814 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:53.166259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bf2f288-ac81-439e-82e9-15b9c993f814 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:53.166709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bf2f288-ac81-439e-82e9-15b9c993f814 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:53.167133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2bf2f288-ac81-439e-82e9-15b9c993f814 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:53.228077 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2bf2f288-ac81-439e-82e9-15b9c993f814 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:53.236217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2bf2f288-ac81-439e-82e9-15b9c993f814 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082023 Aug 08 09:12:53.236778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1041/2179] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:53 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:53.268202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8f8130e1-8ce8-4608-a2c4-310b07f4f3c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:53.268816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8f8130e1-8ce8-4608-a2c4-310b07f4f3c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:53.275176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f8130e1-8ce8-4608-a2c4-310b07f4f3c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:53.275659 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f8130e1-8ce8-4608-a2c4-310b07f4f3c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:53.276097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f8130e1-8ce8-4608-a2c4-310b07f4f3c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:53.276783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f8130e1-8ce8-4608-a2c4-310b07f4f3c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:53.277270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f8130e1-8ce8-4608-a2c4-310b07f4f3c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:53.278187 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8f8130e1-8ce8-4608-a2c4-310b07f4f3c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:53.337528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8f8130e1-8ce8-4608-a2c4-310b07f4f3c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:53.345851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8f8130e1-8ce8-4608-a2c4-310b07f4f3c6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081827 Aug 08 09:12:53.346410 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1139/2180] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:53 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:53.956674 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9f1a37ca-dece-4a24-8958-1f483189cfcf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:53.957249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9f1a37ca-dece-4a24-8958-1f483189cfcf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:53.963309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f1a37ca-dece-4a24-8958-1f483189cfcf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:53.963823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f1a37ca-dece-4a24-8958-1f483189cfcf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:53.964264 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f1a37ca-dece-4a24-8958-1f483189cfcf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:53.968528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f1a37ca-dece-4a24-8958-1f483189cfcf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:53.968528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f1a37ca-dece-4a24-8958-1f483189cfcf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:53.968528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9f1a37ca-dece-4a24-8958-1f483189cfcf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:54.027392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9f1a37ca-dece-4a24-8958-1f483189cfcf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:54.035426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9f1a37ca-dece-4a24-8958-1f483189cfcf tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082670 Aug 08 09:12:54.036152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1042/2181] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:53 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:54.256461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-676a4fe0-47f3-4aeb-85c6-051ff6e3c74e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:54.256993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-676a4fe0-47f3-4aeb-85c6-051ff6e3c74e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:54.263108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-676a4fe0-47f3-4aeb-85c6-051ff6e3c74e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:54.263590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-676a4fe0-47f3-4aeb-85c6-051ff6e3c74e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:54.264036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-676a4fe0-47f3-4aeb-85c6-051ff6e3c74e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:54.264972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-676a4fe0-47f3-4aeb-85c6-051ff6e3c74e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:54.265463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-676a4fe0-47f3-4aeb-85c6-051ff6e3c74e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:54.265890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-676a4fe0-47f3-4aeb-85c6-051ff6e3c74e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:54.329422 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-676a4fe0-47f3-4aeb-85c6-051ff6e3c74e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:54.336893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-676a4fe0-47f3-4aeb-85c6-051ff6e3c74e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084348 Aug 08 09:12:54.337475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1140/2182] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:54 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:54.366688 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f6723ba0-ef1f-4633-9bb5-6523dbcee282 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:54.367295 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f6723ba0-ef1f-4633-9bb5-6523dbcee282 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:54.374433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6723ba0-ef1f-4633-9bb5-6523dbcee282 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:54.374913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6723ba0-ef1f-4633-9bb5-6523dbcee282 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:54.375360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6723ba0-ef1f-4633-9bb5-6523dbcee282 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:54.376030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6723ba0-ef1f-4633-9bb5-6523dbcee282 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:54.376487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6723ba0-ef1f-4633-9bb5-6523dbcee282 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:54.376908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6723ba0-ef1f-4633-9bb5-6523dbcee282 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:54.437329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f6723ba0-ef1f-4633-9bb5-6523dbcee282 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:54.445086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f6723ba0-ef1f-4633-9bb5-6523dbcee282 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082155 Aug 08 09:12:54.445673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1043/2183] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:54 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:55.055727 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-daeb3cdf-10aa-4365-a49d-037f53e5dcf3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:55.056345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-daeb3cdf-10aa-4365-a49d-037f53e5dcf3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:55.063056 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-daeb3cdf-10aa-4365-a49d-037f53e5dcf3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:55.063539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-daeb3cdf-10aa-4365-a49d-037f53e5dcf3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:55.063975 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-daeb3cdf-10aa-4365-a49d-037f53e5dcf3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:55.064661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-daeb3cdf-10aa-4365-a49d-037f53e5dcf3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:55.065117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-daeb3cdf-10aa-4365-a49d-037f53e5dcf3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:55.065573 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-daeb3cdf-10aa-4365-a49d-037f53e5dcf3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:55.124926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-daeb3cdf-10aa-4365-a49d-037f53e5dcf3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:55.132776 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-daeb3cdf-10aa-4365-a49d-037f53e5dcf3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.080855 Aug 08 09:12:55.133369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1141/2184] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:55 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:55.358266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b676c36a-9af9-4609-b3e3-282220c4bed7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:55.358837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b676c36a-9af9-4609-b3e3-282220c4bed7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:55.364791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b676c36a-9af9-4609-b3e3-282220c4bed7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:55.365313 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b676c36a-9af9-4609-b3e3-282220c4bed7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:55.365758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b676c36a-9af9-4609-b3e3-282220c4bed7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:55.366452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b676c36a-9af9-4609-b3e3-282220c4bed7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:55.366913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b676c36a-9af9-4609-b3e3-282220c4bed7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:55.367472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b676c36a-9af9-4609-b3e3-282220c4bed7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:55.429648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b676c36a-9af9-4609-b3e3-282220c4bed7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:55.437333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b676c36a-9af9-4609-b3e3-282220c4bed7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083545 Aug 08 09:12:55.437895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1044/2185] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:55 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:55.466016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b574daa6-9e95-4a37-8f6d-b5728c97eb8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:55.466622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b574daa6-9e95-4a37-8f6d-b5728c97eb8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:55.473050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b574daa6-9e95-4a37-8f6d-b5728c97eb8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:55.473639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b574daa6-9e95-4a37-8f6d-b5728c97eb8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:55.474069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b574daa6-9e95-4a37-8f6d-b5728c97eb8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:55.474753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b574daa6-9e95-4a37-8f6d-b5728c97eb8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:55.475200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b574daa6-9e95-4a37-8f6d-b5728c97eb8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:55.475622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b574daa6-9e95-4a37-8f6d-b5728c97eb8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:55.538119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b574daa6-9e95-4a37-8f6d-b5728c97eb8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:55.546576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b574daa6-9e95-4a37-8f6d-b5728c97eb8b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085007 Aug 08 09:12:55.547135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1142/2186] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:56.153773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ef6ff017-9681-4c93-b41d-b82aeed1102f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:56.154392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ef6ff017-9681-4c93-b41d-b82aeed1102f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:56.160341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6ff017-9681-4c93-b41d-b82aeed1102f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:56.160831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6ff017-9681-4c93-b41d-b82aeed1102f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:56.161309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6ff017-9681-4c93-b41d-b82aeed1102f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:56.162005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6ff017-9681-4c93-b41d-b82aeed1102f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:56.162464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6ff017-9681-4c93-b41d-b82aeed1102f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:56.162901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ef6ff017-9681-4c93-b41d-b82aeed1102f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:56.224651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ef6ff017-9681-4c93-b41d-b82aeed1102f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:56.232539 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ef6ff017-9681-4c93-b41d-b82aeed1102f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082810 Aug 08 09:12:56.233099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1045/2187] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:56 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:56.457798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5e095dd7-7b16-4e82-9425-852f8a6d7df4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:56.458416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5e095dd7-7b16-4e82-9425-852f8a6d7df4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:56.464401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e095dd7-7b16-4e82-9425-852f8a6d7df4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:56.464906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e095dd7-7b16-4e82-9425-852f8a6d7df4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:56.465990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e095dd7-7b16-4e82-9425-852f8a6d7df4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:56.466834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e095dd7-7b16-4e82-9425-852f8a6d7df4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:56.467369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e095dd7-7b16-4e82-9425-852f8a6d7df4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:56.467713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e095dd7-7b16-4e82-9425-852f8a6d7df4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:56.530407 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5e095dd7-7b16-4e82-9425-852f8a6d7df4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:56.537994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5e095dd7-7b16-4e82-9425-852f8a6d7df4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084030 Aug 08 09:12:56.538593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1143/2188] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:56 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:56.566869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e8688df2-da20-43a6-8750-3e466868665c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:56.567480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e8688df2-da20-43a6-8750-3e466868665c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:56.573760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8688df2-da20-43a6-8750-3e466868665c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:56.574757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8688df2-da20-43a6-8750-3e466868665c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:56.575206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8688df2-da20-43a6-8750-3e466868665c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:56.575884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8688df2-da20-43a6-8750-3e466868665c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:56.576339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8688df2-da20-43a6-8750-3e466868665c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:56.576767 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8688df2-da20-43a6-8750-3e466868665c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:56.635735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e8688df2-da20-43a6-8750-3e466868665c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:56.644203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e8688df2-da20-43a6-8750-3e466868665c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081135 Aug 08 09:12:56.644760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1046/2189] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:12:57.253551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1f196e67-dee2-437d-a610-477d3cc5b4af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:57.254162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1f196e67-dee2-437d-a610-477d3cc5b4af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:57.260037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f196e67-dee2-437d-a610-477d3cc5b4af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:57.260551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f196e67-dee2-437d-a610-477d3cc5b4af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:57.260992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f196e67-dee2-437d-a610-477d3cc5b4af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:57.261711 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f196e67-dee2-437d-a610-477d3cc5b4af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:57.262192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f196e67-dee2-437d-a610-477d3cc5b4af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:57.262637 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1f196e67-dee2-437d-a610-477d3cc5b4af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:57.324878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1f196e67-dee2-437d-a610-477d3cc5b4af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:57.332827 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1f196e67-dee2-437d-a610-477d3cc5b4af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083062 Aug 08 09:12:57.333435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1144/2190] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:57 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:57.558699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4615ea42-61ef-418b-984a-67c7081ea4a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:57.559352 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4615ea42-61ef-418b-984a-67c7081ea4a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:57.565288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4615ea42-61ef-418b-984a-67c7081ea4a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:57.565772 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4615ea42-61ef-418b-984a-67c7081ea4a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:57.566210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4615ea42-61ef-418b-984a-67c7081ea4a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:57.566911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4615ea42-61ef-418b-984a-67c7081ea4a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:57.567450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4615ea42-61ef-418b-984a-67c7081ea4a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:57.567807 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4615ea42-61ef-418b-984a-67c7081ea4a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:57.628751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4615ea42-61ef-418b-984a-67c7081ea4a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:57.636178 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4615ea42-61ef-418b-984a-67c7081ea4a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081421 Aug 08 09:12:57.636763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1047/2191] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:57 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:57.665495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3e491a32-497b-40e3-a86a-be912b66daa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:57.666131 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3e491a32-497b-40e3-a86a-be912b66daa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:57.672633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e491a32-497b-40e3-a86a-be912b66daa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:57.673108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e491a32-497b-40e3-a86a-be912b66daa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:57.673570 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e491a32-497b-40e3-a86a-be912b66daa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:57.674250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e491a32-497b-40e3-a86a-be912b66daa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:57.674696 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e491a32-497b-40e3-a86a-be912b66daa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:57.675116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3e491a32-497b-40e3-a86a-be912b66daa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:57.735834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3e491a32-497b-40e3-a86a-be912b66daa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:57.743636 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3e491a32-497b-40e3-a86a-be912b66daa1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081960 Aug 08 09:12:57.744185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1145/2192] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:57 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:58.353654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6b01a3d4-1a9f-4c05-b1fb-4281489a5030 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:58.354265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6b01a3d4-1a9f-4c05-b1fb-4281489a5030 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:58.360841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b01a3d4-1a9f-4c05-b1fb-4281489a5030 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:58.361357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b01a3d4-1a9f-4c05-b1fb-4281489a5030 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:58.361796 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b01a3d4-1a9f-4c05-b1fb-4281489a5030 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:58.362472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b01a3d4-1a9f-4c05-b1fb-4281489a5030 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:58.362952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b01a3d4-1a9f-4c05-b1fb-4281489a5030 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:58.363381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6b01a3d4-1a9f-4c05-b1fb-4281489a5030 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:58.423805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6b01a3d4-1a9f-4c05-b1fb-4281489a5030 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:58.431739 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6b01a3d4-1a9f-4c05-b1fb-4281489a5030 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.081986 Aug 08 09:12:58.432296 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1048/2193] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:58 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:58.657397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3d684878-d328-4b6d-b654-d3aeec272a7c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:58.658006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3d684878-d328-4b6d-b654-d3aeec272a7c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:58.663926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d684878-d328-4b6d-b654-d3aeec272a7c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:58.664406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d684878-d328-4b6d-b654-d3aeec272a7c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:58.664838 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d684878-d328-4b6d-b654-d3aeec272a7c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:58.665542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d684878-d328-4b6d-b654-d3aeec272a7c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:58.666082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d684878-d328-4b6d-b654-d3aeec272a7c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:58.666411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d684878-d328-4b6d-b654-d3aeec272a7c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:58.730330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3d684878-d328-4b6d-b654-d3aeec272a7c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:58.738309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3d684878-d328-4b6d-b654-d3aeec272a7c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084470 Aug 08 09:12:58.738883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1146/2194] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:58 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:58.764112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f521ba19-7fac-494e-896d-c648b2fb7c5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:58.765001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f521ba19-7fac-494e-896d-c648b2fb7c5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:58.771500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f521ba19-7fac-494e-896d-c648b2fb7c5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:58.771989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f521ba19-7fac-494e-896d-c648b2fb7c5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:58.772438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f521ba19-7fac-494e-896d-c648b2fb7c5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:58.773132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f521ba19-7fac-494e-896d-c648b2fb7c5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:58.773616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f521ba19-7fac-494e-896d-c648b2fb7c5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:58.774052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f521ba19-7fac-494e-896d-c648b2fb7c5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:58.835133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f521ba19-7fac-494e-896d-c648b2fb7c5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:58.843550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f521ba19-7fac-494e-896d-c648b2fb7c5d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083764 Aug 08 09:12:58.844115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1049/2195] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:59.452207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-469c80f4-d45b-4447-bf57-1e6a7227044b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:59.452856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-469c80f4-d45b-4447-bf57-1e6a7227044b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:59.458934 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469c80f4-d45b-4447-bf57-1e6a7227044b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:59.459420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469c80f4-d45b-4447-bf57-1e6a7227044b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:59.459863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469c80f4-d45b-4447-bf57-1e6a7227044b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:59.460551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469c80f4-d45b-4447-bf57-1e6a7227044b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:59.461011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469c80f4-d45b-4447-bf57-1e6a7227044b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:59.461474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-469c80f4-d45b-4447-bf57-1e6a7227044b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:59.522698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-469c80f4-d45b-4447-bf57-1e6a7227044b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:59.530723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-469c80f4-d45b-4447-bf57-1e6a7227044b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082558 Aug 08 09:12:59.531289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1147/2196] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:59 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:59.759146 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-17fc2eb3-ca82-4686-84c4-3f7a35c9c91a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:59.759681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-17fc2eb3-ca82-4686-84c4-3f7a35c9c91a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:59.766042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17fc2eb3-ca82-4686-84c4-3f7a35c9c91a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:59.766613 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17fc2eb3-ca82-4686-84c4-3f7a35c9c91a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:59.766955 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17fc2eb3-ca82-4686-84c4-3f7a35c9c91a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:59.767646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17fc2eb3-ca82-4686-84c4-3f7a35c9c91a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:59.768113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17fc2eb3-ca82-4686-84c4-3f7a35c9c91a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:59.768532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-17fc2eb3-ca82-4686-84c4-3f7a35c9c91a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:59.830753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-17fc2eb3-ca82-4686-84c4-3f7a35c9c91a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:59.838172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-17fc2eb3-ca82-4686-84c4-3f7a35c9c91a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082983 Aug 08 09:12:59.838732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1050/2197] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:59 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:12:59.864145 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e206cfc6-d7f7-4099-b6d2-4cb49ee68642 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:12:59.864803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e206cfc6-d7f7-4099-b6d2-4cb49ee68642 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:12:59.871462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e206cfc6-d7f7-4099-b6d2-4cb49ee68642 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:59.871865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e206cfc6-d7f7-4099-b6d2-4cb49ee68642 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:59.872306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e206cfc6-d7f7-4099-b6d2-4cb49ee68642 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:59.873030 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e206cfc6-d7f7-4099-b6d2-4cb49ee68642 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:12:59.873519 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e206cfc6-d7f7-4099-b6d2-4cb49ee68642 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:12:59.873953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e206cfc6-d7f7-4099-b6d2-4cb49ee68642 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:12:59.936538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e206cfc6-d7f7-4099-b6d2-4cb49ee68642 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:12:59.944469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e206cfc6-d7f7-4099-b6d2-4cb49ee68642 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084182 Aug 08 09:12:59.955504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1148/2198] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:12:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:00.551685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-175fefc1-99e9-40a3-a9c9-4cb2d16d30b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:00.552238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-175fefc1-99e9-40a3-a9c9-4cb2d16d30b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:00.558232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175fefc1-99e9-40a3-a9c9-4cb2d16d30b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:00.559212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175fefc1-99e9-40a3-a9c9-4cb2d16d30b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:00.559648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175fefc1-99e9-40a3-a9c9-4cb2d16d30b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:00.560335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175fefc1-99e9-40a3-a9c9-4cb2d16d30b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:00.560793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175fefc1-99e9-40a3-a9c9-4cb2d16d30b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:00.561272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-175fefc1-99e9-40a3-a9c9-4cb2d16d30b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:00.565160 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:00.620777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-175fefc1-99e9-40a3-a9c9-4cb2d16d30b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:00.629266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-175fefc1-99e9-40a3-a9c9-4cb2d16d30b3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.081452 Aug 08 09:13:00.629844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1051/2199] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:00 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:00.859237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-27c3a75e-d91b-4180-9806-6e0d8342e095 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:00.859766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-27c3a75e-d91b-4180-9806-6e0d8342e095 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:00.865745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27c3a75e-d91b-4180-9806-6e0d8342e095 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:00.866323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27c3a75e-d91b-4180-9806-6e0d8342e095 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:00.866653 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27c3a75e-d91b-4180-9806-6e0d8342e095 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:00.867335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27c3a75e-d91b-4180-9806-6e0d8342e095 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:00.867789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27c3a75e-d91b-4180-9806-6e0d8342e095 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:00.868215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27c3a75e-d91b-4180-9806-6e0d8342e095 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:00.929472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-27c3a75e-d91b-4180-9806-6e0d8342e095 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:00.937427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-27c3a75e-d91b-4180-9806-6e0d8342e095 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082176 Aug 08 09:13:00.937991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1149/2200] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:00 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:00.964862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ecb85f8f-90e7-4026-9859-6c507b9f29aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:00.965672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ecb85f8f-90e7-4026-9859-6c507b9f29aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:00.972014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecb85f8f-90e7-4026-9859-6c507b9f29aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:00.972495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecb85f8f-90e7-4026-9859-6c507b9f29aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:00.972929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecb85f8f-90e7-4026-9859-6c507b9f29aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:00.973642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecb85f8f-90e7-4026-9859-6c507b9f29aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:00.974097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecb85f8f-90e7-4026-9859-6c507b9f29aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:00.974518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ecb85f8f-90e7-4026-9859-6c507b9f29aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:01.036263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ecb85f8f-90e7-4026-9859-6c507b9f29aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:01.044507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ecb85f8f-90e7-4026-9859-6c507b9f29aa tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083490 Aug 08 09:13:01.045064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1052/2201] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:00 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:01.650751 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-225969a7-320a-4255-8810-de4b590f781e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:01.651358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-225969a7-320a-4255-8810-de4b590f781e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:01.657281 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225969a7-320a-4255-8810-de4b590f781e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:01.657762 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225969a7-320a-4255-8810-de4b590f781e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:01.658197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225969a7-320a-4255-8810-de4b590f781e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:01.658876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225969a7-320a-4255-8810-de4b590f781e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:01.659327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225969a7-320a-4255-8810-de4b590f781e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:01.659752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-225969a7-320a-4255-8810-de4b590f781e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:01.722236 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-225969a7-320a-4255-8810-de4b590f781e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:01.729990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-225969a7-320a-4255-8810-de4b590f781e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083135 Aug 08 09:13:01.731061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1150/2202] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:01 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:01.957280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3fe58327-5b0e-4859-a270-771e76f38a85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:01.957883 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3fe58327-5b0e-4859-a270-771e76f38a85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:01.963790 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fe58327-5b0e-4859-a270-771e76f38a85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:01.964278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fe58327-5b0e-4859-a270-771e76f38a85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:01.964701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fe58327-5b0e-4859-a270-771e76f38a85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:01.965961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fe58327-5b0e-4859-a270-771e76f38a85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:01.966509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fe58327-5b0e-4859-a270-771e76f38a85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:01.966820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fe58327-5b0e-4859-a270-771e76f38a85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:02.026169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3fe58327-5b0e-4859-a270-771e76f38a85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:02.034146 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3fe58327-5b0e-4859-a270-771e76f38a85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.080737 Aug 08 09:13:02.034702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1053/2203] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:01 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:02.064225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-aa2a30c5-8a33-4367-84ad-1ab4535d6b2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:02.064885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-aa2a30c5-8a33-4367-84ad-1ab4535d6b2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:02.071280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa2a30c5-8a33-4367-84ad-1ab4535d6b2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:02.071761 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa2a30c5-8a33-4367-84ad-1ab4535d6b2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:02.072199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa2a30c5-8a33-4367-84ad-1ab4535d6b2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:02.072884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa2a30c5-8a33-4367-84ad-1ab4535d6b2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:02.073377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa2a30c5-8a33-4367-84ad-1ab4535d6b2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:02.073809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-aa2a30c5-8a33-4367-84ad-1ab4535d6b2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:02.133894 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-aa2a30c5-8a33-4367-84ad-1ab4535d6b2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:02.142828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-aa2a30c5-8a33-4367-84ad-1ab4535d6b2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082524 Aug 08 09:13:02.143391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1151/2204] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:02 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:02.751475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dc93629c-5afe-42a7-af64-f0aa205d1b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:02.752115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dc93629c-5afe-42a7-af64-f0aa205d1b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:02.758013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc93629c-5afe-42a7-af64-f0aa205d1b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:02.758490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc93629c-5afe-42a7-af64-f0aa205d1b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:02.758921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc93629c-5afe-42a7-af64-f0aa205d1b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:02.759602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc93629c-5afe-42a7-af64-f0aa205d1b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:02.760053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc93629c-5afe-42a7-af64-f0aa205d1b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:02.760472 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dc93629c-5afe-42a7-af64-f0aa205d1b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:02.820969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dc93629c-5afe-42a7-af64-f0aa205d1b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:02.828868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dc93629c-5afe-42a7-af64-f0aa205d1b03 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.081230 Aug 08 09:13:02.829452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1054/2205] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:02 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:03.054876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bf0134ee-5be5-4c3e-9bfd-73d0990ee48f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:03.055400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bf0134ee-5be5-4c3e-9bfd-73d0990ee48f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:03.061850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf0134ee-5be5-4c3e-9bfd-73d0990ee48f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:03.062332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf0134ee-5be5-4c3e-9bfd-73d0990ee48f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:03.062768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf0134ee-5be5-4c3e-9bfd-73d0990ee48f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:03.063447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf0134ee-5be5-4c3e-9bfd-73d0990ee48f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:03.063899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf0134ee-5be5-4c3e-9bfd-73d0990ee48f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:03.064324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bf0134ee-5be5-4c3e-9bfd-73d0990ee48f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:03.128460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bf0134ee-5be5-4c3e-9bfd-73d0990ee48f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:03.136289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bf0134ee-5be5-4c3e-9bfd-73d0990ee48f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085033 Aug 08 09:13:03.137480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1152/2206] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:03 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:03.163426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-adedc7f5-d2ee-46ee-8c21-09c7a050e262 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:03.164039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-adedc7f5-d2ee-46ee-8c21-09c7a050e262 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:03.170634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-adedc7f5-d2ee-46ee-8c21-09c7a050e262 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:03.171118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-adedc7f5-d2ee-46ee-8c21-09c7a050e262 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:03.171552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-adedc7f5-d2ee-46ee-8c21-09c7a050e262 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:03.172248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-adedc7f5-d2ee-46ee-8c21-09c7a050e262 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:03.172703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-adedc7f5-d2ee-46ee-8c21-09c7a050e262 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:03.173122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-adedc7f5-d2ee-46ee-8c21-09c7a050e262 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:03.247794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-adedc7f5-d2ee-46ee-8c21-09c7a050e262 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:03.255728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-adedc7f5-d2ee-46ee-8c21-09c7a050e262 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.096165 Aug 08 09:13:03.256283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1055/2207] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:03.849535 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-40272e47-a7e0-4325-a515-35e77320379c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:03.850172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-40272e47-a7e0-4325-a515-35e77320379c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:03.856079 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40272e47-a7e0-4325-a515-35e77320379c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:03.856583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40272e47-a7e0-4325-a515-35e77320379c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:03.857014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40272e47-a7e0-4325-a515-35e77320379c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:03.857723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40272e47-a7e0-4325-a515-35e77320379c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:03.858172 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40272e47-a7e0-4325-a515-35e77320379c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:03.858591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-40272e47-a7e0-4325-a515-35e77320379c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:03.876171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:03.919618 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-40272e47-a7e0-4325-a515-35e77320379c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:03.927448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-40272e47-a7e0-4325-a515-35e77320379c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.081685 Aug 08 09:13:03.928007 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1153/2208] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:03 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:04.158845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3f867e53-5193-4291-9184-b96652d44637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:04.159457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3f867e53-5193-4291-9184-b96652d44637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:04.165433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f867e53-5193-4291-9184-b96652d44637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:04.166038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f867e53-5193-4291-9184-b96652d44637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:04.166333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f867e53-5193-4291-9184-b96652d44637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:04.167020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f867e53-5193-4291-9184-b96652d44637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:04.167477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f867e53-5193-4291-9184-b96652d44637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:04.167957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f867e53-5193-4291-9184-b96652d44637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:04.276833 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a1ecb04e-1adb-49cb-8c2e-9b294c6fe380 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:04.278857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a1ecb04e-1adb-49cb-8c2e-9b294c6fe380 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:04.285092 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1ecb04e-1adb-49cb-8c2e-9b294c6fe380 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:04.285617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1ecb04e-1adb-49cb-8c2e-9b294c6fe380 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:04.286057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1ecb04e-1adb-49cb-8c2e-9b294c6fe380 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:04.286820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1ecb04e-1adb-49cb-8c2e-9b294c6fe380 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:04.287196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1ecb04e-1adb-49cb-8c2e-9b294c6fe380 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:04.287629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a1ecb04e-1adb-49cb-8c2e-9b294c6fe380 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:04.431557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3f867e53-5193-4291-9184-b96652d44637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:04.439962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3f867e53-5193-4291-9184-b96652d44637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.284994 Aug 08 09:13:04.440615 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1056/2209] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:04 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:04.450891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a1ecb04e-1adb-49cb-8c2e-9b294c6fe380 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:04.459122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a1ecb04e-1adb-49cb-8c2e-9b294c6fe380 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.186078 Aug 08 09:13:04.459679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1154/2210] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:04.948631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ed21b93d-d333-41b4-888b-9b2000abbd24 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:04.949288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ed21b93d-d333-41b4-888b-9b2000abbd24 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:04.955361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed21b93d-d333-41b4-888b-9b2000abbd24 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:04.955847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed21b93d-d333-41b4-888b-9b2000abbd24 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:04.956284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed21b93d-d333-41b4-888b-9b2000abbd24 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:04.956973 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed21b93d-d333-41b4-888b-9b2000abbd24 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:04.957456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed21b93d-d333-41b4-888b-9b2000abbd24 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:04.957884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ed21b93d-d333-41b4-888b-9b2000abbd24 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:05.018088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ed21b93d-d333-41b4-888b-9b2000abbd24 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:05.026027 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ed21b93d-d333-41b4-888b-9b2000abbd24 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.081274 Aug 08 09:13:05.026589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1057/2211] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:04 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:05.461756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a2e9cbf8-b346-4d24-9b54-4342a0663752 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:05.462398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a2e9cbf8-b346-4d24-9b54-4342a0663752 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:05.469529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2e9cbf8-b346-4d24-9b54-4342a0663752 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:05.470010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2e9cbf8-b346-4d24-9b54-4342a0663752 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:05.470444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2e9cbf8-b346-4d24-9b54-4342a0663752 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:05.471118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2e9cbf8-b346-4d24-9b54-4342a0663752 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:05.471569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2e9cbf8-b346-4d24-9b54-4342a0663752 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:05.471992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2e9cbf8-b346-4d24-9b54-4342a0663752 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:05.478822 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-35dc90a4-7f24-40f9-b0bf-c7a01c4b95a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:05.480093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-35dc90a4-7f24-40f9-b0bf-c7a01c4b95a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:05.486569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dc90a4-7f24-40f9-b0bf-c7a01c4b95a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:05.487062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dc90a4-7f24-40f9-b0bf-c7a01c4b95a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:05.487500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dc90a4-7f24-40f9-b0bf-c7a01c4b95a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:05.488204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dc90a4-7f24-40f9-b0bf-c7a01c4b95a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:05.488662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dc90a4-7f24-40f9-b0bf-c7a01c4b95a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:05.489090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-35dc90a4-7f24-40f9-b0bf-c7a01c4b95a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:05.535151 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a2e9cbf8-b346-4d24-9b54-4342a0663752 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:05.542719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a2e9cbf8-b346-4d24-9b54-4342a0663752 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085112 Aug 08 09:13:05.543312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1155/2212] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:05 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:05.560546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-35dc90a4-7f24-40f9-b0bf-c7a01c4b95a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:05.568505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-35dc90a4-7f24-40f9-b0bf-c7a01c4b95a1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.093450 Aug 08 09:13:05.569066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1058/2213] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:05 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:06.047693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2d700d3f-ac97-4e86-a534-d617884b8e40 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:06.048315 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2d700d3f-ac97-4e86-a534-d617884b8e40 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:06.054383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d700d3f-ac97-4e86-a534-d617884b8e40 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:06.054873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d700d3f-ac97-4e86-a534-d617884b8e40 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:06.055321 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d700d3f-ac97-4e86-a534-d617884b8e40 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:06.056012 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d700d3f-ac97-4e86-a534-d617884b8e40 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:06.056472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d700d3f-ac97-4e86-a534-d617884b8e40 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:06.056903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d700d3f-ac97-4e86-a534-d617884b8e40 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:06.117355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2d700d3f-ac97-4e86-a534-d617884b8e40 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:06.125873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2d700d3f-ac97-4e86-a534-d617884b8e40 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082594 Aug 08 09:13:06.126441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1156/2214] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:06 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:06.563314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b43749a8-e9f1-45ad-96e2-65e890b38558 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:06.563928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b43749a8-e9f1-45ad-96e2-65e890b38558 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:06.569953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b43749a8-e9f1-45ad-96e2-65e890b38558 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:06.570441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b43749a8-e9f1-45ad-96e2-65e890b38558 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:06.570900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b43749a8-e9f1-45ad-96e2-65e890b38558 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:06.571572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b43749a8-e9f1-45ad-96e2-65e890b38558 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:06.572033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b43749a8-e9f1-45ad-96e2-65e890b38558 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:06.572461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b43749a8-e9f1-45ad-96e2-65e890b38558 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:06.588259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-48953ab5-4a49-4399-80c7-57f36b43960b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:06.588921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-48953ab5-4a49-4399-80c7-57f36b43960b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:06.595373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48953ab5-4a49-4399-80c7-57f36b43960b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:06.595859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48953ab5-4a49-4399-80c7-57f36b43960b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:06.596297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48953ab5-4a49-4399-80c7-57f36b43960b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:06.596983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48953ab5-4a49-4399-80c7-57f36b43960b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:06.597469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48953ab5-4a49-4399-80c7-57f36b43960b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:06.597895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48953ab5-4a49-4399-80c7-57f36b43960b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:06.638334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b43749a8-e9f1-45ad-96e2-65e890b38558 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:06.646334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b43749a8-e9f1-45ad-96e2-65e890b38558 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087049 Aug 08 09:13:06.647482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1059/2215] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:06 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:06.664645 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-48953ab5-4a49-4399-80c7-57f36b43960b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:06.677095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-48953ab5-4a49-4399-80c7-57f36b43960b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.092566 Aug 08 09:13:06.677624 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1157/2216] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:06 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:07.146809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cc36d863-c3db-425c-841e-358f2b4f32ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:07.147420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cc36d863-c3db-425c-841e-358f2b4f32ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:07.153266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc36d863-c3db-425c-841e-358f2b4f32ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:07.153752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc36d863-c3db-425c-841e-358f2b4f32ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:07.154184 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc36d863-c3db-425c-841e-358f2b4f32ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:07.154863 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc36d863-c3db-425c-841e-358f2b4f32ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:07.155315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc36d863-c3db-425c-841e-358f2b4f32ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:07.155740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cc36d863-c3db-425c-841e-358f2b4f32ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:07.217546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cc36d863-c3db-425c-841e-358f2b4f32ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:07.225647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cc36d863-c3db-425c-841e-358f2b4f32ba tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082713 Aug 08 09:13:07.226204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1060/2217] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:07 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:07.668377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-88e1b30e-fa2a-4d79-9444-8f57de4952bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:07.668925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-88e1b30e-fa2a-4d79-9444-8f57de4952bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:07.675988 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88e1b30e-fa2a-4d79-9444-8f57de4952bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:07.676470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88e1b30e-fa2a-4d79-9444-8f57de4952bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:07.676903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88e1b30e-fa2a-4d79-9444-8f57de4952bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:07.677620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88e1b30e-fa2a-4d79-9444-8f57de4952bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:07.678073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88e1b30e-fa2a-4d79-9444-8f57de4952bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:07.678494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-88e1b30e-fa2a-4d79-9444-8f57de4952bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:07.697481 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fbb5f32a-dc12-443a-a7c3-3c2270b9fe81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:07.698099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fbb5f32a-dc12-443a-a7c3-3c2270b9fe81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:07.704462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbb5f32a-dc12-443a-a7c3-3c2270b9fe81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:07.705335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbb5f32a-dc12-443a-a7c3-3c2270b9fe81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:07.706122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbb5f32a-dc12-443a-a7c3-3c2270b9fe81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:07.707059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbb5f32a-dc12-443a-a7c3-3c2270b9fe81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:07.707527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbb5f32a-dc12-443a-a7c3-3c2270b9fe81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:07.707959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbb5f32a-dc12-443a-a7c3-3c2270b9fe81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:07.739604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-88e1b30e-fa2a-4d79-9444-8f57de4952bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:07.747196 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-88e1b30e-fa2a-4d79-9444-8f57de4952bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082742 Aug 08 09:13:07.747757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1158/2218] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:07 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:07.772119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fbb5f32a-dc12-443a-a7c3-3c2270b9fe81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:07.780065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fbb5f32a-dc12-443a-a7c3-3c2270b9fe81 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086488 Aug 08 09:13:07.780632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1061/2219] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:07 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:08.246014 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-de533475-786c-4440-91f9-a83d3a3fef63 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:08.246629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-de533475-786c-4440-91f9-a83d3a3fef63 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:08.252682 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de533475-786c-4440-91f9-a83d3a3fef63 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:08.253194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de533475-786c-4440-91f9-a83d3a3fef63 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:08.253633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de533475-786c-4440-91f9-a83d3a3fef63 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:08.254317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de533475-786c-4440-91f9-a83d3a3fef63 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:08.254799 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de533475-786c-4440-91f9-a83d3a3fef63 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:08.255225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-de533475-786c-4440-91f9-a83d3a3fef63 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:08.316549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-de533475-786c-4440-91f9-a83d3a3fef63 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:08.324389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-de533475-786c-4440-91f9-a83d3a3fef63 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082320 Aug 08 09:13:08.324956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1159/2220] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:08 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:08.770203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-988fec28-34a6-4d4f-9232-c49ad706d986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:08.770815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-988fec28-34a6-4d4f-9232-c49ad706d986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:08.777363 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-988fec28-34a6-4d4f-9232-c49ad706d986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:08.777852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-988fec28-34a6-4d4f-9232-c49ad706d986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:08.778288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-988fec28-34a6-4d4f-9232-c49ad706d986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:08.778978 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-988fec28-34a6-4d4f-9232-c49ad706d986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:08.779434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-988fec28-34a6-4d4f-9232-c49ad706d986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:08.779864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-988fec28-34a6-4d4f-9232-c49ad706d986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:08.800746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-14ba8eaf-0fea-4741-9fc9-9eeac9424d20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:08.801390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-14ba8eaf-0fea-4741-9fc9-9eeac9424d20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:08.807779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14ba8eaf-0fea-4741-9fc9-9eeac9424d20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:08.808270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14ba8eaf-0fea-4741-9fc9-9eeac9424d20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:08.808770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14ba8eaf-0fea-4741-9fc9-9eeac9424d20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:08.809494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14ba8eaf-0fea-4741-9fc9-9eeac9424d20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:08.809957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14ba8eaf-0fea-4741-9fc9-9eeac9424d20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:08.810391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-14ba8eaf-0fea-4741-9fc9-9eeac9424d20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:08.842310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-988fec28-34a6-4d4f-9232-c49ad706d986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:08.850809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-988fec28-34a6-4d4f-9232-c49ad706d986 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084940 Aug 08 09:13:08.851388 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1062/2221] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:08 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:08.873502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-14ba8eaf-0fea-4741-9fc9-9eeac9424d20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:08.882202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-14ba8eaf-0fea-4741-9fc9-9eeac9424d20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085441 Aug 08 09:13:08.882764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1160/2222] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:08 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:09.346228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-52faaa41-f358-4d77-8975-0c5c4e09c5d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:09.346830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-52faaa41-f358-4d77-8975-0c5c4e09c5d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:09.352687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52faaa41-f358-4d77-8975-0c5c4e09c5d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:09.353185 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52faaa41-f358-4d77-8975-0c5c4e09c5d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:09.353622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52faaa41-f358-4d77-8975-0c5c4e09c5d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:09.354304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52faaa41-f358-4d77-8975-0c5c4e09c5d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:09.354754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52faaa41-f358-4d77-8975-0c5c4e09c5d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:09.355171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52faaa41-f358-4d77-8975-0c5c4e09c5d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:09.418912 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-52faaa41-f358-4d77-8975-0c5c4e09c5d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:09.426954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-52faaa41-f358-4d77-8975-0c5c4e09c5d1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.085232 Aug 08 09:13:09.427508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1063/2223] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:09 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:09.870746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-68f9f34b-10a8-474c-8615-dcf565228343 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:09.871359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-68f9f34b-10a8-474c-8615-dcf565228343 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:09.878649 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68f9f34b-10a8-474c-8615-dcf565228343 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:09.879127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68f9f34b-10a8-474c-8615-dcf565228343 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:09.879560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68f9f34b-10a8-474c-8615-dcf565228343 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:09.880234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68f9f34b-10a8-474c-8615-dcf565228343 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:09.880684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68f9f34b-10a8-474c-8615-dcf565228343 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:09.881103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-68f9f34b-10a8-474c-8615-dcf565228343 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:09.902977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2f00c6c8-5cda-4737-b542-ae587c91193a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:09.903595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2f00c6c8-5cda-4737-b542-ae587c91193a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:09.912057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f00c6c8-5cda-4737-b542-ae587c91193a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:09.912547 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f00c6c8-5cda-4737-b542-ae587c91193a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:09.912990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f00c6c8-5cda-4737-b542-ae587c91193a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:09.913721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f00c6c8-5cda-4737-b542-ae587c91193a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:09.914183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f00c6c8-5cda-4737-b542-ae587c91193a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:09.915571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2f00c6c8-5cda-4737-b542-ae587c91193a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:09.943632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-68f9f34b-10a8-474c-8615-dcf565228343 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:09.951130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-68f9f34b-10a8-474c-8615-dcf565228343 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084268 Aug 08 09:13:09.951688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1161/2224] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:09 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:09.979708 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2f00c6c8-5cda-4737-b542-ae587c91193a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:09.988589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2f00c6c8-5cda-4737-b542-ae587c91193a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.089539 Aug 08 09:13:09.989162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1064/2225] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:09 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:10.447774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f0fbb01e-5b28-4a01-b3db-3528588699c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:10.448411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f0fbb01e-5b28-4a01-b3db-3528588699c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:10.454367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0fbb01e-5b28-4a01-b3db-3528588699c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:10.454935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0fbb01e-5b28-4a01-b3db-3528588699c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:10.455373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0fbb01e-5b28-4a01-b3db-3528588699c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:10.456048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0fbb01e-5b28-4a01-b3db-3528588699c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:10.456499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0fbb01e-5b28-4a01-b3db-3528588699c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:10.456919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0fbb01e-5b28-4a01-b3db-3528588699c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:10.517350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f0fbb01e-5b28-4a01-b3db-3528588699c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:10.525232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f0fbb01e-5b28-4a01-b3db-3528588699c3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.081323 Aug 08 09:13:10.525789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1162/2226] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:10 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:10.971334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3fa68b29-8463-4105-86db-235986450be3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:10.971886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3fa68b29-8463-4105-86db-235986450be3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:10.974170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=84 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:10.978818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fa68b29-8463-4105-86db-235986450be3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:10.985963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fa68b29-8463-4105-86db-235986450be3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:10.985963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fa68b29-8463-4105-86db-235986450be3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:10.985963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fa68b29-8463-4105-86db-235986450be3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:10.985963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fa68b29-8463-4105-86db-235986450be3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:10.986467 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3fa68b29-8463-4105-86db-235986450be3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:11.008832 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-86d58ced-49e1-418b-a3f5-7f37f2ddda9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:11.009614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-86d58ced-49e1-418b-a3f5-7f37f2ddda9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:11.016264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86d58ced-49e1-418b-a3f5-7f37f2ddda9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:11.016821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86d58ced-49e1-418b-a3f5-7f37f2ddda9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:11.017287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86d58ced-49e1-418b-a3f5-7f37f2ddda9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:11.017976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86d58ced-49e1-418b-a3f5-7f37f2ddda9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:11.018427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86d58ced-49e1-418b-a3f5-7f37f2ddda9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:11.018848 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-86d58ced-49e1-418b-a3f5-7f37f2ddda9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:11.046579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3fa68b29-8463-4105-86db-235986450be3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:11.054291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3fa68b29-8463-4105-86db-235986450be3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087008 Aug 08 09:13:11.055062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1065/2227] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:10 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:11.329902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-86d58ced-49e1-418b-a3f5-7f37f2ddda9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:11.337783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-86d58ced-49e1-418b-a3f5-7f37f2ddda9f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.332685 Aug 08 09:13:11.338344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1163/2228] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:11 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:11.546117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-89d4dfae-53f8-4669-8348-f498d0622364 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:11.546761 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-89d4dfae-53f8-4669-8348-f498d0622364 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:11.553211 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d4dfae-53f8-4669-8348-f498d0622364 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:11.553703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d4dfae-53f8-4669-8348-f498d0622364 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:11.554143 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d4dfae-53f8-4669-8348-f498d0622364 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:11.554831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d4dfae-53f8-4669-8348-f498d0622364 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:11.555290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d4dfae-53f8-4669-8348-f498d0622364 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:11.555721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d4dfae-53f8-4669-8348-f498d0622364 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:11.615854 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-89d4dfae-53f8-4669-8348-f498d0622364 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:11.623670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-89d4dfae-53f8-4669-8348-f498d0622364 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.081400 Aug 08 09:13:11.624231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1066/2229] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:11 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:12.075143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-05eb4637-e473-4ad3-8657-66c9e5822791 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:12.075736 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-05eb4637-e473-4ad3-8657-66c9e5822791 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:12.078061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=84 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:12.083492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05eb4637-e473-4ad3-8657-66c9e5822791 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:12.083985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05eb4637-e473-4ad3-8657-66c9e5822791 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:12.084421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05eb4637-e473-4ad3-8657-66c9e5822791 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:12.085111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05eb4637-e473-4ad3-8657-66c9e5822791 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:12.085600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05eb4637-e473-4ad3-8657-66c9e5822791 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:12.100469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-05eb4637-e473-4ad3-8657-66c9e5822791 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:12.146376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-05eb4637-e473-4ad3-8657-66c9e5822791 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:12.153691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-05eb4637-e473-4ad3-8657-66c9e5822791 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082404 Aug 08 09:13:12.154257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1164/2230] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:12 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:12.358370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-220bdd39-784c-476c-b383-ea10216d1a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:12.358918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-220bdd39-784c-476c-b383-ea10216d1a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:12.365569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220bdd39-784c-476c-b383-ea10216d1a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:12.366053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220bdd39-784c-476c-b383-ea10216d1a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:12.366490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220bdd39-784c-476c-b383-ea10216d1a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:12.367174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220bdd39-784c-476c-b383-ea10216d1a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:12.367633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220bdd39-784c-476c-b383-ea10216d1a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:12.368056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-220bdd39-784c-476c-b383-ea10216d1a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:12.428555 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-220bdd39-784c-476c-b383-ea10216d1a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:12.431993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:12.436745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-220bdd39-784c-476c-b383-ea10216d1a47 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082276 Aug 08 09:13:12.437319 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1067/2231] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:12 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:12.645408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-31a852ff-1eb1-4a1a-9a0d-75d22de94d37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:12.646023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-31a852ff-1eb1-4a1a-9a0d-75d22de94d37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:12.651859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a852ff-1eb1-4a1a-9a0d-75d22de94d37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:12.652343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a852ff-1eb1-4a1a-9a0d-75d22de94d37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:12.652779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a852ff-1eb1-4a1a-9a0d-75d22de94d37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:12.653494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a852ff-1eb1-4a1a-9a0d-75d22de94d37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:12.653950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a852ff-1eb1-4a1a-9a0d-75d22de94d37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:12.654378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a852ff-1eb1-4a1a-9a0d-75d22de94d37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:12.718330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-31a852ff-1eb1-4a1a-9a0d-75d22de94d37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:12.726411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-31a852ff-1eb1-4a1a-9a0d-75d22de94d37 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.085439 Aug 08 09:13:12.726986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1165/2232] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:12 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:13.175423 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2869a9c9-6cf9-4bb2-a246-d597a325a246 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:13.176041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2869a9c9-6cf9-4bb2-a246-d597a325a246 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:13.182220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2869a9c9-6cf9-4bb2-a246-d597a325a246 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:13.182711 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2869a9c9-6cf9-4bb2-a246-d597a325a246 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:13.183155 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2869a9c9-6cf9-4bb2-a246-d597a325a246 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:13.183851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2869a9c9-6cf9-4bb2-a246-d597a325a246 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:13.184312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2869a9c9-6cf9-4bb2-a246-d597a325a246 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:13.184743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2869a9c9-6cf9-4bb2-a246-d597a325a246 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:13.246413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2869a9c9-6cf9-4bb2-a246-d597a325a246 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:13.253942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2869a9c9-6cf9-4bb2-a246-d597a325a246 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083518 Aug 08 09:13:13.254510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1068/2233] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:13 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:13.457595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d216d3ed-5f10-471b-8a5d-b616121f3a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:13.458207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d216d3ed-5f10-471b-8a5d-b616121f3a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:13.464476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d216d3ed-5f10-471b-8a5d-b616121f3a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:13.464955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d216d3ed-5f10-471b-8a5d-b616121f3a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:13.465418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d216d3ed-5f10-471b-8a5d-b616121f3a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:13.466096 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d216d3ed-5f10-471b-8a5d-b616121f3a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:13.466546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d216d3ed-5f10-471b-8a5d-b616121f3a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:13.466965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d216d3ed-5f10-471b-8a5d-b616121f3a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:13.527179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d216d3ed-5f10-471b-8a5d-b616121f3a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:13.535763 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d216d3ed-5f10-471b-8a5d-b616121f3a2e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082054 Aug 08 09:13:13.536326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1166/2234] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:13 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:13.746302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cf1fac24-cd0f-47ff-8c2d-2814f8132cfb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:13.746957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cf1fac24-cd0f-47ff-8c2d-2814f8132cfb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:13.753486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf1fac24-cd0f-47ff-8c2d-2814f8132cfb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:13.753975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf1fac24-cd0f-47ff-8c2d-2814f8132cfb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:13.754416 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf1fac24-cd0f-47ff-8c2d-2814f8132cfb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:13.755107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf1fac24-cd0f-47ff-8c2d-2814f8132cfb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:13.755595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf1fac24-cd0f-47ff-8c2d-2814f8132cfb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:13.756026 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cf1fac24-cd0f-47ff-8c2d-2814f8132cfb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:13.816638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cf1fac24-cd0f-47ff-8c2d-2814f8132cfb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:13.824563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cf1fac24-cd0f-47ff-8c2d-2814f8132cfb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082592 Aug 08 09:13:13.825122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1069/2235] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:13 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:14.274220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-62fd1f7b-9c03-481e-8172-a61e4de4adfb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:14.274756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-62fd1f7b-9c03-481e-8172-a61e4de4adfb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:14.280697 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62fd1f7b-9c03-481e-8172-a61e4de4adfb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:14.281207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62fd1f7b-9c03-481e-8172-a61e4de4adfb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:14.281653 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62fd1f7b-9c03-481e-8172-a61e4de4adfb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:14.282500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62fd1f7b-9c03-481e-8172-a61e4de4adfb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:14.282960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62fd1f7b-9c03-481e-8172-a61e4de4adfb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:14.283397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-62fd1f7b-9c03-481e-8172-a61e4de4adfb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:14.346125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-62fd1f7b-9c03-481e-8172-a61e4de4adfb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:14.353485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-62fd1f7b-9c03-481e-8172-a61e4de4adfb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083132 Aug 08 09:13:14.354050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1167/2236] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:14 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:14.556218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-89d1930a-8c6b-441d-b7ce-b2e2b367528c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:14.556760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-89d1930a-8c6b-441d-b7ce-b2e2b367528c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:14.562896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d1930a-8c6b-441d-b7ce-b2e2b367528c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:14.564009 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d1930a-8c6b-441d-b7ce-b2e2b367528c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:14.564450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d1930a-8c6b-441d-b7ce-b2e2b367528c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:14.565135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d1930a-8c6b-441d-b7ce-b2e2b367528c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:14.565621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d1930a-8c6b-441d-b7ce-b2e2b367528c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:14.566049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-89d1930a-8c6b-441d-b7ce-b2e2b367528c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:14.626595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-89d1930a-8c6b-441d-b7ce-b2e2b367528c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:14.634425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-89d1930a-8c6b-441d-b7ce-b2e2b367528c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082096 Aug 08 09:13:14.634984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1070/2237] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:14 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:14.846071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e021b08f-634f-4673-87a3-14614833c480 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:14.846642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e021b08f-634f-4673-87a3-14614833c480 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:14.853363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e021b08f-634f-4673-87a3-14614833c480 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:14.853855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e021b08f-634f-4673-87a3-14614833c480 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:14.854294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e021b08f-634f-4673-87a3-14614833c480 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:14.854987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e021b08f-634f-4673-87a3-14614833c480 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:14.855443 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e021b08f-634f-4673-87a3-14614833c480 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:14.855871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e021b08f-634f-4673-87a3-14614833c480 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:14.916303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e021b08f-634f-4673-87a3-14614833c480 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:14.924812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e021b08f-634f-4673-87a3-14614833c480 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083246 Aug 08 09:13:14.925397 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1168/2238] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:14 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:15.374512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8de62a2f-78ce-4a95-97b3-a0c9960c8b77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:15.375111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8de62a2f-78ce-4a95-97b3-a0c9960c8b77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:15.381891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8de62a2f-78ce-4a95-97b3-a0c9960c8b77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:15.382378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8de62a2f-78ce-4a95-97b3-a0c9960c8b77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:15.382817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8de62a2f-78ce-4a95-97b3-a0c9960c8b77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:15.383506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8de62a2f-78ce-4a95-97b3-a0c9960c8b77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:15.383963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8de62a2f-78ce-4a95-97b3-a0c9960c8b77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:15.384390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8de62a2f-78ce-4a95-97b3-a0c9960c8b77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:15.445576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8de62a2f-78ce-4a95-97b3-a0c9960c8b77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:15.453031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8de62a2f-78ce-4a95-97b3-a0c9960c8b77 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082320 Aug 08 09:13:15.453625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1071/2239] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:15 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:15.656403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f7714fdc-82d2-44b2-8a64-8a4c096e978b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:15.656972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f7714fdc-82d2-44b2-8a64-8a4c096e978b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:15.662885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7714fdc-82d2-44b2-8a64-8a4c096e978b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:15.663356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7714fdc-82d2-44b2-8a64-8a4c096e978b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:15.663786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7714fdc-82d2-44b2-8a64-8a4c096e978b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:15.664457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7714fdc-82d2-44b2-8a64-8a4c096e978b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:15.664904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7714fdc-82d2-44b2-8a64-8a4c096e978b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:15.665367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f7714fdc-82d2-44b2-8a64-8a4c096e978b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:15.727117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f7714fdc-82d2-44b2-8a64-8a4c096e978b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:15.734892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f7714fdc-82d2-44b2-8a64-8a4c096e978b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082349 Aug 08 09:13:15.735514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1169/2240] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:15 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:15.945505 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3a1326df-30c9-49a8-9295-d3e0b8bff8b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:15.946042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3a1326df-30c9-49a8-9295-d3e0b8bff8b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:15.951963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a1326df-30c9-49a8-9295-d3e0b8bff8b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:15.952444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a1326df-30c9-49a8-9295-d3e0b8bff8b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:15.952876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a1326df-30c9-49a8-9295-d3e0b8bff8b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:15.953577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a1326df-30c9-49a8-9295-d3e0b8bff8b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:15.954298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a1326df-30c9-49a8-9295-d3e0b8bff8b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:15.954969 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3a1326df-30c9-49a8-9295-d3e0b8bff8b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:16.015581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3a1326df-30c9-49a8-9295-d3e0b8bff8b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:16.023540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3a1326df-30c9-49a8-9295-d3e0b8bff8b2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082065 Aug 08 09:13:16.024099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1072/2241] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:15 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:16.474090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5e3baf80-d96e-4ad4-8c88-5fa8040de984 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:16.474725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5e3baf80-d96e-4ad4-8c88-5fa8040de984 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:16.480991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e3baf80-d96e-4ad4-8c88-5fa8040de984 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:16.481501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e3baf80-d96e-4ad4-8c88-5fa8040de984 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:16.481936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e3baf80-d96e-4ad4-8c88-5fa8040de984 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:16.482673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e3baf80-d96e-4ad4-8c88-5fa8040de984 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:16.483127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e3baf80-d96e-4ad4-8c88-5fa8040de984 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:16.483550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5e3baf80-d96e-4ad4-8c88-5fa8040de984 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:16.488103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:16.545579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5e3baf80-d96e-4ad4-8c88-5fa8040de984 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:16.553240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5e3baf80-d96e-4ad4-8c88-5fa8040de984 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083597 Aug 08 09:13:16.553809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1170/2242] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:16 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:16.755248 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8f0f9508-7653-469c-abad-abfda7651562 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:16.755894 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8f0f9508-7653-469c-abad-abfda7651562 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:16.762310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f0f9508-7653-469c-abad-abfda7651562 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:16.762798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f0f9508-7653-469c-abad-abfda7651562 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:16.763235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f0f9508-7653-469c-abad-abfda7651562 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:16.763925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f0f9508-7653-469c-abad-abfda7651562 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:16.764381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f0f9508-7653-469c-abad-abfda7651562 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:16.764807 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8f0f9508-7653-469c-abad-abfda7651562 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:16.825606 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8f0f9508-7653-469c-abad-abfda7651562 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:16.833962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8f0f9508-7653-469c-abad-abfda7651562 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082559 Aug 08 09:13:16.834518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1073/2243] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:16 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:17.043667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7410e526-1f3e-4716-b05b-07cf2bdc7acb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:17.044278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7410e526-1f3e-4716-b05b-07cf2bdc7acb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:17.050345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7410e526-1f3e-4716-b05b-07cf2bdc7acb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:17.050835 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7410e526-1f3e-4716-b05b-07cf2bdc7acb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:17.051270 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7410e526-1f3e-4716-b05b-07cf2bdc7acb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:17.051955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7410e526-1f3e-4716-b05b-07cf2bdc7acb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:17.052407 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7410e526-1f3e-4716-b05b-07cf2bdc7acb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:17.052830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7410e526-1f3e-4716-b05b-07cf2bdc7acb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:17.115809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7410e526-1f3e-4716-b05b-07cf2bdc7acb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:17.122918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7410e526-1f3e-4716-b05b-07cf2bdc7acb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083057 Aug 08 09:13:17.123473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1171/2244] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:17 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:17.573715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-799a524f-90e4-4997-a29f-01a88b925210 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:17.574330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-799a524f-90e4-4997-a29f-01a88b925210 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:17.580837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-799a524f-90e4-4997-a29f-01a88b925210 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:17.581349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-799a524f-90e4-4997-a29f-01a88b925210 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:17.581791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-799a524f-90e4-4997-a29f-01a88b925210 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:17.582490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-799a524f-90e4-4997-a29f-01a88b925210 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:17.582945 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-799a524f-90e4-4997-a29f-01a88b925210 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:17.583375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-799a524f-90e4-4997-a29f-01a88b925210 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:17.643698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-799a524f-90e4-4997-a29f-01a88b925210 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:17.651073 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-799a524f-90e4-4997-a29f-01a88b925210 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081239 Aug 08 09:13:17.651636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1074/2245] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:17 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:17.855062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3ae71199-e1d2-4dc9-b863-184e6278e7e4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:17.855594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3ae71199-e1d2-4dc9-b863-184e6278e7e4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:17.861899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ae71199-e1d2-4dc9-b863-184e6278e7e4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:17.862375 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ae71199-e1d2-4dc9-b863-184e6278e7e4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:17.862807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ae71199-e1d2-4dc9-b863-184e6278e7e4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:17.863481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ae71199-e1d2-4dc9-b863-184e6278e7e4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:17.863931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ae71199-e1d2-4dc9-b863-184e6278e7e4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:17.864370 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ae71199-e1d2-4dc9-b863-184e6278e7e4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:17.924940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3ae71199-e1d2-4dc9-b863-184e6278e7e4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:17.932826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3ae71199-e1d2-4dc9-b863-184e6278e7e4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081667 Aug 08 09:13:17.933425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1172/2246] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:17 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:18.144524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-48a139b8-c447-4100-b43c-f1de24bb19fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:18.145121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-48a139b8-c447-4100-b43c-f1de24bb19fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:18.151490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48a139b8-c447-4100-b43c-f1de24bb19fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:18.151970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48a139b8-c447-4100-b43c-f1de24bb19fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:18.152402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48a139b8-c447-4100-b43c-f1de24bb19fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:18.153084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48a139b8-c447-4100-b43c-f1de24bb19fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:18.153564 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48a139b8-c447-4100-b43c-f1de24bb19fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:18.153989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-48a139b8-c447-4100-b43c-f1de24bb19fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:18.215419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-48a139b8-c447-4100-b43c-f1de24bb19fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:18.223550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-48a139b8-c447-4100-b43c-f1de24bb19fd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083286 Aug 08 09:13:18.224115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1075/2247] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:18 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:18.676702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-acdd20d2-7307-4a16-8617-e015cf7ba509 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:18.676702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-acdd20d2-7307-4a16-8617-e015cf7ba509 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:18.679242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-acdd20d2-7307-4a16-8617-e015cf7ba509 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:18.679735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-acdd20d2-7307-4a16-8617-e015cf7ba509 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:18.680168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-acdd20d2-7307-4a16-8617-e015cf7ba509 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:18.680854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-acdd20d2-7307-4a16-8617-e015cf7ba509 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:18.681341 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-acdd20d2-7307-4a16-8617-e015cf7ba509 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:18.681768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-acdd20d2-7307-4a16-8617-e015cf7ba509 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:18.750115 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-acdd20d2-7307-4a16-8617-e015cf7ba509 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:18.757750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-acdd20d2-7307-4a16-8617-e015cf7ba509 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.089750 Aug 08 09:13:18.758293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1173/2248] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:18 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:18.954949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-82e7cf66-0a65-4128-82c7-4cf20f16faa9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:18.955491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-82e7cf66-0a65-4128-82c7-4cf20f16faa9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:18.961703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82e7cf66-0a65-4128-82c7-4cf20f16faa9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:18.962192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82e7cf66-0a65-4128-82c7-4cf20f16faa9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:18.962629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82e7cf66-0a65-4128-82c7-4cf20f16faa9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:18.963316 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82e7cf66-0a65-4128-82c7-4cf20f16faa9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:18.963774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82e7cf66-0a65-4128-82c7-4cf20f16faa9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:18.964199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-82e7cf66-0a65-4128-82c7-4cf20f16faa9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:19.025253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-82e7cf66-0a65-4128-82c7-4cf20f16faa9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:19.033655 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-82e7cf66-0a65-4128-82c7-4cf20f16faa9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083322 Aug 08 09:13:19.034220 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1076/2249] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:18 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:19.243803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-49d07ffe-04b0-4752-b427-ff24184acc45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:19.244352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-49d07ffe-04b0-4752-b427-ff24184acc45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:19.251296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49d07ffe-04b0-4752-b427-ff24184acc45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:19.251801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49d07ffe-04b0-4752-b427-ff24184acc45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:19.252220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49d07ffe-04b0-4752-b427-ff24184acc45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:19.252905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49d07ffe-04b0-4752-b427-ff24184acc45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:19.253392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49d07ffe-04b0-4752-b427-ff24184acc45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:19.253823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-49d07ffe-04b0-4752-b427-ff24184acc45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:19.314211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-49d07ffe-04b0-4752-b427-ff24184acc45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:19.321999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-49d07ffe-04b0-4752-b427-ff24184acc45 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082107 Aug 08 09:13:19.322566 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1174/2250] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:19 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:19.779490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3e2c7482-ebc2-4ba6-931a-637546576637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:19.780111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3e2c7482-ebc2-4ba6-931a-637546576637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:19.786773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e2c7482-ebc2-4ba6-931a-637546576637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:19.787269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e2c7482-ebc2-4ba6-931a-637546576637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:19.787717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e2c7482-ebc2-4ba6-931a-637546576637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:19.788415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e2c7482-ebc2-4ba6-931a-637546576637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:19.788880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e2c7482-ebc2-4ba6-931a-637546576637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:19.789355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3e2c7482-ebc2-4ba6-931a-637546576637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:19.853392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3e2c7482-ebc2-4ba6-931a-637546576637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:19.861855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3e2c7482-ebc2-4ba6-931a-637546576637 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086376 Aug 08 09:13:19.865066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1077/2251] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:19 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:20.055101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cf788d50-da69-4044-b733-569dcd8545fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:20.055637 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cf788d50-da69-4044-b733-569dcd8545fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:20.061731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf788d50-da69-4044-b733-569dcd8545fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:20.062204 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf788d50-da69-4044-b733-569dcd8545fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:20.062647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf788d50-da69-4044-b733-569dcd8545fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:20.063495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf788d50-da69-4044-b733-569dcd8545fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:20.064292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf788d50-da69-4044-b733-569dcd8545fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:20.064734 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cf788d50-da69-4044-b733-569dcd8545fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:20.127340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cf788d50-da69-4044-b733-569dcd8545fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:20.135236 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cf788d50-da69-4044-b733-569dcd8545fe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084067 Aug 08 09:13:20.135797 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1175/2252] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:20 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:20.343046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c7919fc5-b4d8-486c-889e-970ffd822d39 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:20.343599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c7919fc5-b4d8-486c-889e-970ffd822d39 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:20.350598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7919fc5-b4d8-486c-889e-970ffd822d39 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:20.351085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7919fc5-b4d8-486c-889e-970ffd822d39 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:20.351519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7919fc5-b4d8-486c-889e-970ffd822d39 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:20.352204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7919fc5-b4d8-486c-889e-970ffd822d39 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:20.352662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7919fc5-b4d8-486c-889e-970ffd822d39 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:20.353088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c7919fc5-b4d8-486c-889e-970ffd822d39 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:20.414036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c7919fc5-b4d8-486c-889e-970ffd822d39 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:20.423068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c7919fc5-b4d8-486c-889e-970ffd822d39 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083621 Aug 08 09:13:20.424081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1078/2253] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:20 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:20.882158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9cd6fcf7-0f1a-4a3b-b7ce-58a3726ab5b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:20.882773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9cd6fcf7-0f1a-4a3b-b7ce-58a3726ab5b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:20.889134 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9cd6fcf7-0f1a-4a3b-b7ce-58a3726ab5b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:20.889646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9cd6fcf7-0f1a-4a3b-b7ce-58a3726ab5b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:20.890088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9cd6fcf7-0f1a-4a3b-b7ce-58a3726ab5b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:20.891032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9cd6fcf7-0f1a-4a3b-b7ce-58a3726ab5b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:20.892160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9cd6fcf7-0f1a-4a3b-b7ce-58a3726ab5b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:20.892594 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9cd6fcf7-0f1a-4a3b-b7ce-58a3726ab5b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:20.951746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9cd6fcf7-0f1a-4a3b-b7ce-58a3726ab5b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:20.959862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9cd6fcf7-0f1a-4a3b-b7ce-58a3726ab5b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081537 Aug 08 09:13:20.960426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1176/2254] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:20 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:21.155885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c6f5f008-1892-4c6f-8201-2300ae953ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:21.156517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c6f5f008-1892-4c6f-8201-2300ae953ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:21.162801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6f5f008-1892-4c6f-8201-2300ae953ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:21.173166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6f5f008-1892-4c6f-8201-2300ae953ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:21.173166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6f5f008-1892-4c6f-8201-2300ae953ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:21.173166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6f5f008-1892-4c6f-8201-2300ae953ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:21.173166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6f5f008-1892-4c6f-8201-2300ae953ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:21.173610 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c6f5f008-1892-4c6f-8201-2300ae953ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:21.225965 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c6f5f008-1892-4c6f-8201-2300ae953ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:21.233915 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c6f5f008-1892-4c6f-8201-2300ae953ffd tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081944 Aug 08 09:13:21.234503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1079/2255] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:21 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:21.443896 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-91a4c2fb-6f56-4c5d-ba4a-0a9fc652c5dd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:21.444507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-91a4c2fb-6f56-4c5d-ba4a-0a9fc652c5dd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:21.450464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a4c2fb-6f56-4c5d-ba4a-0a9fc652c5dd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:21.450971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a4c2fb-6f56-4c5d-ba4a-0a9fc652c5dd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:21.451405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a4c2fb-6f56-4c5d-ba4a-0a9fc652c5dd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:21.452089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a4c2fb-6f56-4c5d-ba4a-0a9fc652c5dd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:21.452545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a4c2fb-6f56-4c5d-ba4a-0a9fc652c5dd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:21.452972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91a4c2fb-6f56-4c5d-ba4a-0a9fc652c5dd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:21.515972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-91a4c2fb-6f56-4c5d-ba4a-0a9fc652c5dd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:21.523921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-91a4c2fb-6f56-4c5d-ba4a-0a9fc652c5dd tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083885 Aug 08 09:13:21.524482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1177/2256] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:21 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:21.980259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7f1753ed-258a-4ecf-920f-1e7bc6db4bc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:21.980868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7f1753ed-258a-4ecf-920f-1e7bc6db4bc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:21.986835 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f1753ed-258a-4ecf-920f-1e7bc6db4bc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:21.987314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f1753ed-258a-4ecf-920f-1e7bc6db4bc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:21.987746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f1753ed-258a-4ecf-920f-1e7bc6db4bc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:21.988424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f1753ed-258a-4ecf-920f-1e7bc6db4bc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:21.988881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f1753ed-258a-4ecf-920f-1e7bc6db4bc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:21.989331 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7f1753ed-258a-4ecf-920f-1e7bc6db4bc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:22.049842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7f1753ed-258a-4ecf-920f-1e7bc6db4bc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:22.057188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7f1753ed-258a-4ecf-920f-1e7bc6db4bc7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.080793 Aug 08 09:13:22.057752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1080/2257] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:21 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:22.254781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2f265bdd-7669-429f-9e2d-3f892d13c081 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:22.255364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2f265bdd-7669-429f-9e2d-3f892d13c081 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:22.261804 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f265bdd-7669-429f-9e2d-3f892d13c081 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:22.262292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f265bdd-7669-429f-9e2d-3f892d13c081 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:22.262730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f265bdd-7669-429f-9e2d-3f892d13c081 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:22.263423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f265bdd-7669-429f-9e2d-3f892d13c081 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:22.263884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f265bdd-7669-429f-9e2d-3f892d13c081 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:22.264312 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f265bdd-7669-429f-9e2d-3f892d13c081 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:22.326830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2f265bdd-7669-429f-9e2d-3f892d13c081 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:22.335453 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2f265bdd-7669-429f-9e2d-3f892d13c081 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085157 Aug 08 09:13:22.336017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1178/2258] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:22 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:22.544024 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-beca35e5-b978-4b6a-90a6-308a2dec466e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:22.544611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-beca35e5-b978-4b6a-90a6-308a2dec466e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:22.551688 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-beca35e5-b978-4b6a-90a6-308a2dec466e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:22.552165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-beca35e5-b978-4b6a-90a6-308a2dec466e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:22.552598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-beca35e5-b978-4b6a-90a6-308a2dec466e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:22.553315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-beca35e5-b978-4b6a-90a6-308a2dec466e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:22.553777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-beca35e5-b978-4b6a-90a6-308a2dec466e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:22.554205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-beca35e5-b978-4b6a-90a6-308a2dec466e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:22.615952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-beca35e5-b978-4b6a-90a6-308a2dec466e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:22.624053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-beca35e5-b978-4b6a-90a6-308a2dec466e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.084144 Aug 08 09:13:22.624618 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1081/2259] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:22 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:23.077623 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d1e681a2-d974-414b-889b-03ebd24c6d03 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:23.078725 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d1e681a2-d974-414b-889b-03ebd24c6d03 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:23.084170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e681a2-d974-414b-889b-03ebd24c6d03 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:23.084656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e681a2-d974-414b-889b-03ebd24c6d03 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:23.085097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e681a2-d974-414b-889b-03ebd24c6d03 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:23.085805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e681a2-d974-414b-889b-03ebd24c6d03 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:23.086260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e681a2-d974-414b-889b-03ebd24c6d03 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:23.086684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1e681a2-d974-414b-889b-03ebd24c6d03 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:23.149646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d1e681a2-d974-414b-889b-03ebd24c6d03 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:23.157569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d1e681a2-d974-414b-889b-03ebd24c6d03 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083241 Aug 08 09:13:23.158393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1179/2260] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:23 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:23.355818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f02f2efc-6cf6-46f8-8194-b60f26fbbe50 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:23.356348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f02f2efc-6cf6-46f8-8194-b60f26fbbe50 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:23.362420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f02f2efc-6cf6-46f8-8194-b60f26fbbe50 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:23.362898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f02f2efc-6cf6-46f8-8194-b60f26fbbe50 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:23.363329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f02f2efc-6cf6-46f8-8194-b60f26fbbe50 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:23.364006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f02f2efc-6cf6-46f8-8194-b60f26fbbe50 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:23.364458 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f02f2efc-6cf6-46f8-8194-b60f26fbbe50 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:23.364879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f02f2efc-6cf6-46f8-8194-b60f26fbbe50 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:23.425544 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f02f2efc-6cf6-46f8-8194-b60f26fbbe50 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:23.433595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f02f2efc-6cf6-46f8-8194-b60f26fbbe50 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081660 Aug 08 09:13:23.434155 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1082/2261] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:23 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:23.646737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d20a7aac-9af3-4597-8b33-670d37674af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:23.647490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d20a7aac-9af3-4597-8b33-670d37674af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:23.654336 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d20a7aac-9af3-4597-8b33-670d37674af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:23.667953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d20a7aac-9af3-4597-8b33-670d37674af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:23.667953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d20a7aac-9af3-4597-8b33-670d37674af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:23.667953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d20a7aac-9af3-4597-8b33-670d37674af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:23.667953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d20a7aac-9af3-4597-8b33-670d37674af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:23.668398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d20a7aac-9af3-4597-8b33-670d37674af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:23.719241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d20a7aac-9af3-4597-8b33-670d37674af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:23.729065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d20a7aac-9af3-4597-8b33-670d37674af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.085798 Aug 08 09:13:23.729665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1180/2262] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:23 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:24.178344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a87ea72f-d723-4750-a2f2-54e91375ccb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:24.178957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a87ea72f-d723-4750-a2f2-54e91375ccb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:24.185373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87ea72f-d723-4750-a2f2-54e91375ccb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:24.185860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87ea72f-d723-4750-a2f2-54e91375ccb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:24.186302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87ea72f-d723-4750-a2f2-54e91375ccb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:24.186993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87ea72f-d723-4750-a2f2-54e91375ccb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:24.187450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87ea72f-d723-4750-a2f2-54e91375ccb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:24.187878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a87ea72f-d723-4750-a2f2-54e91375ccb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:24.248261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a87ea72f-d723-4750-a2f2-54e91375ccb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:24.256457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a87ea72f-d723-4750-a2f2-54e91375ccb6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082118 Aug 08 09:13:24.257055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1083/2263] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:24 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:24.454607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cde1d4f6-a786-42bd-9a53-0b3e3b7414e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:24.455157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cde1d4f6-a786-42bd-9a53-0b3e3b7414e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:24.461080 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cde1d4f6-a786-42bd-9a53-0b3e3b7414e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:24.461588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cde1d4f6-a786-42bd-9a53-0b3e3b7414e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:24.462024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cde1d4f6-a786-42bd-9a53-0b3e3b7414e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:24.462697 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cde1d4f6-a786-42bd-9a53-0b3e3b7414e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:24.463150 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cde1d4f6-a786-42bd-9a53-0b3e3b7414e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:24.463575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cde1d4f6-a786-42bd-9a53-0b3e3b7414e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:24.525326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cde1d4f6-a786-42bd-9a53-0b3e3b7414e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:24.533732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cde1d4f6-a786-42bd-9a53-0b3e3b7414e7 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083128 Aug 08 09:13:24.534285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1181/2264] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:24 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:24.750371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c750a266-1355-4059-a680-b127a1df7533 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:24.750975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c750a266-1355-4059-a680-b127a1df7533 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:24.756906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c750a266-1355-4059-a680-b127a1df7533 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:24.757422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c750a266-1355-4059-a680-b127a1df7533 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:24.757862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c750a266-1355-4059-a680-b127a1df7533 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:24.758555 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c750a266-1355-4059-a680-b127a1df7533 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:24.759010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c750a266-1355-4059-a680-b127a1df7533 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:24.759436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c750a266-1355-4059-a680-b127a1df7533 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:24.777690 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:24.821831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c750a266-1355-4059-a680-b127a1df7533 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:24.830345 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c750a266-1355-4059-a680-b127a1df7533 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083931 Aug 08 09:13:24.830903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1084/2265] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:24 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:25.026634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:13:25.026844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:13:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:13:25.276944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5b14705d-998e-44c1-a38c-5ffc2ab2711b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:25.277575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5b14705d-998e-44c1-a38c-5ffc2ab2711b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:25.283968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b14705d-998e-44c1-a38c-5ffc2ab2711b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:25.284448 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b14705d-998e-44c1-a38c-5ffc2ab2711b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:25.284883 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b14705d-998e-44c1-a38c-5ffc2ab2711b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:25.285596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b14705d-998e-44c1-a38c-5ffc2ab2711b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:25.286080 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b14705d-998e-44c1-a38c-5ffc2ab2711b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:25.286504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b14705d-998e-44c1-a38c-5ffc2ab2711b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:25.349727 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5b14705d-998e-44c1-a38c-5ffc2ab2711b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:25.357384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5b14705d-998e-44c1-a38c-5ffc2ab2711b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084238 Aug 08 09:13:25.357996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1182/2266] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:25 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:25.560464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1b3ebff2-b547-40ef-a3b4-3ae6bead13c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:25.561077 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1b3ebff2-b547-40ef-a3b4-3ae6bead13c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:25.568120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b3ebff2-b547-40ef-a3b4-3ae6bead13c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:25.568613 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b3ebff2-b547-40ef-a3b4-3ae6bead13c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:25.569058 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b3ebff2-b547-40ef-a3b4-3ae6bead13c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:25.569791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b3ebff2-b547-40ef-a3b4-3ae6bead13c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:25.570277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b3ebff2-b547-40ef-a3b4-3ae6bead13c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:25.570712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b3ebff2-b547-40ef-a3b4-3ae6bead13c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:25.642861 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1b3ebff2-b547-40ef-a3b4-3ae6bead13c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:25.651374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1b3ebff2-b547-40ef-a3b4-3ae6bead13c5 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.100272 Aug 08 09:13:25.652043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1085/2267] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:25 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:25.851174 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-79452f75-9e9b-4d16-9282-2bfc5611dfc5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:25.851720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-79452f75-9e9b-4d16-9282-2bfc5611dfc5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:25.858319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79452f75-9e9b-4d16-9282-2bfc5611dfc5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:25.858809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79452f75-9e9b-4d16-9282-2bfc5611dfc5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:25.859253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79452f75-9e9b-4d16-9282-2bfc5611dfc5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:25.860584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79452f75-9e9b-4d16-9282-2bfc5611dfc5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:25.861046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79452f75-9e9b-4d16-9282-2bfc5611dfc5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:25.861619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-79452f75-9e9b-4d16-9282-2bfc5611dfc5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:25.930399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-79452f75-9e9b-4d16-9282-2bfc5611dfc5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:25.938455 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-79452f75-9e9b-4d16-9282-2bfc5611dfc5 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.091235 Aug 08 09:13:25.939019 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1183/2268] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:25 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:26.378409 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-910822bc-7cc7-4cdd-a9e2-d15075f4a0ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:26.379062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-910822bc-7cc7-4cdd-a9e2-d15075f4a0ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:26.385042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-910822bc-7cc7-4cdd-a9e2-d15075f4a0ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:26.388616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-910822bc-7cc7-4cdd-a9e2-d15075f4a0ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:26.388616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-910822bc-7cc7-4cdd-a9e2-d15075f4a0ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:26.388616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-910822bc-7cc7-4cdd-a9e2-d15075f4a0ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:26.388616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-910822bc-7cc7-4cdd-a9e2-d15075f4a0ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:26.389041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-910822bc-7cc7-4cdd-a9e2-d15075f4a0ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:26.448395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-910822bc-7cc7-4cdd-a9e2-d15075f4a0ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:26.456406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-910822bc-7cc7-4cdd-a9e2-d15075f4a0ea tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081853 Aug 08 09:13:26.456957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1086/2269] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:26 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:26.679429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7f3d561e-c290-48a9-81ca-17879a3e5f0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:26.680066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7f3d561e-c290-48a9-81ca-17879a3e5f0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:26.686404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f3d561e-c290-48a9-81ca-17879a3e5f0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:26.686884 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f3d561e-c290-48a9-81ca-17879a3e5f0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:26.687318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f3d561e-c290-48a9-81ca-17879a3e5f0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:26.687998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f3d561e-c290-48a9-81ca-17879a3e5f0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:26.688451 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f3d561e-c290-48a9-81ca-17879a3e5f0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:26.688872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f3d561e-c290-48a9-81ca-17879a3e5f0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:26.748479 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7f3d561e-c290-48a9-81ca-17879a3e5f0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:26.756241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7f3d561e-c290-48a9-81ca-17879a3e5f0f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081275 Aug 08 09:13:26.756807 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1184/2270] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:26 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:26.958600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3f5e16b3-d6da-49f3-80c3-223f40046521 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:26.959166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3f5e16b3-d6da-49f3-80c3-223f40046521 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:26.965556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f5e16b3-d6da-49f3-80c3-223f40046521 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:26.966037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f5e16b3-d6da-49f3-80c3-223f40046521 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:26.966478 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f5e16b3-d6da-49f3-80c3-223f40046521 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:26.967162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f5e16b3-d6da-49f3-80c3-223f40046521 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:26.967619 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f5e16b3-d6da-49f3-80c3-223f40046521 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:26.968051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3f5e16b3-d6da-49f3-80c3-223f40046521 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:27.030329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3f5e16b3-d6da-49f3-80c3-223f40046521 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:27.039005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3f5e16b3-d6da-49f3-80c3-223f40046521 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.084362 Aug 08 09:13:27.039565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1087/2271] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:26 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:27.475692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8ceecb2b-eb1e-4c96-86df-4ec76d7ea848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:27.476296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8ceecb2b-eb1e-4c96-86df-4ec76d7ea848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:27.482421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ceecb2b-eb1e-4c96-86df-4ec76d7ea848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:27.482899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ceecb2b-eb1e-4c96-86df-4ec76d7ea848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:27.483333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ceecb2b-eb1e-4c96-86df-4ec76d7ea848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:27.484401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ceecb2b-eb1e-4c96-86df-4ec76d7ea848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:27.484863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ceecb2b-eb1e-4c96-86df-4ec76d7ea848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:27.485416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8ceecb2b-eb1e-4c96-86df-4ec76d7ea848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:27.548296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8ceecb2b-eb1e-4c96-86df-4ec76d7ea848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:27.555634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8ceecb2b-eb1e-4c96-86df-4ec76d7ea848 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083861 Aug 08 09:13:27.556190 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1185/2272] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:27 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:27.777207 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c56cbfd7-ea73-4c06-b875-9ada4d9c9c8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:27.777830 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c56cbfd7-ea73-4c06-b875-9ada4d9c9c8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:27.784249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c56cbfd7-ea73-4c06-b875-9ada4d9c9c8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:27.784737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c56cbfd7-ea73-4c06-b875-9ada4d9c9c8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:27.785206 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c56cbfd7-ea73-4c06-b875-9ada4d9c9c8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:27.785902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c56cbfd7-ea73-4c06-b875-9ada4d9c9c8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:27.786364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c56cbfd7-ea73-4c06-b875-9ada4d9c9c8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:27.786798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c56cbfd7-ea73-4c06-b875-9ada4d9c9c8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:27.847954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c56cbfd7-ea73-4c06-b875-9ada4d9c9c8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:27.855811 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c56cbfd7-ea73-4c06-b875-9ada4d9c9c8a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082500 Aug 08 09:13:27.856369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1088/2273] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:27 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:28.059687 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-80f5a469-5757-44c2-98c5-3cd48888e035 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:28.060216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-80f5a469-5757-44c2-98c5-3cd48888e035 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:28.067504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80f5a469-5757-44c2-98c5-3cd48888e035 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:28.067990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80f5a469-5757-44c2-98c5-3cd48888e035 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:28.068460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80f5a469-5757-44c2-98c5-3cd48888e035 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:28.069171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80f5a469-5757-44c2-98c5-3cd48888e035 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:28.069636 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80f5a469-5757-44c2-98c5-3cd48888e035 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:28.070064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80f5a469-5757-44c2-98c5-3cd48888e035 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:28.130687 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-80f5a469-5757-44c2-98c5-3cd48888e035 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:28.134046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:28.138812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-80f5a469-5757-44c2-98c5-3cd48888e035 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082983 Aug 08 09:13:28.139369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1186/2274] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:28 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:28.575829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-77c5755f-0a53-49e2-85e7-f75f23ed4ca0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:28.576445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-77c5755f-0a53-49e2-85e7-f75f23ed4ca0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:28.583433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c5755f-0a53-49e2-85e7-f75f23ed4ca0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:28.583916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c5755f-0a53-49e2-85e7-f75f23ed4ca0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:28.584353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c5755f-0a53-49e2-85e7-f75f23ed4ca0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:28.585039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c5755f-0a53-49e2-85e7-f75f23ed4ca0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:28.585525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c5755f-0a53-49e2-85e7-f75f23ed4ca0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:28.585953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-77c5755f-0a53-49e2-85e7-f75f23ed4ca0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:28.616976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:13:28.617484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:13:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:13:28.648864 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-77c5755f-0a53-49e2-85e7-f75f23ed4ca0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:28.656304 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-77c5755f-0a53-49e2-85e7-f75f23ed4ca0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084368 Aug 08 09:13:28.657665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1089/2275] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:28 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:28.876213 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0db825d0-11b2-460e-b550-753db350873e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:28.876866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0db825d0-11b2-460e-b550-753db350873e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:28.883421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0db825d0-11b2-460e-b550-753db350873e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:28.883907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0db825d0-11b2-460e-b550-753db350873e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:28.884349 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0db825d0-11b2-460e-b550-753db350873e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:28.885038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0db825d0-11b2-460e-b550-753db350873e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:28.885530 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0db825d0-11b2-460e-b550-753db350873e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:28.885959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0db825d0-11b2-460e-b550-753db350873e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:28.951046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0db825d0-11b2-460e-b550-753db350873e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:28.959506 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0db825d0-11b2-460e-b550-753db350873e tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087192 Aug 08 09:13:28.960057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1187/2276] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:28 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:29.170433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-33bd83a2-bcab-4fea-9275-271d756f0bd3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:29.170962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-33bd83a2-bcab-4fea-9275-271d756f0bd3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:29.176980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-33bd83a2-bcab-4fea-9275-271d756f0bd3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:29.177498 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-33bd83a2-bcab-4fea-9275-271d756f0bd3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:29.177937 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-33bd83a2-bcab-4fea-9275-271d756f0bd3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:29.178620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-33bd83a2-bcab-4fea-9275-271d756f0bd3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:29.179070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-33bd83a2-bcab-4fea-9275-271d756f0bd3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:29.179501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-33bd83a2-bcab-4fea-9275-271d756f0bd3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:29.239588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-33bd83a2-bcab-4fea-9275-271d756f0bd3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:29.247487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-33bd83a2-bcab-4fea-9275-271d756f0bd3 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.080997 Aug 08 09:13:29.248041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1090/2277] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:29 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:29.677765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a22a98b9-2036-4159-8b1c-762e83251c3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:29.678404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a22a98b9-2036-4159-8b1c-762e83251c3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:29.684691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a22a98b9-2036-4159-8b1c-762e83251c3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:29.685194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a22a98b9-2036-4159-8b1c-762e83251c3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:29.685632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a22a98b9-2036-4159-8b1c-762e83251c3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:29.686403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a22a98b9-2036-4159-8b1c-762e83251c3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:29.686852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a22a98b9-2036-4159-8b1c-762e83251c3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:29.687273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a22a98b9-2036-4159-8b1c-762e83251c3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:29.748858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a22a98b9-2036-4159-8b1c-762e83251c3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:29.756554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a22a98b9-2036-4159-8b1c-762e83251c3c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082595 Aug 08 09:13:29.757493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1188/2278] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:29 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:29.979820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-44556cb8-444c-45c9-a8cf-49accc4e62c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:29.980361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-44556cb8-444c-45c9-a8cf-49accc4e62c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:29.986800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44556cb8-444c-45c9-a8cf-49accc4e62c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:29.987290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44556cb8-444c-45c9-a8cf-49accc4e62c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:29.987730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44556cb8-444c-45c9-a8cf-49accc4e62c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:29.988447 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44556cb8-444c-45c9-a8cf-49accc4e62c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:29.988908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44556cb8-444c-45c9-a8cf-49accc4e62c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:29.989380 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44556cb8-444c-45c9-a8cf-49accc4e62c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:30.050714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-44556cb8-444c-45c9-a8cf-49accc4e62c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:30.058495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-44556cb8-444c-45c9-a8cf-49accc4e62c9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082609 Aug 08 09:13:30.059049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1091/2279] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:29 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:30.269053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-100ea087-1302-43d9-9153-c833d536a811 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:30.269602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-100ea087-1302-43d9-9153-c833d536a811 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:30.275530 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-100ea087-1302-43d9-9153-c833d536a811 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:30.276006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-100ea087-1302-43d9-9153-c833d536a811 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:30.276437 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-100ea087-1302-43d9-9153-c833d536a811 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:30.277110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-100ea087-1302-43d9-9153-c833d536a811 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:30.277586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-100ea087-1302-43d9-9153-c833d536a811 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:30.278009 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-100ea087-1302-43d9-9153-c833d536a811 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:30.343013 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-100ea087-1302-43d9-9153-c833d536a811 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:30.350952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-100ea087-1302-43d9-9153-c833d536a811 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.086283 Aug 08 09:13:30.351504 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1189/2280] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:30 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:30.777980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-97530ca6-3287-457e-997a-37ab03b3d5e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:30.778592 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-97530ca6-3287-457e-997a-37ab03b3d5e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:30.785228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97530ca6-3287-457e-997a-37ab03b3d5e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:30.785712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97530ca6-3287-457e-997a-37ab03b3d5e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:30.786147 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97530ca6-3287-457e-997a-37ab03b3d5e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:30.786823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97530ca6-3287-457e-997a-37ab03b3d5e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:30.787276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97530ca6-3287-457e-997a-37ab03b3d5e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:30.787700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-97530ca6-3287-457e-997a-37ab03b3d5e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:30.847412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-97530ca6-3287-457e-997a-37ab03b3d5e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:30.854975 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-97530ca6-3287-457e-997a-37ab03b3d5e5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.080806 Aug 08 09:13:30.855527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1092/2281] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:30 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:31.080094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-faace0d9-9439-43bd-89b4-94de392a7568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:31.080634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-faace0d9-9439-43bd-89b4-94de392a7568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:31.086962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faace0d9-9439-43bd-89b4-94de392a7568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:31.087440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faace0d9-9439-43bd-89b4-94de392a7568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:31.087876 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faace0d9-9439-43bd-89b4-94de392a7568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:31.088550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faace0d9-9439-43bd-89b4-94de392a7568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:31.089005 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faace0d9-9439-43bd-89b4-94de392a7568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:31.089568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faace0d9-9439-43bd-89b4-94de392a7568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:31.149780 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-faace0d9-9439-43bd-89b4-94de392a7568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:31.158242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-faace0d9-9439-43bd-89b4-94de392a7568 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082522 Aug 08 09:13:31.158801 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1190/2282] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:31 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:31.371896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-11a33806-2cea-4dcd-8073-8d14314bd90b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:31.372511 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-11a33806-2cea-4dcd-8073-8d14314bd90b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:31.379510 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11a33806-2cea-4dcd-8073-8d14314bd90b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:31.379995 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11a33806-2cea-4dcd-8073-8d14314bd90b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:31.380434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11a33806-2cea-4dcd-8073-8d14314bd90b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:31.381121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11a33806-2cea-4dcd-8073-8d14314bd90b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:31.381603 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11a33806-2cea-4dcd-8073-8d14314bd90b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:31.382030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-11a33806-2cea-4dcd-8073-8d14314bd90b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:31.443649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-11a33806-2cea-4dcd-8073-8d14314bd90b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:31.452016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-11a33806-2cea-4dcd-8073-8d14314bd90b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.084015 Aug 08 09:13:31.452579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1093/2283] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:31 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:31.875162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f26201b4-5ffc-4413-a185-50ac9b854941 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:31.875787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f26201b4-5ffc-4413-a185-50ac9b854941 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:31.881790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f26201b4-5ffc-4413-a185-50ac9b854941 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:31.882276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f26201b4-5ffc-4413-a185-50ac9b854941 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:31.882719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f26201b4-5ffc-4413-a185-50ac9b854941 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:31.883405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f26201b4-5ffc-4413-a185-50ac9b854941 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:31.883865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f26201b4-5ffc-4413-a185-50ac9b854941 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:31.884294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f26201b4-5ffc-4413-a185-50ac9b854941 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:31.947563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f26201b4-5ffc-4413-a185-50ac9b854941 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:31.955654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f26201b4-5ffc-4413-a185-50ac9b854941 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084297 Aug 08 09:13:31.956211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1191/2284] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:31 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:32.179337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d4de0fc3-f705-48c3-a8ad-5de5a28ff8b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:32.179874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d4de0fc3-f705-48c3-a8ad-5de5a28ff8b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:32.185827 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4de0fc3-f705-48c3-a8ad-5de5a28ff8b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:32.186305 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4de0fc3-f705-48c3-a8ad-5de5a28ff8b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:32.186735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4de0fc3-f705-48c3-a8ad-5de5a28ff8b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:32.187413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4de0fc3-f705-48c3-a8ad-5de5a28ff8b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:32.187862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4de0fc3-f705-48c3-a8ad-5de5a28ff8b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:32.188401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d4de0fc3-f705-48c3-a8ad-5de5a28ff8b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:32.249916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d4de0fc3-f705-48c3-a8ad-5de5a28ff8b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:32.257691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d4de0fc3-f705-48c3-a8ad-5de5a28ff8b1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082265 Aug 08 09:13:32.258252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1094/2285] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:32 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:32.473864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-54738e16-88d4-401d-a54d-88dd10808662 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:32.474449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-54738e16-88d4-401d-a54d-88dd10808662 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:32.480789 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54738e16-88d4-401d-a54d-88dd10808662 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:32.481303 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54738e16-88d4-401d-a54d-88dd10808662 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:32.481739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54738e16-88d4-401d-a54d-88dd10808662 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:32.482426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54738e16-88d4-401d-a54d-88dd10808662 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:32.482881 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54738e16-88d4-401d-a54d-88dd10808662 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:32.483310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-54738e16-88d4-401d-a54d-88dd10808662 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:32.545522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-54738e16-88d4-401d-a54d-88dd10808662 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:32.553477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-54738e16-88d4-401d-a54d-88dd10808662 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.084182 Aug 08 09:13:32.554061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1192/2286] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:32 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:32.975828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1493b49a-7d31-4557-b22d-703eecc8440c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:32.976439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1493b49a-7d31-4557-b22d-703eecc8440c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:32.982797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1493b49a-7d31-4557-b22d-703eecc8440c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:32.983280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1493b49a-7d31-4557-b22d-703eecc8440c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:32.983713 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1493b49a-7d31-4557-b22d-703eecc8440c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:32.984392 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1493b49a-7d31-4557-b22d-703eecc8440c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:32.984846 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1493b49a-7d31-4557-b22d-703eecc8440c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:32.985293 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1493b49a-7d31-4557-b22d-703eecc8440c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:33.046091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1493b49a-7d31-4557-b22d-703eecc8440c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:33.054199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1493b49a-7d31-4557-b22d-703eecc8440c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082189 Aug 08 09:13:33.054756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1095/2287] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:32 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:33.279064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9c9830e6-7c11-4d2b-b0db-7f9646041532 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:33.279599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9c9830e6-7c11-4d2b-b0db-7f9646041532 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:33.285749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c9830e6-7c11-4d2b-b0db-7f9646041532 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:33.286237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c9830e6-7c11-4d2b-b0db-7f9646041532 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:33.286675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c9830e6-7c11-4d2b-b0db-7f9646041532 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:33.287357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c9830e6-7c11-4d2b-b0db-7f9646041532 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:33.287816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c9830e6-7c11-4d2b-b0db-7f9646041532 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:33.288242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9c9830e6-7c11-4d2b-b0db-7f9646041532 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:33.352103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9c9830e6-7c11-4d2b-b0db-7f9646041532 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:33.360501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9c9830e6-7c11-4d2b-b0db-7f9646041532 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084835 Aug 08 09:13:33.361055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1193/2288] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:33 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:33.573087 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1e50801c-ca07-44e9-bf9a-3e5aa67b03bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:33.573675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1e50801c-ca07-44e9-bf9a-3e5aa67b03bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:33.579617 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e50801c-ca07-44e9-bf9a-3e5aa67b03bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:33.580094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e50801c-ca07-44e9-bf9a-3e5aa67b03bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:33.580523 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e50801c-ca07-44e9-bf9a-3e5aa67b03bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:33.581229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e50801c-ca07-44e9-bf9a-3e5aa67b03bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:33.581683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e50801c-ca07-44e9-bf9a-3e5aa67b03bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:33.582109 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e50801c-ca07-44e9-bf9a-3e5aa67b03bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:33.642305 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1e50801c-ca07-44e9-bf9a-3e5aa67b03bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:33.650123 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1e50801c-ca07-44e9-bf9a-3e5aa67b03bb tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.080922 Aug 08 09:13:33.650676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1096/2289] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:33 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:34.075201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3d6b5ac7-4ff0-446a-b532-cb77697170b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:34.075822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3d6b5ac7-4ff0-446a-b532-cb77697170b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:34.082852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d6b5ac7-4ff0-446a-b532-cb77697170b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:34.083343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d6b5ac7-4ff0-446a-b532-cb77697170b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:34.083784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d6b5ac7-4ff0-446a-b532-cb77697170b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:34.084473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d6b5ac7-4ff0-446a-b532-cb77697170b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:34.084932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d6b5ac7-4ff0-446a-b532-cb77697170b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:34.085400 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3d6b5ac7-4ff0-446a-b532-cb77697170b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:34.147016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3d6b5ac7-4ff0-446a-b532-cb77697170b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:34.154483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3d6b5ac7-4ff0-446a-b532-cb77697170b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083157 Aug 08 09:13:34.155041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1194/2290] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:34 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:34.381420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c4612ac0-785f-4522-acdc-c5654cb70713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:34.382041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c4612ac0-785f-4522-acdc-c5654cb70713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:34.388456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4612ac0-785f-4522-acdc-c5654cb70713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:34.388944 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4612ac0-785f-4522-acdc-c5654cb70713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:34.389419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4612ac0-785f-4522-acdc-c5654cb70713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:34.390119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4612ac0-785f-4522-acdc-c5654cb70713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:34.390578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4612ac0-785f-4522-acdc-c5654cb70713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:34.392059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4612ac0-785f-4522-acdc-c5654cb70713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:34.452302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c4612ac0-785f-4522-acdc-c5654cb70713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:34.460918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c4612ac0-785f-4522-acdc-c5654cb70713 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083369 Aug 08 09:13:34.461519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1097/2291] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:34 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:34.670962 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-34f95e9a-b247-433f-b5e1-998e7ea87d33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:34.671527 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-34f95e9a-b247-433f-b5e1-998e7ea87d33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:34.678003 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34f95e9a-b247-433f-b5e1-998e7ea87d33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:34.678482 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34f95e9a-b247-433f-b5e1-998e7ea87d33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:34.678912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34f95e9a-b247-433f-b5e1-998e7ea87d33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:34.679585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34f95e9a-b247-433f-b5e1-998e7ea87d33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:34.680034 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34f95e9a-b247-433f-b5e1-998e7ea87d33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:34.680456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-34f95e9a-b247-433f-b5e1-998e7ea87d33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:34.742802 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-34f95e9a-b247-433f-b5e1-998e7ea87d33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:34.751253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-34f95e9a-b247-433f-b5e1-998e7ea87d33 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083561 Aug 08 09:13:34.751808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1195/2292] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:34 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:35.176165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e4bb8542-d475-4660-ae12-71a4d5119ece tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:35.176782 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e4bb8542-d475-4660-ae12-71a4d5119ece tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:35.182789 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb8542-d475-4660-ae12-71a4d5119ece tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:35.183280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb8542-d475-4660-ae12-71a4d5119ece tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:35.183722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb8542-d475-4660-ae12-71a4d5119ece tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:35.184417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb8542-d475-4660-ae12-71a4d5119ece tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:35.184879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb8542-d475-4660-ae12-71a4d5119ece tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:35.185352 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e4bb8542-d475-4660-ae12-71a4d5119ece tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:35.245402 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e4bb8542-d475-4660-ae12-71a4d5119ece tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:35.253277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e4bb8542-d475-4660-ae12-71a4d5119ece tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081545 Aug 08 09:13:35.253855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1098/2293] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:35 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:35.481599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f8eec09b-c3e7-43b5-afca-926c85273ad4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:35.482155 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f8eec09b-c3e7-43b5-afca-926c85273ad4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:35.488581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8eec09b-c3e7-43b5-afca-926c85273ad4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:35.489062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8eec09b-c3e7-43b5-afca-926c85273ad4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:35.489529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8eec09b-c3e7-43b5-afca-926c85273ad4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:35.490216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8eec09b-c3e7-43b5-afca-926c85273ad4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:35.490672 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8eec09b-c3e7-43b5-afca-926c85273ad4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:35.491105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8eec09b-c3e7-43b5-afca-926c85273ad4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:35.552836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f8eec09b-c3e7-43b5-afca-926c85273ad4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:35.560712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f8eec09b-c3e7-43b5-afca-926c85273ad4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082989 Aug 08 09:13:35.561289 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1196/2294] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:35 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:35.772366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-20766d3e-97bd-40f6-aa87-98207ad0d295 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:35.772941 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-20766d3e-97bd-40f6-aa87-98207ad0d295 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:35.779257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20766d3e-97bd-40f6-aa87-98207ad0d295 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:35.779736 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20766d3e-97bd-40f6-aa87-98207ad0d295 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:35.780173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20766d3e-97bd-40f6-aa87-98207ad0d295 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:35.780848 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20766d3e-97bd-40f6-aa87-98207ad0d295 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:35.781327 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20766d3e-97bd-40f6-aa87-98207ad0d295 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:35.781860 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20766d3e-97bd-40f6-aa87-98207ad0d295 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:35.844118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-20766d3e-97bd-40f6-aa87-98207ad0d295 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:35.852346 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-20766d3e-97bd-40f6-aa87-98207ad0d295 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083831 Aug 08 09:13:35.852943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1099/2295] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:35 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:36.274509 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-16389686-4bda-4cae-877f-8743b74484fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:36.275129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-16389686-4bda-4cae-877f-8743b74484fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:36.281235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16389686-4bda-4cae-877f-8743b74484fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:36.281747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16389686-4bda-4cae-877f-8743b74484fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:36.282202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16389686-4bda-4cae-877f-8743b74484fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:36.282972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16389686-4bda-4cae-877f-8743b74484fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:36.283433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16389686-4bda-4cae-877f-8743b74484fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:36.283866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-16389686-4bda-4cae-877f-8743b74484fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:36.347135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-16389686-4bda-4cae-877f-8743b74484fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:36.354760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-16389686-4bda-4cae-877f-8743b74484fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084190 Aug 08 09:13:36.355319 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1197/2296] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:36 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:36.581683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2aa8b5c2-f653-4809-83fe-624a087f3b8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:36.582224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2aa8b5c2-f653-4809-83fe-624a087f3b8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:36.588098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2aa8b5c2-f653-4809-83fe-624a087f3b8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:36.588603 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2aa8b5c2-f653-4809-83fe-624a087f3b8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:36.589036 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2aa8b5c2-f653-4809-83fe-624a087f3b8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:36.589738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2aa8b5c2-f653-4809-83fe-624a087f3b8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:36.590194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2aa8b5c2-f653-4809-83fe-624a087f3b8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:36.590614 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2aa8b5c2-f653-4809-83fe-624a087f3b8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:36.650921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2aa8b5c2-f653-4809-83fe-624a087f3b8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:36.659307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2aa8b5c2-f653-4809-83fe-624a087f3b8c tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081806 Aug 08 09:13:36.659862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1100/2297] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:36 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:36.873293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-faefb233-2cbc-426a-9293-3cfdc5ae7b1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:36.873908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-faefb233-2cbc-426a-9293-3cfdc5ae7b1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:36.880306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faefb233-2cbc-426a-9293-3cfdc5ae7b1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:36.880790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faefb233-2cbc-426a-9293-3cfdc5ae7b1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:36.881265 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faefb233-2cbc-426a-9293-3cfdc5ae7b1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:36.882127 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faefb233-2cbc-426a-9293-3cfdc5ae7b1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:36.882688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faefb233-2cbc-426a-9293-3cfdc5ae7b1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:36.883216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-faefb233-2cbc-426a-9293-3cfdc5ae7b1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:36.944063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-faefb233-2cbc-426a-9293-3cfdc5ae7b1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:36.952314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-faefb233-2cbc-426a-9293-3cfdc5ae7b1e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082849 Aug 08 09:13:36.952871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1198/2298] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:36 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:37.376816 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-272766cf-5e82-491e-b22c-a3085efc9c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:37.377462 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-272766cf-5e82-491e-b22c-a3085efc9c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:37.383358 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-272766cf-5e82-491e-b22c-a3085efc9c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:37.383842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-272766cf-5e82-491e-b22c-a3085efc9c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:37.384339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-272766cf-5e82-491e-b22c-a3085efc9c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:37.385013 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-272766cf-5e82-491e-b22c-a3085efc9c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:37.386651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-272766cf-5e82-491e-b22c-a3085efc9c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:37.386651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-272766cf-5e82-491e-b22c-a3085efc9c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:37.389921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:37.447837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-272766cf-5e82-491e-b22c-a3085efc9c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:37.456752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-272766cf-5e82-491e-b22c-a3085efc9c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084566 Aug 08 09:13:37.457334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1101/2299] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:37 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:37.681285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-075af38f-0707-4692-bfd3-9dc58c8d8abe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:37.681806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-075af38f-0707-4692-bfd3-9dc58c8d8abe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:37.688943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-075af38f-0707-4692-bfd3-9dc58c8d8abe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:37.689439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-075af38f-0707-4692-bfd3-9dc58c8d8abe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:37.689872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-075af38f-0707-4692-bfd3-9dc58c8d8abe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:37.690549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-075af38f-0707-4692-bfd3-9dc58c8d8abe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:37.690995 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-075af38f-0707-4692-bfd3-9dc58c8d8abe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:37.691416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-075af38f-0707-4692-bfd3-9dc58c8d8abe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:37.753030 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-075af38f-0707-4692-bfd3-9dc58c8d8abe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:37.760937 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-075af38f-0707-4692-bfd3-9dc58c8d8abe tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083549 Aug 08 09:13:37.761533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1199/2300] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:37 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:37.974329 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6da82e89-5428-4907-ba24-afa2fd7b456a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:37.974893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6da82e89-5428-4907-ba24-afa2fd7b456a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:37.981317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6da82e89-5428-4907-ba24-afa2fd7b456a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:37.981806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6da82e89-5428-4907-ba24-afa2fd7b456a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:37.982241 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6da82e89-5428-4907-ba24-afa2fd7b456a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:37.982927 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6da82e89-5428-4907-ba24-afa2fd7b456a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:37.983384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6da82e89-5428-4907-ba24-afa2fd7b456a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:37.983810 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6da82e89-5428-4907-ba24-afa2fd7b456a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:38.046166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6da82e89-5428-4907-ba24-afa2fd7b456a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:38.054658 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6da82e89-5428-4907-ba24-afa2fd7b456a tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.084323 Aug 08 09:13:38.055224 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1102/2301] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:37 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:38.476701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-afbe6126-7112-41d8-94be-28ab7317c6ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:38.477347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-afbe6126-7112-41d8-94be-28ab7317c6ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:38.483274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbe6126-7112-41d8-94be-28ab7317c6ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:38.483762 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbe6126-7112-41d8-94be-28ab7317c6ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:38.484232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbe6126-7112-41d8-94be-28ab7317c6ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:38.485055 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbe6126-7112-41d8-94be-28ab7317c6ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:38.485654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbe6126-7112-41d8-94be-28ab7317c6ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:38.486095 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-afbe6126-7112-41d8-94be-28ab7317c6ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:38.546695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-afbe6126-7112-41d8-94be-28ab7317c6ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:38.554165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-afbe6126-7112-41d8-94be-28ab7317c6ac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081285 Aug 08 09:13:38.554730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1200/2302] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:38 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:38.781673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a006de75-9a91-467d-b61a-0ff83eb0a496 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:38.782361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a006de75-9a91-467d-b61a-0ff83eb0a496 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:38.788242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a006de75-9a91-467d-b61a-0ff83eb0a496 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:38.788727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a006de75-9a91-467d-b61a-0ff83eb0a496 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:38.789171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a006de75-9a91-467d-b61a-0ff83eb0a496 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:38.789863 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a006de75-9a91-467d-b61a-0ff83eb0a496 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:38.790315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a006de75-9a91-467d-b61a-0ff83eb0a496 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:38.790731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a006de75-9a91-467d-b61a-0ff83eb0a496 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:38.850742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a006de75-9a91-467d-b61a-0ff83eb0a496 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:38.858545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a006de75-9a91-467d-b61a-0ff83eb0a496 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.080772 Aug 08 09:13:38.859101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1103/2303] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:38 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:39.074359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-02a375eb-4a1b-4218-a761-a9371d7e66ff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:39.074959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-02a375eb-4a1b-4218-a761-a9371d7e66ff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:39.082002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02a375eb-4a1b-4218-a761-a9371d7e66ff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:39.082483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02a375eb-4a1b-4218-a761-a9371d7e66ff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:39.082922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02a375eb-4a1b-4218-a761-a9371d7e66ff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:39.083603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02a375eb-4a1b-4218-a761-a9371d7e66ff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:39.084054 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02a375eb-4a1b-4218-a761-a9371d7e66ff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:39.084474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-02a375eb-4a1b-4218-a761-a9371d7e66ff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:39.148420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-02a375eb-4a1b-4218-a761-a9371d7e66ff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:39.156231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-02a375eb-4a1b-4218-a761-a9371d7e66ff tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.085679 Aug 08 09:13:39.157416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1201/2304] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:39 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:39.574439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-df512c7f-8dab-42d9-bc6d-1eea339d2455 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:39.575047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-df512c7f-8dab-42d9-bc6d-1eea339d2455 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:39.582450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df512c7f-8dab-42d9-bc6d-1eea339d2455 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:39.582935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df512c7f-8dab-42d9-bc6d-1eea339d2455 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:39.583371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df512c7f-8dab-42d9-bc6d-1eea339d2455 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:39.584054 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df512c7f-8dab-42d9-bc6d-1eea339d2455 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:39.584508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df512c7f-8dab-42d9-bc6d-1eea339d2455 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:39.584929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df512c7f-8dab-42d9-bc6d-1eea339d2455 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:39.646364 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-df512c7f-8dab-42d9-bc6d-1eea339d2455 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:39.653859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-df512c7f-8dab-42d9-bc6d-1eea339d2455 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083242 Aug 08 09:13:39.654424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1104/2305] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:39 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:39.879539 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c1777d1e-6d31-48b7-9e82-1dd80a15bec4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:39.880149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c1777d1e-6d31-48b7-9e82-1dd80a15bec4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:39.886273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1777d1e-6d31-48b7-9e82-1dd80a15bec4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:39.886742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1777d1e-6d31-48b7-9e82-1dd80a15bec4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:39.887179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1777d1e-6d31-48b7-9e82-1dd80a15bec4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:39.887892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1777d1e-6d31-48b7-9e82-1dd80a15bec4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:39.888391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1777d1e-6d31-48b7-9e82-1dd80a15bec4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:39.888811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c1777d1e-6d31-48b7-9e82-1dd80a15bec4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:39.950823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c1777d1e-6d31-48b7-9e82-1dd80a15bec4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:39.958906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c1777d1e-6d31-48b7-9e82-1dd80a15bec4 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083948 Aug 08 09:13:39.959471 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1202/2306] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:39 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:40.176729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-376ed792-eff4-45ef-9589-374b295cfe4b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:40.177385 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-376ed792-eff4-45ef-9589-374b295cfe4b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:40.183339 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-376ed792-eff4-45ef-9589-374b295cfe4b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:40.183825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-376ed792-eff4-45ef-9589-374b295cfe4b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:40.184263 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-376ed792-eff4-45ef-9589-374b295cfe4b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:40.184949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-376ed792-eff4-45ef-9589-374b295cfe4b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:40.185444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-376ed792-eff4-45ef-9589-374b295cfe4b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:40.185873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-376ed792-eff4-45ef-9589-374b295cfe4b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:40.247029 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-376ed792-eff4-45ef-9589-374b295cfe4b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:40.255530 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-376ed792-eff4-45ef-9589-374b295cfe4b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082787 Aug 08 09:13:40.256094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1105/2307] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:40 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:40.674970 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fbdf9ea2-fdf7-4f22-a1a6-a5513893138a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:40.675617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fbdf9ea2-fdf7-4f22-a1a6-a5513893138a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:40.682105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbdf9ea2-fdf7-4f22-a1a6-a5513893138a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:40.682582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbdf9ea2-fdf7-4f22-a1a6-a5513893138a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:40.683016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbdf9ea2-fdf7-4f22-a1a6-a5513893138a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:40.683692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbdf9ea2-fdf7-4f22-a1a6-a5513893138a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:40.684143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbdf9ea2-fdf7-4f22-a1a6-a5513893138a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:40.684564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fbdf9ea2-fdf7-4f22-a1a6-a5513893138a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:40.702852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:40.748572 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fbdf9ea2-fdf7-4f22-a1a6-a5513893138a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:40.756865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fbdf9ea2-fdf7-4f22-a1a6-a5513893138a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086576 Aug 08 09:13:40.757500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1203/2308] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:40 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:40.979079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cca94160-be55-4b58-a2b3-0494d257cc85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:40.979627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cca94160-be55-4b58-a2b3-0494d257cc85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:40.987019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cca94160-be55-4b58-a2b3-0494d257cc85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:40.987503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cca94160-be55-4b58-a2b3-0494d257cc85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:40.987943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cca94160-be55-4b58-a2b3-0494d257cc85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:40.988629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cca94160-be55-4b58-a2b3-0494d257cc85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:40.989116 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cca94160-be55-4b58-a2b3-0494d257cc85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:40.989570 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cca94160-be55-4b58-a2b3-0494d257cc85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:41.050167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cca94160-be55-4b58-a2b3-0494d257cc85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:41.057956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cca94160-be55-4b58-a2b3-0494d257cc85 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082809 Aug 08 09:13:41.058511 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1106/2309] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:40 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:41.276843 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d9dde7df-f8c3-42f8-9d9b-32c960e50298 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:41.277423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d9dde7df-f8c3-42f8-9d9b-32c960e50298 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:41.284023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9dde7df-f8c3-42f8-9d9b-32c960e50298 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:41.284513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9dde7df-f8c3-42f8-9d9b-32c960e50298 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:41.284958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9dde7df-f8c3-42f8-9d9b-32c960e50298 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:41.285690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9dde7df-f8c3-42f8-9d9b-32c960e50298 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:41.286152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9dde7df-f8c3-42f8-9d9b-32c960e50298 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:41.286589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d9dde7df-f8c3-42f8-9d9b-32c960e50298 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:41.347618 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d9dde7df-f8c3-42f8-9d9b-32c960e50298 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:41.355560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d9dde7df-f8c3-42f8-9d9b-32c960e50298 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082599 Aug 08 09:13:41.356124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1204/2310] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:41 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:41.777536 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ccf3debc-6dc8-44b8-aca2-accf6c6ed21a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:41.778203 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ccf3debc-6dc8-44b8-aca2-accf6c6ed21a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:41.780055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=84 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:41.784786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf3debc-6dc8-44b8-aca2-accf6c6ed21a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:41.785318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf3debc-6dc8-44b8-aca2-accf6c6ed21a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:41.785759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf3debc-6dc8-44b8-aca2-accf6c6ed21a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:41.786448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf3debc-6dc8-44b8-aca2-accf6c6ed21a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:41.786903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf3debc-6dc8-44b8-aca2-accf6c6ed21a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:41.787330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ccf3debc-6dc8-44b8-aca2-accf6c6ed21a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:41.847958 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ccf3debc-6dc8-44b8-aca2-accf6c6ed21a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:41.855355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ccf3debc-6dc8-44b8-aca2-accf6c6ed21a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081679 Aug 08 09:13:41.855921 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1107/2311] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:41 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:42.078485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5b784280-b754-412e-b885-b45654bc3c54 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:42.079082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5b784280-b754-412e-b885-b45654bc3c54 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:42.085423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b784280-b754-412e-b885-b45654bc3c54 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:42.085906 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b784280-b754-412e-b885-b45654bc3c54 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:42.086343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b784280-b754-412e-b885-b45654bc3c54 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:42.087025 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b784280-b754-412e-b885-b45654bc3c54 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:42.087478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b784280-b754-412e-b885-b45654bc3c54 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:42.087902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5b784280-b754-412e-b885-b45654bc3c54 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:42.152712 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5b784280-b754-412e-b885-b45654bc3c54 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:42.160635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5b784280-b754-412e-b885-b45654bc3c54 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.086059 Aug 08 09:13:42.161217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1205/2312] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:42 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:42.377055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6de910bc-6ab3-4e01-bbb9-13015d55b19c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:42.377689 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6de910bc-6ab3-4e01-bbb9-13015d55b19c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:42.384086 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6de910bc-6ab3-4e01-bbb9-13015d55b19c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:42.384565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6de910bc-6ab3-4e01-bbb9-13015d55b19c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:42.384998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6de910bc-6ab3-4e01-bbb9-13015d55b19c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:42.385707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6de910bc-6ab3-4e01-bbb9-13015d55b19c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:42.386162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6de910bc-6ab3-4e01-bbb9-13015d55b19c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:42.386585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6de910bc-6ab3-4e01-bbb9-13015d55b19c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:42.448025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6de910bc-6ab3-4e01-bbb9-13015d55b19c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:42.456302 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6de910bc-6ab3-4e01-bbb9-13015d55b19c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083724 Aug 08 09:13:42.456877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1108/2313] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:42 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:42.875621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f8164dd2-2681-4b1b-9ea0-0db5c146119f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:42.876240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f8164dd2-2681-4b1b-9ea0-0db5c146119f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:42.878791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=84 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:42.883456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8164dd2-2681-4b1b-9ea0-0db5c146119f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:42.883943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8164dd2-2681-4b1b-9ea0-0db5c146119f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:42.884383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8164dd2-2681-4b1b-9ea0-0db5c146119f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:42.885073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8164dd2-2681-4b1b-9ea0-0db5c146119f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:42.885568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8164dd2-2681-4b1b-9ea0-0db5c146119f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:42.885998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f8164dd2-2681-4b1b-9ea0-0db5c146119f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:42.947515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f8164dd2-2681-4b1b-9ea0-0db5c146119f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:42.954950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f8164dd2-2681-4b1b-9ea0-0db5c146119f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083134 Aug 08 09:13:42.955516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1206/2314] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:42 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:43.181742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-87b09246-d95e-4350-9b14-cf2fd246e843 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:43.182285 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-87b09246-d95e-4350-9b14-cf2fd246e843 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:43.188314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87b09246-d95e-4350-9b14-cf2fd246e843 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:43.188805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87b09246-d95e-4350-9b14-cf2fd246e843 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:43.189277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87b09246-d95e-4350-9b14-cf2fd246e843 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:43.189966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87b09246-d95e-4350-9b14-cf2fd246e843 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:43.190424 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87b09246-d95e-4350-9b14-cf2fd246e843 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:43.190850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-87b09246-d95e-4350-9b14-cf2fd246e843 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:43.250971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-87b09246-d95e-4350-9b14-cf2fd246e843 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:43.258862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-87b09246-d95e-4350-9b14-cf2fd246e843 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081029 Aug 08 09:13:43.259401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1109/2315] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:43 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:43.476690 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c13648ba-ea93-4c07-bf42-87bf9040e49e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:43.477264 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c13648ba-ea93-4c07-bf42-87bf9040e49e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:43.483554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c13648ba-ea93-4c07-bf42-87bf9040e49e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:43.484028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c13648ba-ea93-4c07-bf42-87bf9040e49e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:43.484462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c13648ba-ea93-4c07-bf42-87bf9040e49e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:43.485593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c13648ba-ea93-4c07-bf42-87bf9040e49e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:43.486051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c13648ba-ea93-4c07-bf42-87bf9040e49e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:43.486477 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c13648ba-ea93-4c07-bf42-87bf9040e49e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:43.550368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c13648ba-ea93-4c07-bf42-87bf9040e49e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:43.558086 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c13648ba-ea93-4c07-bf42-87bf9040e49e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.085257 Aug 08 09:13:43.558637 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1207/2316] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:43 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:43.975698 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-21aaf6c7-843b-4b5c-a02e-db3e9ce84e2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:43.976320 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-21aaf6c7-843b-4b5c-a02e-db3e9ce84e2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:43.982745 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-21aaf6c7-843b-4b5c-a02e-db3e9ce84e2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:43.983235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-21aaf6c7-843b-4b5c-a02e-db3e9ce84e2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:43.983682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-21aaf6c7-843b-4b5c-a02e-db3e9ce84e2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:43.984378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-21aaf6c7-843b-4b5c-a02e-db3e9ce84e2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:43.985529 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-21aaf6c7-843b-4b5c-a02e-db3e9ce84e2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:43.986239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-21aaf6c7-843b-4b5c-a02e-db3e9ce84e2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:44.048134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-21aaf6c7-843b-4b5c-a02e-db3e9ce84e2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:44.055741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-21aaf6c7-843b-4b5c-a02e-db3e9ce84e2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083907 Aug 08 09:13:44.058070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1110/2317] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:43 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:44.279822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e7836072-381b-4f67-8191-cb882be2b7f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:44.280381 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e7836072-381b-4f67-8191-cb882be2b7f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:44.286994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7836072-381b-4f67-8191-cb882be2b7f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:44.287466 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7836072-381b-4f67-8191-cb882be2b7f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:44.287928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7836072-381b-4f67-8191-cb882be2b7f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:44.288600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7836072-381b-4f67-8191-cb882be2b7f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:44.289047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7836072-381b-4f67-8191-cb882be2b7f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:44.289489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7836072-381b-4f67-8191-cb882be2b7f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:44.349549 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e7836072-381b-4f67-8191-cb882be2b7f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:44.357392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e7836072-381b-4f67-8191-cb882be2b7f9 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081396 Aug 08 09:13:44.357949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1208/2318] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:44 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:44.579642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ab575455-f7a5-4f19-bf76-131a0759d1ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:44.580155 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ab575455-f7a5-4f19-bf76-131a0759d1ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:44.586132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab575455-f7a5-4f19-bf76-131a0759d1ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:44.586644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab575455-f7a5-4f19-bf76-131a0759d1ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:44.587079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab575455-f7a5-4f19-bf76-131a0759d1ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:44.587765 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab575455-f7a5-4f19-bf76-131a0759d1ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:44.588222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab575455-f7a5-4f19-bf76-131a0759d1ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:44.588647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ab575455-f7a5-4f19-bf76-131a0759d1ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:44.650230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ab575455-f7a5-4f19-bf76-131a0759d1ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:44.658690 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ab575455-f7a5-4f19-bf76-131a0759d1ca tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083497 Aug 08 09:13:44.659251 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1111/2319] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:44 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:45.075968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-715f02e3-cf59-4e7b-93e0-796e100af0c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:45.076584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-715f02e3-cf59-4e7b-93e0-796e100af0c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:45.083035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715f02e3-cf59-4e7b-93e0-796e100af0c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:45.083522 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715f02e3-cf59-4e7b-93e0-796e100af0c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:45.083961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715f02e3-cf59-4e7b-93e0-796e100af0c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:45.084640 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715f02e3-cf59-4e7b-93e0-796e100af0c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:45.085094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715f02e3-cf59-4e7b-93e0-796e100af0c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:45.085544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-715f02e3-cf59-4e7b-93e0-796e100af0c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:45.150176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-715f02e3-cf59-4e7b-93e0-796e100af0c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:45.157741 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-715f02e3-cf59-4e7b-93e0-796e100af0c2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085591 Aug 08 09:13:45.158297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1209/2320] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:45 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:45.377943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e8800e40-9ed7-43b0-85b1-52fc94dc0855 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:45.378561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e8800e40-9ed7-43b0-85b1-52fc94dc0855 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:45.384920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8800e40-9ed7-43b0-85b1-52fc94dc0855 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:45.385439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8800e40-9ed7-43b0-85b1-52fc94dc0855 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:45.385877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8800e40-9ed7-43b0-85b1-52fc94dc0855 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:45.386563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8800e40-9ed7-43b0-85b1-52fc94dc0855 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:45.387016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8800e40-9ed7-43b0-85b1-52fc94dc0855 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:45.387438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e8800e40-9ed7-43b0-85b1-52fc94dc0855 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:45.449278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e8800e40-9ed7-43b0-85b1-52fc94dc0855 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:45.457956 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e8800e40-9ed7-43b0-85b1-52fc94dc0855 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083879 Aug 08 09:13:45.458515 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1112/2321] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:45 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:45.679002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-72608286-2072-4bc5-b151-f6bedff40862 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:45.679534 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-72608286-2072-4bc5-b151-f6bedff40862 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:45.685447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72608286-2072-4bc5-b151-f6bedff40862 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:45.685922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72608286-2072-4bc5-b151-f6bedff40862 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:45.686356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72608286-2072-4bc5-b151-f6bedff40862 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:45.687029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72608286-2072-4bc5-b151-f6bedff40862 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:45.687480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72608286-2072-4bc5-b151-f6bedff40862 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:45.688401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-72608286-2072-4bc5-b151-f6bedff40862 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:45.747605 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-72608286-2072-4bc5-b151-f6bedff40862 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:45.756008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-72608286-2072-4bc5-b151-f6bedff40862 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.080877 Aug 08 09:13:45.756563 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1210/2322] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:45 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:46.177987 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9dd3da46-51af-4432-8a3a-c75abe9c83ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:46.178602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9dd3da46-51af-4432-8a3a-c75abe9c83ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:46.184545 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dd3da46-51af-4432-8a3a-c75abe9c83ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:46.185025 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dd3da46-51af-4432-8a3a-c75abe9c83ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:46.185494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dd3da46-51af-4432-8a3a-c75abe9c83ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:46.186173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dd3da46-51af-4432-8a3a-c75abe9c83ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:46.186630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dd3da46-51af-4432-8a3a-c75abe9c83ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:46.187052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9dd3da46-51af-4432-8a3a-c75abe9c83ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:46.247559 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9dd3da46-51af-4432-8a3a-c75abe9c83ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:46.254963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9dd3da46-51af-4432-8a3a-c75abe9c83ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.080802 Aug 08 09:13:46.255516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1113/2323] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:46 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:13:46.478877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ab6f37eb-ae4a-49e0-9933-422d0d3f1975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:46.479424 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ab6f37eb-ae4a-49e0-9933-422d0d3f1975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:46.486524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab6f37eb-ae4a-49e0-9933-422d0d3f1975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:46.487010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab6f37eb-ae4a-49e0-9933-422d0d3f1975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:46.487441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab6f37eb-ae4a-49e0-9933-422d0d3f1975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:46.488118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab6f37eb-ae4a-49e0-9933-422d0d3f1975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:46.488567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab6f37eb-ae4a-49e0-9933-422d0d3f1975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:46.488990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ab6f37eb-ae4a-49e0-9933-422d0d3f1975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:46.552447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ab6f37eb-ae4a-49e0-9933-422d0d3f1975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:46.560247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ab6f37eb-ae4a-49e0-9933-422d0d3f1975 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.085282 Aug 08 09:13:46.560802 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1211/2324] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:46 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:46.776970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-56c0d167-67b8-41e9-b316-e0e15ee9a2a4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:46.777549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-56c0d167-67b8-41e9-b316-e0e15ee9a2a4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:46.784621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56c0d167-67b8-41e9-b316-e0e15ee9a2a4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:46.785102 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56c0d167-67b8-41e9-b316-e0e15ee9a2a4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:46.785569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56c0d167-67b8-41e9-b316-e0e15ee9a2a4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:46.786261 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56c0d167-67b8-41e9-b316-e0e15ee9a2a4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:46.786715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56c0d167-67b8-41e9-b316-e0e15ee9a2a4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:46.787138 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56c0d167-67b8-41e9-b316-e0e15ee9a2a4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:46.848449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-56c0d167-67b8-41e9-b316-e0e15ee9a2a4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:46.856286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-56c0d167-67b8-41e9-b316-e0e15ee9a2a4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083220 Aug 08 09:13:46.856849 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1114/2325] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:46 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:47.275352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0aaf6273-53be-4c17-9d54-bc5b0c9e12bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:47.275961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0aaf6273-53be-4c17-9d54-bc5b0c9e12bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:47.282457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0aaf6273-53be-4c17-9d54-bc5b0c9e12bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:47.282979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0aaf6273-53be-4c17-9d54-bc5b0c9e12bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:47.283429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0aaf6273-53be-4c17-9d54-bc5b0c9e12bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:47.284132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0aaf6273-53be-4c17-9d54-bc5b0c9e12bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:47.284596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0aaf6273-53be-4c17-9d54-bc5b0c9e12bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:47.285028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0aaf6273-53be-4c17-9d54-bc5b0c9e12bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:47.351770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0aaf6273-53be-4c17-9d54-bc5b0c9e12bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:47.354182 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0aaf6273-53be-4c17-9d54-bc5b0c9e12bb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082578 Aug 08 09:13:47.354749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1212/2326] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:47 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:47.580533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-291f8dc7-6818-4879-ace7-ceb0af6afd7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:47.581115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-291f8dc7-6818-4879-ace7-ceb0af6afd7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:47.587252 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-291f8dc7-6818-4879-ace7-ceb0af6afd7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:47.587747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-291f8dc7-6818-4879-ace7-ceb0af6afd7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:47.588195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-291f8dc7-6818-4879-ace7-ceb0af6afd7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:47.588893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-291f8dc7-6818-4879-ace7-ceb0af6afd7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:47.589390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-291f8dc7-6818-4879-ace7-ceb0af6afd7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:47.589824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-291f8dc7-6818-4879-ace7-ceb0af6afd7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:47.650372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-291f8dc7-6818-4879-ace7-ceb0af6afd7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:47.658886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-291f8dc7-6818-4879-ace7-ceb0af6afd7a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082336 Aug 08 09:13:47.659454 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1115/2327] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:47 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:47.876490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ced260ec-f109-4bd9-af17-787956662ec7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:47.877100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ced260ec-f109-4bd9-af17-787956662ec7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:47.883445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ced260ec-f109-4bd9-af17-787956662ec7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:47.883928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ced260ec-f109-4bd9-af17-787956662ec7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:47.884358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ced260ec-f109-4bd9-af17-787956662ec7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:47.885038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ced260ec-f109-4bd9-af17-787956662ec7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:47.885512 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ced260ec-f109-4bd9-af17-787956662ec7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:47.885936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ced260ec-f109-4bd9-af17-787956662ec7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:47.949046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ced260ec-f109-4bd9-af17-787956662ec7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:47.956900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ced260ec-f109-4bd9-af17-787956662ec7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.084287 Aug 08 09:13:47.957481 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1213/2328] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:47 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:48.375597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6e8ae5b6-ebe5-4228-ab70-a4b6c76ea31d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:48.376222 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6e8ae5b6-ebe5-4228-ab70-a4b6c76ea31d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:48.382617 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e8ae5b6-ebe5-4228-ab70-a4b6c76ea31d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:48.383103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e8ae5b6-ebe5-4228-ab70-a4b6c76ea31d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:48.383542 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e8ae5b6-ebe5-4228-ab70-a4b6c76ea31d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:48.384236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e8ae5b6-ebe5-4228-ab70-a4b6c76ea31d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:48.384695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e8ae5b6-ebe5-4228-ab70-a4b6c76ea31d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:48.385131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e8ae5b6-ebe5-4228-ab70-a4b6c76ea31d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:48.446443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6e8ae5b6-ebe5-4228-ab70-a4b6c76ea31d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:48.454520 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6e8ae5b6-ebe5-4228-ab70-a4b6c76ea31d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082355 Aug 08 09:13:48.455213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1116/2329] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:48 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:48.680536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7f72b988-7cf9-410f-9ce8-d57fecaf144b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:48.681170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7f72b988-7cf9-410f-9ce8-d57fecaf144b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:48.686983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f72b988-7cf9-410f-9ce8-d57fecaf144b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:48.687458 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f72b988-7cf9-410f-9ce8-d57fecaf144b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:48.688438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f72b988-7cf9-410f-9ce8-d57fecaf144b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:48.689309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f72b988-7cf9-410f-9ce8-d57fecaf144b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:48.689762 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f72b988-7cf9-410f-9ce8-d57fecaf144b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:48.690184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7f72b988-7cf9-410f-9ce8-d57fecaf144b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:48.752105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7f72b988-7cf9-410f-9ce8-d57fecaf144b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:48.759949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7f72b988-7cf9-410f-9ce8-d57fecaf144b tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.083181 Aug 08 09:13:48.760499 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1214/2330] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:48 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:48.978101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cb549f78-8fde-4712-9159-8513df58e6fa tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:48.979670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cb549f78-8fde-4712-9159-8513df58e6fa tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:48.985752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb549f78-8fde-4712-9159-8513df58e6fa tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:48.986239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb549f78-8fde-4712-9159-8513df58e6fa tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:48.986709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb549f78-8fde-4712-9159-8513df58e6fa tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:48.987398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb549f78-8fde-4712-9159-8513df58e6fa tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:48.987856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb549f78-8fde-4712-9159-8513df58e6fa tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:48.988283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cb549f78-8fde-4712-9159-8513df58e6fa tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:49.060725 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cb549f78-8fde-4712-9159-8513df58e6fa tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:49.064197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:49.068952 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cb549f78-8fde-4712-9159-8513df58e6fa tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.094797 Aug 08 09:13:49.069543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1117/2331] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:48 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:49.475177 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-28e1543e-7b23-42df-8349-9deb22f8cfd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:49.475787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-28e1543e-7b23-42df-8349-9deb22f8cfd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:49.482124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28e1543e-7b23-42df-8349-9deb22f8cfd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:49.482601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28e1543e-7b23-42df-8349-9deb22f8cfd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:49.483035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28e1543e-7b23-42df-8349-9deb22f8cfd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:49.483709 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28e1543e-7b23-42df-8349-9deb22f8cfd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:49.484160 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28e1543e-7b23-42df-8349-9deb22f8cfd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:49.484595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-28e1543e-7b23-42df-8349-9deb22f8cfd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:49.547773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-28e1543e-7b23-42df-8349-9deb22f8cfd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:49.555192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-28e1543e-7b23-42df-8349-9deb22f8cfd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083805 Aug 08 09:13:49.555747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1215/2332] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:49 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:49.781733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b42e24fb-0d4e-465c-a5be-8a21a966c9bf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:49.782417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b42e24fb-0d4e-465c-a5be-8a21a966c9bf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:49.789629 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b42e24fb-0d4e-465c-a5be-8a21a966c9bf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:49.790120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b42e24fb-0d4e-465c-a5be-8a21a966c9bf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:49.790563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b42e24fb-0d4e-465c-a5be-8a21a966c9bf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:49.791253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b42e24fb-0d4e-465c-a5be-8a21a966c9bf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:49.791714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b42e24fb-0d4e-465c-a5be-8a21a966c9bf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:49.792144 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b42e24fb-0d4e-465c-a5be-8a21a966c9bf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:49.855801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b42e24fb-0d4e-465c-a5be-8a21a966c9bf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:49.864840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b42e24fb-0d4e-465c-a5be-8a21a966c9bf tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087119 Aug 08 09:13:49.865434 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1118/2333] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:49 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:50.089348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8a3ed070-4e06-424a-ad9f-258375706a91 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:50.089960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8a3ed070-4e06-424a-ad9f-258375706a91 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:50.096483 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a3ed070-4e06-424a-ad9f-258375706a91 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:50.096959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a3ed070-4e06-424a-ad9f-258375706a91 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:50.097485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a3ed070-4e06-424a-ad9f-258375706a91 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:50.098168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a3ed070-4e06-424a-ad9f-258375706a91 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:50.098616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a3ed070-4e06-424a-ad9f-258375706a91 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:50.099038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8a3ed070-4e06-424a-ad9f-258375706a91 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:50.159879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8a3ed070-4e06-424a-ad9f-258375706a91 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:50.167868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8a3ed070-4e06-424a-ad9f-258375706a91 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082310 Aug 08 09:13:50.168432 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1216/2334] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:50 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:50.575665 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-336fe19c-c0d1-47e9-99ab-0a91d06f04ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:50.576280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-336fe19c-c0d1-47e9-99ab-0a91d06f04ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:50.582963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-336fe19c-c0d1-47e9-99ab-0a91d06f04ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:50.583452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-336fe19c-c0d1-47e9-99ab-0a91d06f04ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:50.583889 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-336fe19c-c0d1-47e9-99ab-0a91d06f04ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:50.584576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-336fe19c-c0d1-47e9-99ab-0a91d06f04ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:50.585040 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-336fe19c-c0d1-47e9-99ab-0a91d06f04ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:50.585506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-336fe19c-c0d1-47e9-99ab-0a91d06f04ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:50.645805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-336fe19c-c0d1-47e9-99ab-0a91d06f04ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:50.659130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-336fe19c-c0d1-47e9-99ab-0a91d06f04ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081695 Aug 08 09:13:50.659711 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1119/2335] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:50 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:50.887047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5f4f2f17-fde5-4a82-8b7f-47442ac83e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:50.887675 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5f4f2f17-fde5-4a82-8b7f-47442ac83e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:50.894753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f4f2f17-fde5-4a82-8b7f-47442ac83e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:50.895221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f4f2f17-fde5-4a82-8b7f-47442ac83e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:50.895662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f4f2f17-fde5-4a82-8b7f-47442ac83e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:50.896348 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f4f2f17-fde5-4a82-8b7f-47442ac83e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:50.896806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f4f2f17-fde5-4a82-8b7f-47442ac83e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:50.897275 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5f4f2f17-fde5-4a82-8b7f-47442ac83e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:50.959730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5f4f2f17-fde5-4a82-8b7f-47442ac83e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:50.967705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5f4f2f17-fde5-4a82-8b7f-47442ac83e67 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084479 Aug 08 09:13:50.968268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1217/2336] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:50 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:51.189039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b23b88ba-ff31-4ce7-9782-91e6b7c28af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:51.189598 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b23b88ba-ff31-4ce7-9782-91e6b7c28af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:51.196487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b23b88ba-ff31-4ce7-9782-91e6b7c28af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:51.196967 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b23b88ba-ff31-4ce7-9782-91e6b7c28af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:51.197426 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b23b88ba-ff31-4ce7-9782-91e6b7c28af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:51.198112 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b23b88ba-ff31-4ce7-9782-91e6b7c28af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:51.198569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b23b88ba-ff31-4ce7-9782-91e6b7c28af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:51.198998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b23b88ba-ff31-4ce7-9782-91e6b7c28af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:51.261774 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b23b88ba-ff31-4ce7-9782-91e6b7c28af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:51.269998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b23b88ba-ff31-4ce7-9782-91e6b7c28af7 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.085027 Aug 08 09:13:51.270560 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1120/2337] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:51 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:51.679790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2d2c61c0-bb13-45fd-b89b-d06e46ff7fd5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:51.680617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2d2c61c0-bb13-45fd-b89b-d06e46ff7fd5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:51.688830 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d2c61c0-bb13-45fd-b89b-d06e46ff7fd5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:51.689679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d2c61c0-bb13-45fd-b89b-d06e46ff7fd5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:51.690431 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d2c61c0-bb13-45fd-b89b-d06e46ff7fd5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:51.691166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d2c61c0-bb13-45fd-b89b-d06e46ff7fd5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:51.691628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d2c61c0-bb13-45fd-b89b-d06e46ff7fd5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:51.692063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2d2c61c0-bb13-45fd-b89b-d06e46ff7fd5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:51.752297 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2d2c61c0-bb13-45fd-b89b-d06e46ff7fd5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:51.759788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2d2c61c0-bb13-45fd-b89b-d06e46ff7fd5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083851 Aug 08 09:13:51.760338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1218/2338] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:51 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:51.988011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-562bbc86-23ec-4a32-877e-f0c6e4565b63 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:51.988540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-562bbc86-23ec-4a32-877e-f0c6e4565b63 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:51.994476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-562bbc86-23ec-4a32-877e-f0c6e4565b63 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:51.994960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-562bbc86-23ec-4a32-877e-f0c6e4565b63 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:51.995408 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-562bbc86-23ec-4a32-877e-f0c6e4565b63 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:51.996094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-562bbc86-23ec-4a32-877e-f0c6e4565b63 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:51.996554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-562bbc86-23ec-4a32-877e-f0c6e4565b63 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:51.996981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-562bbc86-23ec-4a32-877e-f0c6e4565b63 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:52.056673 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-562bbc86-23ec-4a32-877e-f0c6e4565b63 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:52.064684 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-562bbc86-23ec-4a32-877e-f0c6e4565b63 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.080785 Aug 08 09:13:52.065272 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1121/2339] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:51 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:52.293439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a914bc69-a068-4beb-ac17-647f9176522e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:52.293439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a914bc69-a068-4beb-ac17-647f9176522e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:52.297764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a914bc69-a068-4beb-ac17-647f9176522e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:52.298256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a914bc69-a068-4beb-ac17-647f9176522e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:52.298703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a914bc69-a068-4beb-ac17-647f9176522e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:52.299396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a914bc69-a068-4beb-ac17-647f9176522e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:52.299857 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a914bc69-a068-4beb-ac17-647f9176522e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:52.300291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a914bc69-a068-4beb-ac17-647f9176522e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:52.364899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a914bc69-a068-4beb-ac17-647f9176522e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:52.372885 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a914bc69-a068-4beb-ac17-647f9176522e tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.086244 Aug 08 09:13:52.373470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1219/2340] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:52 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:52.780565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-20ce5670-af29-4a50-bda7-28a5e27eb0f8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:52.781210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-20ce5670-af29-4a50-bda7-28a5e27eb0f8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:52.787690 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ce5670-af29-4a50-bda7-28a5e27eb0f8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:52.788177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ce5670-af29-4a50-bda7-28a5e27eb0f8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:52.788616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ce5670-af29-4a50-bda7-28a5e27eb0f8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:52.789335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ce5670-af29-4a50-bda7-28a5e27eb0f8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:52.789794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ce5670-af29-4a50-bda7-28a5e27eb0f8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:52.790219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-20ce5670-af29-4a50-bda7-28a5e27eb0f8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:52.850942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-20ce5670-af29-4a50-bda7-28a5e27eb0f8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:52.858526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-20ce5670-af29-4a50-bda7-28a5e27eb0f8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081803 Aug 08 09:13:52.859142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1122/2341] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:52 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:53.085536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e7a690c6-cc7d-4571-bad4-65bff671f06f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:53.086076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e7a690c6-cc7d-4571-bad4-65bff671f06f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:53.091961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a690c6-cc7d-4571-bad4-65bff671f06f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:53.092440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a690c6-cc7d-4571-bad4-65bff671f06f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:53.092874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a690c6-cc7d-4571-bad4-65bff671f06f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:53.093579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a690c6-cc7d-4571-bad4-65bff671f06f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:53.094032 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a690c6-cc7d-4571-bad4-65bff671f06f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:53.095062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e7a690c6-cc7d-4571-bad4-65bff671f06f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:53.098940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:13:53.154371 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e7a690c6-cc7d-4571-bad4-65bff671f06f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:53.162688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e7a690c6-cc7d-4571-bad4-65bff671f06f tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081118 Aug 08 09:13:53.163239 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1220/2342] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:53 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:53.395191 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8e4ef4dd-17a9-43f4-94b9-d00ea661560d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:53.395806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8e4ef4dd-17a9-43f4-94b9-d00ea661560d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:53.401773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e4ef4dd-17a9-43f4-94b9-d00ea661560d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:53.402255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e4ef4dd-17a9-43f4-94b9-d00ea661560d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:53.402687 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e4ef4dd-17a9-43f4-94b9-d00ea661560d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:53.403375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e4ef4dd-17a9-43f4-94b9-d00ea661560d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:53.403823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e4ef4dd-17a9-43f4-94b9-d00ea661560d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:53.404247 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e4ef4dd-17a9-43f4-94b9-d00ea661560d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:53.465584 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8e4ef4dd-17a9-43f4-94b9-d00ea661560d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:53.474006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8e4ef4dd-17a9-43f4-94b9-d00ea661560d tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083839 Aug 08 09:13:53.474562 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1123/2343] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:53 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:53.879327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-13303d82-e0e3-41c7-8821-623e6ccd27fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:53.879998 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-13303d82-e0e3-41c7-8821-623e6ccd27fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:53.886374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13303d82-e0e3-41c7-8821-623e6ccd27fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:53.886855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13303d82-e0e3-41c7-8821-623e6ccd27fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:53.887292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13303d82-e0e3-41c7-8821-623e6ccd27fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:53.887966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13303d82-e0e3-41c7-8821-623e6ccd27fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:53.888418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13303d82-e0e3-41c7-8821-623e6ccd27fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:53.888844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13303d82-e0e3-41c7-8821-623e6ccd27fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:53.951600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-13303d82-e0e3-41c7-8821-623e6ccd27fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:53.959722 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-13303d82-e0e3-41c7-8821-623e6ccd27fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084865 Aug 08 09:13:53.960271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1221/2344] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:53 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:54.183799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-19fce5d9-104a-434a-85c7-ede783aeccc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:54.184414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-19fce5d9-104a-434a-85c7-ede783aeccc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:54.191667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19fce5d9-104a-434a-85c7-ede783aeccc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:54.192158 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19fce5d9-104a-434a-85c7-ede783aeccc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:54.192597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19fce5d9-104a-434a-85c7-ede783aeccc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:54.193325 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19fce5d9-104a-434a-85c7-ede783aeccc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:54.193784 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19fce5d9-104a-434a-85c7-ede783aeccc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:54.194212 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-19fce5d9-104a-434a-85c7-ede783aeccc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:54.254521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-19fce5d9-104a-434a-85c7-ede783aeccc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:54.262390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-19fce5d9-104a-434a-85c7-ede783aeccc1 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.082422 Aug 08 09:13:54.262946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1124/2345] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:54 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:54.494423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5fa51170-76fc-4134-9304-1c2ae1c0846c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:54.495035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5fa51170-76fc-4134-9304-1c2ae1c0846c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:54.501217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5fa51170-76fc-4134-9304-1c2ae1c0846c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:54.501701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5fa51170-76fc-4134-9304-1c2ae1c0846c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:54.502186 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5fa51170-76fc-4134-9304-1c2ae1c0846c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:54.502818 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5fa51170-76fc-4134-9304-1c2ae1c0846c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:54.503269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5fa51170-76fc-4134-9304-1c2ae1c0846c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:54.503688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5fa51170-76fc-4134-9304-1c2ae1c0846c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:54.565796 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5fa51170-76fc-4134-9304-1c2ae1c0846c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:54.573667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5fa51170-76fc-4134-9304-1c2ae1c0846c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083091 Aug 08 09:13:54.574251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1222/2346] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:54 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:54.979783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8234b754-8afa-439f-bfda-2d07470bafac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:54.980395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8234b754-8afa-439f-bfda-2d07470bafac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:54.986448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8234b754-8afa-439f-bfda-2d07470bafac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:54.986936 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8234b754-8afa-439f-bfda-2d07470bafac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:54.987375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8234b754-8afa-439f-bfda-2d07470bafac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:54.988062 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8234b754-8afa-439f-bfda-2d07470bafac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:54.988522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8234b754-8afa-439f-bfda-2d07470bafac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:54.988953 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8234b754-8afa-439f-bfda-2d07470bafac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:55.049525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8234b754-8afa-439f-bfda-2d07470bafac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:55.056942 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8234b754-8afa-439f-bfda-2d07470bafac tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081071 Aug 08 09:13:55.057604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1125/2347] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:54 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:55.283891 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a90566db-2af2-450b-8eb1-91297e2558d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:55.284447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a90566db-2af2-450b-8eb1-91297e2558d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:55.290823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a90566db-2af2-450b-8eb1-91297e2558d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:55.291307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a90566db-2af2-450b-8eb1-91297e2558d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:55.291747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a90566db-2af2-450b-8eb1-91297e2558d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:55.292428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a90566db-2af2-450b-8eb1-91297e2558d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:55.292879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a90566db-2af2-450b-8eb1-91297e2558d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:55.293332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a90566db-2af2-450b-8eb1-91297e2558d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:55.513871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a90566db-2af2-450b-8eb1-91297e2558d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:55.522201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a90566db-2af2-450b-8eb1-91297e2558d8 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.242513 Aug 08 09:13:55.522756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1223/2348] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:55 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:55.594088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ff31f503-9ae5-4ed9-a4da-4e68fe9c58e4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:55.594677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ff31f503-9ae5-4ed9-a4da-4e68fe9c58e4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:55.601010 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff31f503-9ae5-4ed9-a4da-4e68fe9c58e4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:55.601592 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff31f503-9ae5-4ed9-a4da-4e68fe9c58e4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:55.602024 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff31f503-9ae5-4ed9-a4da-4e68fe9c58e4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:55.602707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff31f503-9ae5-4ed9-a4da-4e68fe9c58e4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:55.603157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff31f503-9ae5-4ed9-a4da-4e68fe9c58e4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:55.603579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ff31f503-9ae5-4ed9-a4da-4e68fe9c58e4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:55.664533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ff31f503-9ae5-4ed9-a4da-4e68fe9c58e4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:55.672873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ff31f503-9ae5-4ed9-a4da-4e68fe9c58e4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082173 Aug 08 09:13:55.673471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1126/2349] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:55 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:56.077395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8d00a75b-280e-4f0c-a500-3cf09d0d0325 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:56.078006 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8d00a75b-280e-4f0c-a500-3cf09d0d0325 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:56.083897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d00a75b-280e-4f0c-a500-3cf09d0d0325 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:56.084376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d00a75b-280e-4f0c-a500-3cf09d0d0325 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:56.084811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d00a75b-280e-4f0c-a500-3cf09d0d0325 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:56.085513 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d00a75b-280e-4f0c-a500-3cf09d0d0325 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:56.085966 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d00a75b-280e-4f0c-a500-3cf09d0d0325 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:56.086389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8d00a75b-280e-4f0c-a500-3cf09d0d0325 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:56.146439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8d00a75b-280e-4f0c-a500-3cf09d0d0325 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:56.153769 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8d00a75b-280e-4f0c-a500-3cf09d0d0325 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.080145 Aug 08 09:13:56.154323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1224/2350] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:56 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:56.542831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d63c3832-d59d-4c0b-8beb-ae372d1e8030 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:56.543439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d63c3832-d59d-4c0b-8beb-ae372d1e8030 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:56.549396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d63c3832-d59d-4c0b-8beb-ae372d1e8030 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:56.549900 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d63c3832-d59d-4c0b-8beb-ae372d1e8030 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:56.550333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d63c3832-d59d-4c0b-8beb-ae372d1e8030 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:56.551011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d63c3832-d59d-4c0b-8beb-ae372d1e8030 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:56.551463 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d63c3832-d59d-4c0b-8beb-ae372d1e8030 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:56.551881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d63c3832-d59d-4c0b-8beb-ae372d1e8030 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:56.612383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d63c3832-d59d-4c0b-8beb-ae372d1e8030 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:56.620209 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d63c3832-d59d-4c0b-8beb-ae372d1e8030 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081252 Aug 08 09:13:56.620760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1127/2351] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:56 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:56.692760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ffc4b5ec-6324-498e-827c-79d4e5b64d2b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:56.693374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ffc4b5ec-6324-498e-827c-79d4e5b64d2b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:56.699671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffc4b5ec-6324-498e-827c-79d4e5b64d2b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:56.700150 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffc4b5ec-6324-498e-827c-79d4e5b64d2b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:56.700586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffc4b5ec-6324-498e-827c-79d4e5b64d2b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:56.701294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffc4b5ec-6324-498e-827c-79d4e5b64d2b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:56.701748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffc4b5ec-6324-498e-827c-79d4e5b64d2b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:56.702168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ffc4b5ec-6324-498e-827c-79d4e5b64d2b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:56.764607 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ffc4b5ec-6324-498e-827c-79d4e5b64d2b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:56.773373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ffc4b5ec-6324-498e-827c-79d4e5b64d2b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.084400 Aug 08 09:13:56.773917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1225/2352] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:56 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:57.174851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8cc1c776-a6c4-411a-9cb8-6ef418a454dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:57.175466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8cc1c776-a6c4-411a-9cb8-6ef418a454dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:57.181686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc1c776-a6c4-411a-9cb8-6ef418a454dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:57.182169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc1c776-a6c4-411a-9cb8-6ef418a454dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:57.182603 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc1c776-a6c4-411a-9cb8-6ef418a454dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:57.183281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc1c776-a6c4-411a-9cb8-6ef418a454dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:57.183732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc1c776-a6c4-411a-9cb8-6ef418a454dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:57.184153 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8cc1c776-a6c4-411a-9cb8-6ef418a454dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:57.244354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8cc1c776-a6c4-411a-9cb8-6ef418a454dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:57.251892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8cc1c776-a6c4-411a-9cb8-6ef418a454dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.080922 Aug 08 09:13:57.252451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1128/2353] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:57 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:57.640720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7ce4a65a-5751-471f-988c-c4920193d73d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:57.641370 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7ce4a65a-5751-471f-988c-c4920193d73d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:57.647493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ce4a65a-5751-471f-988c-c4920193d73d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:57.647974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ce4a65a-5751-471f-988c-c4920193d73d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:57.648409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ce4a65a-5751-471f-988c-c4920193d73d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:57.649089 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ce4a65a-5751-471f-988c-c4920193d73d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:57.649568 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ce4a65a-5751-471f-988c-c4920193d73d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:57.649990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7ce4a65a-5751-471f-988c-c4920193d73d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:57.709416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7ce4a65a-5751-471f-988c-c4920193d73d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:57.717182 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7ce4a65a-5751-471f-988c-c4920193d73d tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.080251 Aug 08 09:13:57.717708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1226/2354] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:57 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:57.793647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dd9180db-c12c-44da-a473-9bd16173bc31 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:57.794257 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dd9180db-c12c-44da-a473-9bd16173bc31 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:57.800662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9180db-c12c-44da-a473-9bd16173bc31 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:57.801139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9180db-c12c-44da-a473-9bd16173bc31 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:57.801599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9180db-c12c-44da-a473-9bd16173bc31 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:57.802277 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9180db-c12c-44da-a473-9bd16173bc31 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:57.802730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9180db-c12c-44da-a473-9bd16173bc31 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:57.803148 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9180db-c12c-44da-a473-9bd16173bc31 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:57.864677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dd9180db-c12c-44da-a473-9bd16173bc31 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:57.872540 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dd9180db-c12c-44da-a473-9bd16173bc31 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.082724 Aug 08 09:13:57.873102 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1129/2355] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:57 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:58.271851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c763c01e-602b-433c-a538-cfa2a861351f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:58.272464 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c763c01e-602b-433c-a538-cfa2a861351f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:58.278395 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c763c01e-602b-433c-a538-cfa2a861351f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:58.278886 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c763c01e-602b-433c-a538-cfa2a861351f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:58.279327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c763c01e-602b-433c-a538-cfa2a861351f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:58.280016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c763c01e-602b-433c-a538-cfa2a861351f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:58.280472 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c763c01e-602b-433c-a538-cfa2a861351f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:58.280900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c763c01e-602b-433c-a538-cfa2a861351f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:58.346108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c763c01e-602b-433c-a538-cfa2a861351f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:58.353642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c763c01e-602b-433c-a538-cfa2a861351f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085668 Aug 08 09:13:58.354195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1227/2356] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:58 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:58.737620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2ba8e810-ce1d-4e07-88f2-dffaa362e6d6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:58.738167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2ba8e810-ce1d-4e07-88f2-dffaa362e6d6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:58.744185 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ba8e810-ce1d-4e07-88f2-dffaa362e6d6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:58.744680 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ba8e810-ce1d-4e07-88f2-dffaa362e6d6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:58.745120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ba8e810-ce1d-4e07-88f2-dffaa362e6d6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:58.745834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ba8e810-ce1d-4e07-88f2-dffaa362e6d6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:58.746286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ba8e810-ce1d-4e07-88f2-dffaa362e6d6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:58.746722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2ba8e810-ce1d-4e07-88f2-dffaa362e6d6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:58.807234 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2ba8e810-ce1d-4e07-88f2-dffaa362e6d6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:58.815162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2ba8e810-ce1d-4e07-88f2-dffaa362e6d6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081787 Aug 08 09:13:58.815724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1130/2357] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:58 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:58.893445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-483ec57b-1788-4d0c-8e07-8220b93f3ca4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:58.894051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-483ec57b-1788-4d0c-8e07-8220b93f3ca4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:58.900337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-483ec57b-1788-4d0c-8e07-8220b93f3ca4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:58.900816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-483ec57b-1788-4d0c-8e07-8220b93f3ca4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:58.901283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-483ec57b-1788-4d0c-8e07-8220b93f3ca4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:58.901971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-483ec57b-1788-4d0c-8e07-8220b93f3ca4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:58.902420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-483ec57b-1788-4d0c-8e07-8220b93f3ca4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:58.902841 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-483ec57b-1788-4d0c-8e07-8220b93f3ca4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:58.964231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-483ec57b-1788-4d0c-8e07-8220b93f3ca4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:58.972042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-483ec57b-1788-4d0c-8e07-8220b93f3ca4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083014 Aug 08 09:13:58.972592 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1228/2358] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:58 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:59.377023 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9096ec4c-62bb-4327-aa38-dc258b460aaf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:59.377668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9096ec4c-62bb-4327-aa38-dc258b460aaf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:59.383587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9096ec4c-62bb-4327-aa38-dc258b460aaf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:59.384075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9096ec4c-62bb-4327-aa38-dc258b460aaf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:59.384516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9096ec4c-62bb-4327-aa38-dc258b460aaf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:59.385230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9096ec4c-62bb-4327-aa38-dc258b460aaf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:59.385690 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9096ec4c-62bb-4327-aa38-dc258b460aaf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:59.386117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9096ec4c-62bb-4327-aa38-dc258b460aaf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:59.447517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9096ec4c-62bb-4327-aa38-dc258b460aaf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:59.455037 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9096ec4c-62bb-4327-aa38-dc258b460aaf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082643 Aug 08 09:13:59.455597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1131/2359] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:59 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:59.835895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d4ec9ae5-28d1-4510-b818-b919f555cdb2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:59.836465 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d4ec9ae5-28d1-4510-b818-b919f555cdb2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:59.842493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4ec9ae5-28d1-4510-b818-b919f555cdb2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:59.846901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4ec9ae5-28d1-4510-b818-b919f555cdb2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:59.846901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4ec9ae5-28d1-4510-b818-b919f555cdb2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:59.846901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4ec9ae5-28d1-4510-b818-b919f555cdb2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:59.846901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4ec9ae5-28d1-4510-b818-b919f555cdb2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:13:59.847360 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d4ec9ae5-28d1-4510-b818-b919f555cdb2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:13:59.911331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d4ec9ae5-28d1-4510-b818-b919f555cdb2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:13:59.919241 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d4ec9ae5-28d1-4510-b818-b919f555cdb2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.087318 Aug 08 09:13:59.919795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1229/2360] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:59 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:13:59.992200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a2a56a1d-01f1-4fb8-b0f5-b4ef40532631 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:13:59.992818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a2a56a1d-01f1-4fb8-b0f5-b4ef40532631 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:13:59.999338 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a56a1d-01f1-4fb8-b0f5-b4ef40532631 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:13:59.999828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a56a1d-01f1-4fb8-b0f5-b4ef40532631 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:00.000298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a56a1d-01f1-4fb8-b0f5-b4ef40532631 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:00.001309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a56a1d-01f1-4fb8-b0f5-b4ef40532631 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:00.001785 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a56a1d-01f1-4fb8-b0f5-b4ef40532631 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:00.002219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a2a56a1d-01f1-4fb8-b0f5-b4ef40532631 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:00.064185 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a2a56a1d-01f1-4fb8-b0f5-b4ef40532631 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:00.072162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a2a56a1d-01f1-4fb8-b0f5-b4ef40532631 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083871 Aug 08 09:14:00.072721 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1132/2361] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:13:59 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:00.475340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0539281e-2da1-4b18-acf4-04d0f7fce222 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:00.475992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0539281e-2da1-4b18-acf4-04d0f7fce222 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:00.481965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0539281e-2da1-4b18-acf4-04d0f7fce222 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:00.482456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0539281e-2da1-4b18-acf4-04d0f7fce222 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:00.482897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0539281e-2da1-4b18-acf4-04d0f7fce222 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:00.483583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0539281e-2da1-4b18-acf4-04d0f7fce222 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:00.484042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0539281e-2da1-4b18-acf4-04d0f7fce222 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:00.484470 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0539281e-2da1-4b18-acf4-04d0f7fce222 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:00.544893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0539281e-2da1-4b18-acf4-04d0f7fce222 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:00.552427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0539281e-2da1-4b18-acf4-04d0f7fce222 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.080984 Aug 08 09:14:00.552982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1230/2362] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:00 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:00.940517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ee38428a-1869-42ee-8086-f10f56f07fe6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:00.941130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ee38428a-1869-42ee-8086-f10f56f07fe6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:00.947096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee38428a-1869-42ee-8086-f10f56f07fe6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:00.947585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee38428a-1869-42ee-8086-f10f56f07fe6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:00.948018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee38428a-1869-42ee-8086-f10f56f07fe6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:00.948702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee38428a-1869-42ee-8086-f10f56f07fe6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:00.949188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee38428a-1869-42ee-8086-f10f56f07fe6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:00.949628 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ee38428a-1869-42ee-8086-f10f56f07fe6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:01.008749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ee38428a-1869-42ee-8086-f10f56f07fe6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:01.016644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ee38428a-1869-42ee-8086-f10f56f07fe6 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.080688 Aug 08 09:14:01.017486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1133/2363] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:00 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:01.093334 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2807b902-c8ed-4afa-acbe-c69b8334cd3c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:01.093947 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2807b902-c8ed-4afa-acbe-c69b8334cd3c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:01.100430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2807b902-c8ed-4afa-acbe-c69b8334cd3c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:01.100913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2807b902-c8ed-4afa-acbe-c69b8334cd3c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:01.101394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2807b902-c8ed-4afa-acbe-c69b8334cd3c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:01.102120 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2807b902-c8ed-4afa-acbe-c69b8334cd3c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:01.102578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2807b902-c8ed-4afa-acbe-c69b8334cd3c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:01.103004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2807b902-c8ed-4afa-acbe-c69b8334cd3c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:01.166821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2807b902-c8ed-4afa-acbe-c69b8334cd3c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:01.175338 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2807b902-c8ed-4afa-acbe-c69b8334cd3c tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.085900 Aug 08 09:14:01.175889 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1231/2364] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:01 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:01.573048 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b6d769f5-4d19-490f-aa9c-b6d3259c1026 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:01.573729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b6d769f5-4d19-490f-aa9c-b6d3259c1026 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:01.580370 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6d769f5-4d19-490f-aa9c-b6d3259c1026 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:01.580854 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6d769f5-4d19-490f-aa9c-b6d3259c1026 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:01.581327 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6d769f5-4d19-490f-aa9c-b6d3259c1026 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:01.582018 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6d769f5-4d19-490f-aa9c-b6d3259c1026 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:01.582476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6d769f5-4d19-490f-aa9c-b6d3259c1026 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:01.582905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b6d769f5-4d19-490f-aa9c-b6d3259c1026 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:01.601557 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=100 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:14:01.644221 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b6d769f5-4d19-490f-aa9c-b6d3259c1026 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:01.652095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b6d769f5-4d19-490f-aa9c-b6d3259c1026 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082934 Aug 08 09:14:01.652648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1134/2365] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:01 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:02.036550 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dd78daaa-3e68-4b5f-8d3c-1706cf916ad2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:02.037176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dd78daaa-3e68-4b5f-8d3c-1706cf916ad2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:02.043158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd78daaa-3e68-4b5f-8d3c-1706cf916ad2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:02.043644 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd78daaa-3e68-4b5f-8d3c-1706cf916ad2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:02.044085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd78daaa-3e68-4b5f-8d3c-1706cf916ad2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:02.044773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd78daaa-3e68-4b5f-8d3c-1706cf916ad2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:02.045255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd78daaa-3e68-4b5f-8d3c-1706cf916ad2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:02.045688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd78daaa-3e68-4b5f-8d3c-1706cf916ad2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:02.105238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-dd78daaa-3e68-4b5f-8d3c-1706cf916ad2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:02.113232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dd78daaa-3e68-4b5f-8d3c-1706cf916ad2 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.080499 Aug 08 09:14:02.113787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1232/2366] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:02 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:02.195737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-429a88c8-d7d0-4193-98ff-8e424e4d61e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:02.196349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-429a88c8-d7d0-4193-98ff-8e424e4d61e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:02.202676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a88c8-d7d0-4193-98ff-8e424e4d61e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:02.203177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a88c8-d7d0-4193-98ff-8e424e4d61e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:02.204192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a88c8-d7d0-4193-98ff-8e424e4d61e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:02.204879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a88c8-d7d0-4193-98ff-8e424e4d61e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:02.205371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a88c8-d7d0-4193-98ff-8e424e4d61e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:02.205802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-429a88c8-d7d0-4193-98ff-8e424e4d61e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:02.265868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-429a88c8-d7d0-4193-98ff-8e424e4d61e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:02.274884 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-429a88c8-d7d0-4193-98ff-8e424e4d61e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.083153 Aug 08 09:14:02.275449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1135/2367] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:02 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:02.673351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-226aa9c5-ec28-4e48-afb6-4a1e6ac655b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:02.674707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-226aa9c5-ec28-4e48-afb6-4a1e6ac655b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:02.680852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-226aa9c5-ec28-4e48-afb6-4a1e6ac655b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:02.681382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-226aa9c5-ec28-4e48-afb6-4a1e6ac655b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:02.681831 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-226aa9c5-ec28-4e48-afb6-4a1e6ac655b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:02.682528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-226aa9c5-ec28-4e48-afb6-4a1e6ac655b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:02.682989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-226aa9c5-ec28-4e48-afb6-4a1e6ac655b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:02.683421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-226aa9c5-ec28-4e48-afb6-4a1e6ac655b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:02.746946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-226aa9c5-ec28-4e48-afb6-4a1e6ac655b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:02.754742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-226aa9c5-ec28-4e48-afb6-4a1e6ac655b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085532 Aug 08 09:14:02.755294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1233/2368] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:02 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:03.134229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-8e9d64e2-a175-4081-a92a-f2c83a53610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:03.134852 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-8e9d64e2-a175-4081-a92a-f2c83a53610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:03.140885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e9d64e2-a175-4081-a92a-f2c83a53610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:03.141428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e9d64e2-a175-4081-a92a-f2c83a53610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:03.142152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e9d64e2-a175-4081-a92a-f2c83a53610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:03.143330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e9d64e2-a175-4081-a92a-f2c83a53610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:03.143790 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e9d64e2-a175-4081-a92a-f2c83a53610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:03.144215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-8e9d64e2-a175-4081-a92a-f2c83a53610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:03.203731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-8e9d64e2-a175-4081-a92a-f2c83a53610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:03.212100 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-8e9d64e2-a175-4081-a92a-f2c83a53610a tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.081823 Aug 08 09:14:03.212661 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1136/2369] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:03 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:03.295051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cbd10668-cf6c-43c0-aae3-599bcb7c6397 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:03.295661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cbd10668-cf6c-43c0-aae3-599bcb7c6397 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:03.302427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbd10668-cf6c-43c0-aae3-599bcb7c6397 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:03.302913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbd10668-cf6c-43c0-aae3-599bcb7c6397 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:03.303353 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbd10668-cf6c-43c0-aae3-599bcb7c6397 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:03.304038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbd10668-cf6c-43c0-aae3-599bcb7c6397 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:03.304490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbd10668-cf6c-43c0-aae3-599bcb7c6397 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:03.304917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cbd10668-cf6c-43c0-aae3-599bcb7c6397 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:03.365219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cbd10668-cf6c-43c0-aae3-599bcb7c6397 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:03.372952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cbd10668-cf6c-43c0-aae3-599bcb7c6397 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.081710 Aug 08 09:14:03.373537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1234/2370] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:03 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:03.774851 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-62663ec0-7f3e-44be-b32a-924fc2519ecd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:03.775499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-62663ec0-7f3e-44be-b32a-924fc2519ecd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:03.781531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62663ec0-7f3e-44be-b32a-924fc2519ecd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:03.782031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62663ec0-7f3e-44be-b32a-924fc2519ecd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:03.782473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62663ec0-7f3e-44be-b32a-924fc2519ecd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:03.783168 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62663ec0-7f3e-44be-b32a-924fc2519ecd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:03.783632 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62663ec0-7f3e-44be-b32a-924fc2519ecd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:03.784066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-62663ec0-7f3e-44be-b32a-924fc2519ecd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:03.845003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-62663ec0-7f3e-44be-b32a-924fc2519ecd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:03.852613 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-62663ec0-7f3e-44be-b32a-924fc2519ecd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081758 Aug 08 09:14:03.853200 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1137/2371] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:03 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:04.232724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8afac955-a086-428f-94fa-4b155e812fab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:04.233401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8afac955-a086-428f-94fa-4b155e812fab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] [instance: 83365b2d-9f2c-4966-bdb6-789059348c37] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:04.239698 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8afac955-a086-428f-94fa-4b155e812fab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:04.240180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8afac955-a086-428f-94fa-4b155e812fab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:04.240619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8afac955-a086-428f-94fa-4b155e812fab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:04.241403 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8afac955-a086-428f-94fa-4b155e812fab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:04.241854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8afac955-a086-428f-94fa-4b155e812fab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:04.242277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8afac955-a086-428f-94fa-4b155e812fab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:04.305063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8afac955-a086-428f-94fa-4b155e812fab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891658773e7546c78c3213a3f5233fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbf785f7de94ef7ad423568d41af122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:04.312999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8afac955-a086-428f-94fa-4b155e812fab tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37" status: 200 len: 1389 microversion: 2.1 time: 0.084160 Aug 08 09:14:04.313595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1235/2372] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:04 2022] GET /compute/v2.1/servers/83365b2d-9f2c-4966-bdb6-789059348c37 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:04.333517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-814ac64c-a6be-478a-8e3a-11f018f0fc20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] Calling method '.version_select at 0x7f479a40cb80>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:04.394608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3b8f5da7-1616-45cc-b134-f2e2753cb59b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:04.395224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3b8f5da7-1616-45cc-b134-f2e2753cb59b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: a22a3234-6e6a-4901-a390-8e621ef8134f] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:04.401414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b8f5da7-1616-45cc-b134-f2e2753cb59b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:04.401896 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b8f5da7-1616-45cc-b134-f2e2753cb59b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:04.402333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b8f5da7-1616-45cc-b134-f2e2753cb59b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:04.403018 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b8f5da7-1616-45cc-b134-f2e2753cb59b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:04.403473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b8f5da7-1616-45cc-b134-f2e2753cb59b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:04.403959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3b8f5da7-1616-45cc-b134-f2e2753cb59b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:04.419133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-814ac64c-a6be-478a-8e3a-11f018f0fc20 tempest-TestMinimumBasicScenario-951900542 tempest-TestMinimumBasicScenario-951900542-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1594176557" status: 202 len: 0 microversion: 2.1 time: 0.089603 Aug 08 09:14:04.422362 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1138/2373] 10.222.0.33 () {58 vars in 1272 bytes} [Mon Aug 8 09:14:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1594176557 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 09:14:04.467785 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3b8f5da7-1616-45cc-b134-f2e2753cb59b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:04.471205 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=100 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:14:04.476206 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3b8f5da7-1616-45cc-b134-f2e2753cb59b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f" status: 200 len: 1350 microversion: 2.1 time: 0.086845 Aug 08 09:14:04.476771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1236/2374] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:04 2022] GET /compute/v2.1/servers/a22a3234-6e6a-4901-a390-8e621ef8134f => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:14:04.873829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c9832d43-c554-4761-a1b7-b75568e941f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:04.874500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c9832d43-c554-4761-a1b7-b75568e941f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:04.882962 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9832d43-c554-4761-a1b7-b75568e941f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:04.883457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9832d43-c554-4761-a1b7-b75568e941f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:04.884030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9832d43-c554-4761-a1b7-b75568e941f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:04.884630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9832d43-c554-4761-a1b7-b75568e941f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:04.885199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9832d43-c554-4761-a1b7-b75568e941f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:04.885461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9832d43-c554-4761-a1b7-b75568e941f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:04.949337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c9832d43-c554-4761-a1b7-b75568e941f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:04.957039 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c9832d43-c554-4761-a1b7-b75568e941f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087200 Aug 08 09:14:04.957636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1139/2375] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:04 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:05.977850 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-30bdf271-5be7-4ec0-ab0c-39441e51f6e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:05.978463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-30bdf271-5be7-4ec0-ab0c-39441e51f6e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:05.985535 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30bdf271-5be7-4ec0-ab0c-39441e51f6e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:05.986026 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30bdf271-5be7-4ec0-ab0c-39441e51f6e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:05.987028 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30bdf271-5be7-4ec0-ab0c-39441e51f6e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:05.987733 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30bdf271-5be7-4ec0-ab0c-39441e51f6e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:05.988188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30bdf271-5be7-4ec0-ab0c-39441e51f6e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:05.988614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-30bdf271-5be7-4ec0-ab0c-39441e51f6e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:06.051834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-30bdf271-5be7-4ec0-ab0c-39441e51f6e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:06.060742 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-30bdf271-5be7-4ec0-ab0c-39441e51f6e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086718 Aug 08 09:14:06.061326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1237/2376] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:05 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:07.082353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c681a8dd-4cb0-4019-9e9a-e098a4296bdf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:07.083173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c681a8dd-4cb0-4019-9e9a-e098a4296bdf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:07.090105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c681a8dd-4cb0-4019-9e9a-e098a4296bdf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:07.090872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c681a8dd-4cb0-4019-9e9a-e098a4296bdf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:07.091501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c681a8dd-4cb0-4019-9e9a-e098a4296bdf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:07.092386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c681a8dd-4cb0-4019-9e9a-e098a4296bdf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:07.092872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c681a8dd-4cb0-4019-9e9a-e098a4296bdf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:07.093560 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c681a8dd-4cb0-4019-9e9a-e098a4296bdf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:07.191672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c681a8dd-4cb0-4019-9e9a-e098a4296bdf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:07.199175 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c681a8dd-4cb0-4019-9e9a-e098a4296bdf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.121817 Aug 08 09:14:07.199733 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1140/2377] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:07 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:08.220065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5797073a-e812-41f1-b113-3a2494274378 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:08.221243 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5797073a-e812-41f1-b113-3a2494274378 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:08.227817 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5797073a-e812-41f1-b113-3a2494274378 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:08.228310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5797073a-e812-41f1-b113-3a2494274378 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:08.228748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5797073a-e812-41f1-b113-3a2494274378 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:08.229467 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5797073a-e812-41f1-b113-3a2494274378 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:08.229928 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5797073a-e812-41f1-b113-3a2494274378 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:08.230355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5797073a-e812-41f1-b113-3a2494274378 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:08.359589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5797073a-e812-41f1-b113-3a2494274378 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:08.369903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5797073a-e812-41f1-b113-3a2494274378 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.153201 Aug 08 09:14:08.371122 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1238/2378] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:08 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:09.391242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-61c471b2-636e-4f81-a33c-ca9b869390d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:09.391887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-61c471b2-636e-4f81-a33c-ca9b869390d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:09.398850 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61c471b2-636e-4f81-a33c-ca9b869390d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:09.400431 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61c471b2-636e-4f81-a33c-ca9b869390d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:09.400431 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61c471b2-636e-4f81-a33c-ca9b869390d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:09.400431 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61c471b2-636e-4f81-a33c-ca9b869390d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:09.400906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61c471b2-636e-4f81-a33c-ca9b869390d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:09.401373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-61c471b2-636e-4f81-a33c-ca9b869390d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:09.481966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-61c471b2-636e-4f81-a33c-ca9b869390d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:09.490401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-61c471b2-636e-4f81-a33c-ca9b869390d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.103002 Aug 08 09:14:09.490981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1141/2379] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:09 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:10.511188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-084e3444-5d5c-42c7-a822-da849ad7646a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:10.511896 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-084e3444-5d5c-42c7-a822-da849ad7646a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:10.519441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-084e3444-5d5c-42c7-a822-da849ad7646a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:10.519933 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-084e3444-5d5c-42c7-a822-da849ad7646a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:10.520384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-084e3444-5d5c-42c7-a822-da849ad7646a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:10.521084 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-084e3444-5d5c-42c7-a822-da849ad7646a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:10.521572 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-084e3444-5d5c-42c7-a822-da849ad7646a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:10.522005 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-084e3444-5d5c-42c7-a822-da849ad7646a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:10.584098 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-084e3444-5d5c-42c7-a822-da849ad7646a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:10.591567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-084e3444-5d5c-42c7-a822-da849ad7646a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084190 Aug 08 09:14:10.592143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1239/2380] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:10 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:11.612121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f7eb0852-b951-4fea-aae5-af05a022bb40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:11.613839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f7eb0852-b951-4fea-aae5-af05a022bb40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:11.620727 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7eb0852-b951-4fea-aae5-af05a022bb40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:11.621366 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7eb0852-b951-4fea-aae5-af05a022bb40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:11.621874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7eb0852-b951-4fea-aae5-af05a022bb40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:11.622834 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7eb0852-b951-4fea-aae5-af05a022bb40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:11.623383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7eb0852-b951-4fea-aae5-af05a022bb40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:11.626707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7eb0852-b951-4fea-aae5-af05a022bb40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:11.691095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f7eb0852-b951-4fea-aae5-af05a022bb40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:11.699618 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f7eb0852-b951-4fea-aae5-af05a022bb40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.091517 Aug 08 09:14:11.700396 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1142/2381] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:11 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:12.719964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d560cd5f-6ad0-4694-be20-32245a4d57c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:12.720579 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d560cd5f-6ad0-4694-be20-32245a4d57c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:12.733803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d560cd5f-6ad0-4694-be20-32245a4d57c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:12.734680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d560cd5f-6ad0-4694-be20-32245a4d57c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:12.735287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d560cd5f-6ad0-4694-be20-32245a4d57c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:12.736406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d560cd5f-6ad0-4694-be20-32245a4d57c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:12.737002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d560cd5f-6ad0-4694-be20-32245a4d57c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:12.737478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d560cd5f-6ad0-4694-be20-32245a4d57c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:12.807486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d560cd5f-6ad0-4694-be20-32245a4d57c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:12.816378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d560cd5f-6ad0-4694-be20-32245a4d57c8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.099993 Aug 08 09:14:12.816945 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1240/2382] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:12 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:13.837566 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-32fc15b8-09d7-4f99-96af-7c33f378088a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:13.838082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-32fc15b8-09d7-4f99-96af-7c33f378088a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:13.840410 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:14:13.845055 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32fc15b8-09d7-4f99-96af-7c33f378088a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:13.845590 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32fc15b8-09d7-4f99-96af-7c33f378088a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:13.846030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32fc15b8-09d7-4f99-96af-7c33f378088a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:13.846714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32fc15b8-09d7-4f99-96af-7c33f378088a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:13.847747 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32fc15b8-09d7-4f99-96af-7c33f378088a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:13.848311 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-32fc15b8-09d7-4f99-96af-7c33f378088a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:13.914872 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-32fc15b8-09d7-4f99-96af-7c33f378088a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:13.924449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-32fc15b8-09d7-4f99-96af-7c33f378088a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.090707 Aug 08 09:14:13.925051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1143/2383] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:13 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:14.945806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-31a17723-af6f-4074-966d-7a53fa05e47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:14.946417 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-31a17723-af6f-4074-966d-7a53fa05e47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:14.948755 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=70 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:14:14.953330 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a17723-af6f-4074-966d-7a53fa05e47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:14.953820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a17723-af6f-4074-966d-7a53fa05e47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:14.954261 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a17723-af6f-4074-966d-7a53fa05e47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:14.957247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a17723-af6f-4074-966d-7a53fa05e47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:14.957247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a17723-af6f-4074-966d-7a53fa05e47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:14.957247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31a17723-af6f-4074-966d-7a53fa05e47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:15.017699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-31a17723-af6f-4074-966d-7a53fa05e47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:15.025121 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-31a17723-af6f-4074-966d-7a53fa05e47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083234 Aug 08 09:14:15.025775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1241/2384] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:14 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:16.046142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6bc075f7-67f6-4396-8368-f260180b2804 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:16.046750 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6bc075f7-67f6-4396-8368-f260180b2804 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:16.053799 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bc075f7-67f6-4396-8368-f260180b2804 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:16.054281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bc075f7-67f6-4396-8368-f260180b2804 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:16.054758 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bc075f7-67f6-4396-8368-f260180b2804 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:16.055457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bc075f7-67f6-4396-8368-f260180b2804 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:16.055934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bc075f7-67f6-4396-8368-f260180b2804 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:16.056359 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6bc075f7-67f6-4396-8368-f260180b2804 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:16.118236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6bc075f7-67f6-4396-8368-f260180b2804 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:16.125935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6bc075f7-67f6-4396-8368-f260180b2804 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084025 Aug 08 09:14:16.126514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1144/2385] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:16 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:17.147986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-21ee1963-69dc-4a05-a985-2d8f70d603ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:17.148595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-21ee1963-69dc-4a05-a985-2d8f70d603ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:17.155201 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-21ee1963-69dc-4a05-a985-2d8f70d603ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:17.155691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-21ee1963-69dc-4a05-a985-2d8f70d603ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:17.156543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-21ee1963-69dc-4a05-a985-2d8f70d603ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:17.156804 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-21ee1963-69dc-4a05-a985-2d8f70d603ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:17.157285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-21ee1963-69dc-4a05-a985-2d8f70d603ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:17.157724 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-21ee1963-69dc-4a05-a985-2d8f70d603ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:17.221486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-21ee1963-69dc-4a05-a985-2d8f70d603ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:17.229613 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-21ee1963-69dc-4a05-a985-2d8f70d603ee tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085815 Aug 08 09:14:17.230180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1242/2386] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:17 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:18.250977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2a2a0d90-763f-4ac5-8537-1534ed10d975 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:18.251672 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2a2a0d90-763f-4ac5-8537-1534ed10d975 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:18.259675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a2a0d90-763f-4ac5-8537-1534ed10d975 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:18.260161 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a2a0d90-763f-4ac5-8537-1534ed10d975 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:18.260622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a2a0d90-763f-4ac5-8537-1534ed10d975 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:18.261354 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a2a0d90-763f-4ac5-8537-1534ed10d975 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:18.261812 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a2a0d90-763f-4ac5-8537-1534ed10d975 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:18.262448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2a2a0d90-763f-4ac5-8537-1534ed10d975 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:18.353274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2a2a0d90-763f-4ac5-8537-1534ed10d975 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:18.364932 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2a2a0d90-763f-4ac5-8537-1534ed10d975 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.119138 Aug 08 09:14:18.365880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1145/2387] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:18 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:19.385423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-01752593-5957-4727-aa87-2dcd659d9b17 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:19.386576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-01752593-5957-4727-aa87-2dcd659d9b17 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:19.393435 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01752593-5957-4727-aa87-2dcd659d9b17 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:19.394873 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01752593-5957-4727-aa87-2dcd659d9b17 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:19.395691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01752593-5957-4727-aa87-2dcd659d9b17 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:19.396548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01752593-5957-4727-aa87-2dcd659d9b17 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:19.397177 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01752593-5957-4727-aa87-2dcd659d9b17 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:19.397749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-01752593-5957-4727-aa87-2dcd659d9b17 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:19.471446 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-01752593-5957-4727-aa87-2dcd659d9b17 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:19.479554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-01752593-5957-4727-aa87-2dcd659d9b17 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.098041 Aug 08 09:14:19.480139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1243/2388] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:19 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:20.500756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1a1634ec-5b64-428a-b3a2-f1c1494e41ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:20.501389 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1a1634ec-5b64-428a-b3a2-f1c1494e41ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:20.511839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a1634ec-5b64-428a-b3a2-f1c1494e41ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:20.511839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a1634ec-5b64-428a-b3a2-f1c1494e41ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:20.511839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a1634ec-5b64-428a-b3a2-f1c1494e41ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:20.511839 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a1634ec-5b64-428a-b3a2-f1c1494e41ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:20.512258 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a1634ec-5b64-428a-b3a2-f1c1494e41ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:20.512258 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a1634ec-5b64-428a-b3a2-f1c1494e41ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:20.598019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1a1634ec-5b64-428a-b3a2-f1c1494e41ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:20.604471 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1a1634ec-5b64-428a-b3a2-f1c1494e41ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.107419 Aug 08 09:14:20.605325 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1146/2389] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:20 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:21.625908 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1608b37e-a21a-4afb-9c5b-4e5f439381bd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:21.626516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1608b37e-a21a-4afb-9c5b-4e5f439381bd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:21.633430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1608b37e-a21a-4afb-9c5b-4e5f439381bd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:21.633916 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1608b37e-a21a-4afb-9c5b-4e5f439381bd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:21.634352 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1608b37e-a21a-4afb-9c5b-4e5f439381bd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:21.635041 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1608b37e-a21a-4afb-9c5b-4e5f439381bd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:21.635496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1608b37e-a21a-4afb-9c5b-4e5f439381bd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:21.635935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1608b37e-a21a-4afb-9c5b-4e5f439381bd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:21.698152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1608b37e-a21a-4afb-9c5b-4e5f439381bd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:21.705578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1608b37e-a21a-4afb-9c5b-4e5f439381bd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083431 Aug 08 09:14:21.706648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1244/2390] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:21 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:22.726637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c48b2459-94d7-4934-a953-3c9a0c6e1f94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:22.727427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c48b2459-94d7-4934-a953-3c9a0c6e1f94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:22.734258 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c48b2459-94d7-4934-a953-3c9a0c6e1f94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:22.734794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c48b2459-94d7-4934-a953-3c9a0c6e1f94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:22.735455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c48b2459-94d7-4934-a953-3c9a0c6e1f94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:22.736239 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c48b2459-94d7-4934-a953-3c9a0c6e1f94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:22.736898 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c48b2459-94d7-4934-a953-3c9a0c6e1f94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:22.738019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c48b2459-94d7-4934-a953-3c9a0c6e1f94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:22.810169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c48b2459-94d7-4934-a953-3c9a0c6e1f94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:22.818084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c48b2459-94d7-4934-a953-3c9a0c6e1f94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.095336 Aug 08 09:14:22.818650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1147/2391] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:22 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:23.838987 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-95c2a37c-a9a1-4cbf-a256-657dd91c17ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:23.840136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-95c2a37c-a9a1-4cbf-a256-657dd91c17ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:23.850314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-95c2a37c-a9a1-4cbf-a256-657dd91c17ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:23.851096 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-95c2a37c-a9a1-4cbf-a256-657dd91c17ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:23.859425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-95c2a37c-a9a1-4cbf-a256-657dd91c17ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:23.859425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-95c2a37c-a9a1-4cbf-a256-657dd91c17ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:23.859425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-95c2a37c-a9a1-4cbf-a256-657dd91c17ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:23.859425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-95c2a37c-a9a1-4cbf-a256-657dd91c17ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:23.965728 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-95c2a37c-a9a1-4cbf-a256-657dd91c17ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:23.979017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-95c2a37c-a9a1-4cbf-a256-657dd91c17ad tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.144096 Aug 08 09:14:23.994114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1245/2392] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:23 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:25.000586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-04e7c12e-f676-41c0-a680-daacaf7f48f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:25.002595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-04e7c12e-f676-41c0-a680-daacaf7f48f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:25.009988 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04e7c12e-f676-41c0-a680-daacaf7f48f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:25.010492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04e7c12e-f676-41c0-a680-daacaf7f48f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:25.010930 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04e7c12e-f676-41c0-a680-daacaf7f48f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:25.011643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04e7c12e-f676-41c0-a680-daacaf7f48f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:25.012100 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04e7c12e-f676-41c0-a680-daacaf7f48f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:25.012527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-04e7c12e-f676-41c0-a680-daacaf7f48f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:25.085878 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-04e7c12e-f676-41c0-a680-daacaf7f48f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:25.094949 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-04e7c12e-f676-41c0-a680-daacaf7f48f0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.098265 Aug 08 09:14:25.095519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1148/2393] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:24 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:26.117560 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7fdd64ea-924b-4d86-9920-435ff2bcc57d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:26.118207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7fdd64ea-924b-4d86-9920-435ff2bcc57d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:26.124856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fdd64ea-924b-4d86-9920-435ff2bcc57d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:26.125595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fdd64ea-924b-4d86-9920-435ff2bcc57d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:26.126044 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fdd64ea-924b-4d86-9920-435ff2bcc57d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:26.126997 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fdd64ea-924b-4d86-9920-435ff2bcc57d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:26.127533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fdd64ea-924b-4d86-9920-435ff2bcc57d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:26.128093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7fdd64ea-924b-4d86-9920-435ff2bcc57d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:26.203318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7fdd64ea-924b-4d86-9920-435ff2bcc57d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:26.211401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7fdd64ea-924b-4d86-9920-435ff2bcc57d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.097754 Aug 08 09:14:26.211955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1246/2394] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:26 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:27.232089 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-15c59cc8-37e8-426e-8066-18308e3f7875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:27.232896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-15c59cc8-37e8-426e-8066-18308e3f7875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:27.239439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-15c59cc8-37e8-426e-8066-18308e3f7875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:27.239935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-15c59cc8-37e8-426e-8066-18308e3f7875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:27.240373 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-15c59cc8-37e8-426e-8066-18308e3f7875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:27.241083 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-15c59cc8-37e8-426e-8066-18308e3f7875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:27.242148 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-15c59cc8-37e8-426e-8066-18308e3f7875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:27.242148 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-15c59cc8-37e8-426e-8066-18308e3f7875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:27.366856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-15c59cc8-37e8-426e-8066-18308e3f7875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:27.375171 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-15c59cc8-37e8-426e-8066-18308e3f7875 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.146890 Aug 08 09:14:27.390399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1149/2395] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:27 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:27.847074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-200c46f8-1656-4e54-bd25-d38618a84cee tempest-TestShelveInstance-654509028 tempest-TestShelveInstance-654509028-project] Action: 'create', calling method: .version_select at 0x7f4795f73280>, body: {"keypair": {"name": "tempest-TestShelveInstance-2077275754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZA7w3nicYxM+NdmhFfFzKPDyQc1AiKf8BVv+ZP2cNUOL0opY7fKrOCyDmnaM6rb2x8LMJNj2QSvX0P2+jgXDEspYs69xPc0SQWxwA3hLuT900+UTKylxQsniVwsY/gWg=="}} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 09:14:27.863702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-200c46f8-1656-4e54-bd25-d38618a84cee tempest-TestShelveInstance-654509028 tempest-TestShelveInstance-654509028-project] Getting quotas for project b7f5daa7b9e84f7e866fc990001b8666. Resources: {'key_pairs'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 09:14:27.867757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.quota [None req-200c46f8-1656-4e54-bd25-d38618a84cee tempest-TestShelveInstance-654509028 tempest-TestShelveInstance-654509028-project] Getting quotas for user 2754079f211f4a30a60cd38911f3305b and project b7f5daa7b9e84f7e866fc990001b8666. Resources: {'key_pairs'} {{(pid=124673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 09:14:27.996666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-200c46f8-1656-4e54-bd25-d38618a84cee tempest-TestShelveInstance-654509028 tempest-TestShelveInstance-654509028-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.321078 Aug 08 09:14:27.997227 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1247/2396] 10.222.0.33 () {60 vars in 1159 bytes} [Mon Aug 8 09:14:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 09:14:28.397099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-aa464870-688f-4c50-92a8-39a60dc0b02f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:28.397755 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-aa464870-688f-4c50-92a8-39a60dc0b02f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:28.427712 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa464870-688f-4c50-92a8-39a60dc0b02f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:28.428221 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa464870-688f-4c50-92a8-39a60dc0b02f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:28.428668 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa464870-688f-4c50-92a8-39a60dc0b02f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:28.430081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa464870-688f-4c50-92a8-39a60dc0b02f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:28.430588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa464870-688f-4c50-92a8-39a60dc0b02f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:28.431240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-aa464870-688f-4c50-92a8-39a60dc0b02f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:28.504991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-aa464870-688f-4c50-92a8-39a60dc0b02f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:28.512716 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-aa464870-688f-4c50-92a8-39a60dc0b02f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.119699 Aug 08 09:14:28.513344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1150/2397] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:28 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:29.535302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-185c194b-bb69-43ec-9c7f-fd87156c920f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:29.535919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-185c194b-bb69-43ec-9c7f-fd87156c920f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:29.542792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-185c194b-bb69-43ec-9c7f-fd87156c920f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:29.543304 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-185c194b-bb69-43ec-9c7f-fd87156c920f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:29.543707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-185c194b-bb69-43ec-9c7f-fd87156c920f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:29.544396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-185c194b-bb69-43ec-9c7f-fd87156c920f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:29.544851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-185c194b-bb69-43ec-9c7f-fd87156c920f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:29.545326 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-185c194b-bb69-43ec-9c7f-fd87156c920f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:29.623887 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-185c194b-bb69-43ec-9c7f-fd87156c920f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:29.632972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-185c194b-bb69-43ec-9c7f-fd87156c920f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.102600 Aug 08 09:14:29.645368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1248/2398] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:29 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:30.654579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-eb0f740b-0c77-46a4-8eef-1bf368ee4be6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:30.655197 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-eb0f740b-0c77-46a4-8eef-1bf368ee4be6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:30.662061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb0f740b-0c77-46a4-8eef-1bf368ee4be6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:30.662550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb0f740b-0c77-46a4-8eef-1bf368ee4be6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:30.662990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb0f740b-0c77-46a4-8eef-1bf368ee4be6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:30.663676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb0f740b-0c77-46a4-8eef-1bf368ee4be6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:30.664132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb0f740b-0c77-46a4-8eef-1bf368ee4be6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:30.664561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-eb0f740b-0c77-46a4-8eef-1bf368ee4be6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:30.726360 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-eb0f740b-0c77-46a4-8eef-1bf368ee4be6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:30.734122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-eb0f740b-0c77-46a4-8eef-1bf368ee4be6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083324 Aug 08 09:14:30.734920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1151/2399] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:30 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:31.755576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-12234d7e-91a6-4327-8a01-bec90b464f3a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:31.756141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-12234d7e-91a6-4327-8a01-bec90b464f3a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:31.762629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12234d7e-91a6-4327-8a01-bec90b464f3a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:31.763110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12234d7e-91a6-4327-8a01-bec90b464f3a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:31.763545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12234d7e-91a6-4327-8a01-bec90b464f3a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:31.764222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12234d7e-91a6-4327-8a01-bec90b464f3a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:31.764673 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12234d7e-91a6-4327-8a01-bec90b464f3a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:31.765097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-12234d7e-91a6-4327-8a01-bec90b464f3a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:31.825744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-12234d7e-91a6-4327-8a01-bec90b464f3a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:31.833242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-12234d7e-91a6-4327-8a01-bec90b464f3a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082191 Aug 08 09:14:31.833791 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1249/2400] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:31 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:32.854210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-92be813f-c4d0-41b4-981e-423c532001a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:32.854738 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-92be813f-c4d0-41b4-981e-423c532001a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:32.861499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-92be813f-c4d0-41b4-981e-423c532001a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:32.862022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-92be813f-c4d0-41b4-981e-423c532001a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:32.862642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-92be813f-c4d0-41b4-981e-423c532001a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:32.863344 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-92be813f-c4d0-41b4-981e-423c532001a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:32.863803 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-92be813f-c4d0-41b4-981e-423c532001a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:32.864229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-92be813f-c4d0-41b4-981e-423c532001a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:32.866863 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=99 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:14:32.928113 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-92be813f-c4d0-41b4-981e-423c532001a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:32.935593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-92be813f-c4d0-41b4-981e-423c532001a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085671 Aug 08 09:14:32.936157 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1152/2401] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:32 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:33.955936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9ed922c6-82ea-4ce5-8549-6aa74005f86e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:33.956958 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9ed922c6-82ea-4ce5-8549-6aa74005f86e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:33.963332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ed922c6-82ea-4ce5-8549-6aa74005f86e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:33.963814 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ed922c6-82ea-4ce5-8549-6aa74005f86e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:33.964255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ed922c6-82ea-4ce5-8549-6aa74005f86e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:33.964940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ed922c6-82ea-4ce5-8549-6aa74005f86e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:33.965420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ed922c6-82ea-4ce5-8549-6aa74005f86e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:33.965849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9ed922c6-82ea-4ce5-8549-6aa74005f86e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:34.026475 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9ed922c6-82ea-4ce5-8549-6aa74005f86e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:34.034740 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9ed922c6-82ea-4ce5-8549-6aa74005f86e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082148 Aug 08 09:14:34.035356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1250/2402] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:33 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:35.055014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6205c9e7-43c4-4e84-ac63-e19384f48bc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:35.055621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6205c9e7-43c4-4e84-ac63-e19384f48bc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:35.062054 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6205c9e7-43c4-4e84-ac63-e19384f48bc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:35.062459 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6205c9e7-43c4-4e84-ac63-e19384f48bc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:35.062893 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6205c9e7-43c4-4e84-ac63-e19384f48bc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:35.063575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6205c9e7-43c4-4e84-ac63-e19384f48bc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:35.064030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6205c9e7-43c4-4e84-ac63-e19384f48bc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:35.064455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6205c9e7-43c4-4e84-ac63-e19384f48bc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:35.126928 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6205c9e7-43c4-4e84-ac63-e19384f48bc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:35.134847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6205c9e7-43c4-4e84-ac63-e19384f48bc3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083646 Aug 08 09:14:35.135408 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1153/2403] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:35 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:14:36.155863 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-13ddef16-7b23-4705-8941-60766f827083 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:36.156473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-13ddef16-7b23-4705-8941-60766f827083 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:36.162476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ddef16-7b23-4705-8941-60766f827083 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:36.162956 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ddef16-7b23-4705-8941-60766f827083 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:36.163392 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ddef16-7b23-4705-8941-60766f827083 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:36.164076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ddef16-7b23-4705-8941-60766f827083 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:36.164528 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ddef16-7b23-4705-8941-60766f827083 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:36.164950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-13ddef16-7b23-4705-8941-60766f827083 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:36.167432 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=79 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:14:36.228258 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-13ddef16-7b23-4705-8941-60766f827083 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:36.235798 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-13ddef16-7b23-4705-8941-60766f827083 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083908 Aug 08 09:14:36.236350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1251/2404] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:36 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:37.257609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4cfbdbc0-9833-473e-9d29-378de1ab5a20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:37.258231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4cfbdbc0-9833-473e-9d29-378de1ab5a20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:37.264334 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfbdbc0-9833-473e-9d29-378de1ab5a20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:37.264825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfbdbc0-9833-473e-9d29-378de1ab5a20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:37.265303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfbdbc0-9833-473e-9d29-378de1ab5a20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:37.265990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfbdbc0-9833-473e-9d29-378de1ab5a20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:37.266453 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfbdbc0-9833-473e-9d29-378de1ab5a20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:37.266976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4cfbdbc0-9833-473e-9d29-378de1ab5a20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:37.332748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4cfbdbc0-9833-473e-9d29-378de1ab5a20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:37.340577 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4cfbdbc0-9833-473e-9d29-378de1ab5a20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086818 Aug 08 09:14:37.341172 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1154/2405] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:37 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:38.361011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9a090bc1-1c47-4bb6-a9de-153d38b18f55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:38.361699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9a090bc1-1c47-4bb6-a9de-153d38b18f55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:38.364179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=4 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:14:38.368826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9a090bc1-1c47-4bb6-a9de-153d38b18f55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:38.369351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9a090bc1-1c47-4bb6-a9de-153d38b18f55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:38.369790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9a090bc1-1c47-4bb6-a9de-153d38b18f55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:38.370473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9a090bc1-1c47-4bb6-a9de-153d38b18f55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:38.370926 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9a090bc1-1c47-4bb6-a9de-153d38b18f55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:38.376746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9a090bc1-1c47-4bb6-a9de-153d38b18f55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:38.433242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9a090bc1-1c47-4bb6-a9de-153d38b18f55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:38.440951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9a090bc1-1c47-4bb6-a9de-153d38b18f55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083583 Aug 08 09:14:38.441542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1252/2406] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:38 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:39.461646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bd755a61-389d-41cb-a7b8-38c8139e1c36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:39.462258 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bd755a61-389d-41cb-a7b8-38c8139e1c36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:39.468581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd755a61-389d-41cb-a7b8-38c8139e1c36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:39.469067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd755a61-389d-41cb-a7b8-38c8139e1c36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:39.469535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd755a61-389d-41cb-a7b8-38c8139e1c36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:39.470215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd755a61-389d-41cb-a7b8-38c8139e1c36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:39.470671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd755a61-389d-41cb-a7b8-38c8139e1c36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:39.471093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd755a61-389d-41cb-a7b8-38c8139e1c36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:39.532677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bd755a61-389d-41cb-a7b8-38c8139e1c36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:39.540800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bd755a61-389d-41cb-a7b8-38c8139e1c36 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082950 Aug 08 09:14:39.541386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1155/2407] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:39 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:40.562123 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-15c2b727-07d3-4412-bfaa-079b16293b08 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:40.562685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-15c2b727-07d3-4412-bfaa-079b16293b08 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:40.569930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15c2b727-07d3-4412-bfaa-079b16293b08 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:40.570422 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15c2b727-07d3-4412-bfaa-079b16293b08 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:40.570870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15c2b727-07d3-4412-bfaa-079b16293b08 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:40.571570 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15c2b727-07d3-4412-bfaa-079b16293b08 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:40.572034 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15c2b727-07d3-4412-bfaa-079b16293b08 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:40.572473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15c2b727-07d3-4412-bfaa-079b16293b08 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:40.634489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-15c2b727-07d3-4412-bfaa-079b16293b08 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:40.641951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-15c2b727-07d3-4412-bfaa-079b16293b08 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083787 Aug 08 09:14:40.642510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1253/2408] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:40 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:41.662637 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a52c3e9f-05af-4b9b-b394-aa81721074a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:41.663259 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a52c3e9f-05af-4b9b-b394-aa81721074a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:41.669686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a52c3e9f-05af-4b9b-b394-aa81721074a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:41.670179 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a52c3e9f-05af-4b9b-b394-aa81721074a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:41.670623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a52c3e9f-05af-4b9b-b394-aa81721074a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:41.671313 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a52c3e9f-05af-4b9b-b394-aa81721074a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:41.671777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a52c3e9f-05af-4b9b-b394-aa81721074a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:41.672210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a52c3e9f-05af-4b9b-b394-aa81721074a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:41.735532 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-a52c3e9f-05af-4b9b-b394-aa81721074a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:41.743214 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a52c3e9f-05af-4b9b-b394-aa81721074a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084553 Aug 08 09:14:41.743783 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1156/2409] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:41 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:42.764365 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1eb5723f-e7ae-4c9d-8dc7-063ee89017f4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:42.764989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1eb5723f-e7ae-4c9d-8dc7-063ee89017f4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:42.771865 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1eb5723f-e7ae-4c9d-8dc7-063ee89017f4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:42.772351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1eb5723f-e7ae-4c9d-8dc7-063ee89017f4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:42.772788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1eb5723f-e7ae-4c9d-8dc7-063ee89017f4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:42.773505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1eb5723f-e7ae-4c9d-8dc7-063ee89017f4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:42.773965 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1eb5723f-e7ae-4c9d-8dc7-063ee89017f4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:42.774393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1eb5723f-e7ae-4c9d-8dc7-063ee89017f4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:42.835551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1eb5723f-e7ae-4c9d-8dc7-063ee89017f4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:42.842951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1eb5723f-e7ae-4c9d-8dc7-063ee89017f4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082443 Aug 08 09:14:42.843510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1254/2410] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:42 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:43.864061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fed8009e-a2b2-4ee1-bcaa-884c02725532 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:43.864582 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fed8009e-a2b2-4ee1-bcaa-884c02725532 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:43.871011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fed8009e-a2b2-4ee1-bcaa-884c02725532 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:43.871492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fed8009e-a2b2-4ee1-bcaa-884c02725532 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:43.871926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fed8009e-a2b2-4ee1-bcaa-884c02725532 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:43.872605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fed8009e-a2b2-4ee1-bcaa-884c02725532 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:43.873064 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fed8009e-a2b2-4ee1-bcaa-884c02725532 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:43.873509 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fed8009e-a2b2-4ee1-bcaa-884c02725532 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:43.934128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fed8009e-a2b2-4ee1-bcaa-884c02725532 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:43.941537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fed8009e-a2b2-4ee1-bcaa-884c02725532 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081989 Aug 08 09:14:43.942088 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1157/2411] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:43 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:44.962149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f37d6675-3b2a-4076-80e0-abbdf23f2b2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:44.962730 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f37d6675-3b2a-4076-80e0-abbdf23f2b2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:44.969097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f37d6675-3b2a-4076-80e0-abbdf23f2b2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:44.969616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f37d6675-3b2a-4076-80e0-abbdf23f2b2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:44.970061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f37d6675-3b2a-4076-80e0-abbdf23f2b2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:44.970757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f37d6675-3b2a-4076-80e0-abbdf23f2b2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:44.971220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f37d6675-3b2a-4076-80e0-abbdf23f2b2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:44.971647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f37d6675-3b2a-4076-80e0-abbdf23f2b2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:45.032328 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f37d6675-3b2a-4076-80e0-abbdf23f2b2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:45.040731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f37d6675-3b2a-4076-80e0-abbdf23f2b2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082471 Aug 08 09:14:45.041324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1255/2412] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:44 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:46.061537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-67c56771-8345-40ba-bb67-f0036ba22dcf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:46.062141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-67c56771-8345-40ba-bb67-f0036ba22dcf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:46.069099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c56771-8345-40ba-bb67-f0036ba22dcf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:46.069797 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c56771-8345-40ba-bb67-f0036ba22dcf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:46.070235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c56771-8345-40ba-bb67-f0036ba22dcf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:46.070929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c56771-8345-40ba-bb67-f0036ba22dcf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:46.071384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c56771-8345-40ba-bb67-f0036ba22dcf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:46.071805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c56771-8345-40ba-bb67-f0036ba22dcf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:46.139644 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-67c56771-8345-40ba-bb67-f0036ba22dcf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:46.147463 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-67c56771-8345-40ba-bb67-f0036ba22dcf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.089772 Aug 08 09:14:46.148023 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1158/2413] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:46 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:47.167907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-b169e450-13a9-4079-b6ec-0fb5cc6136f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:47.168520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-b169e450-13a9-4079-b6ec-0fb5cc6136f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:47.170834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:14:47.175441 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b169e450-13a9-4079-b6ec-0fb5cc6136f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:47.175922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b169e450-13a9-4079-b6ec-0fb5cc6136f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:47.176363 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b169e450-13a9-4079-b6ec-0fb5cc6136f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:47.177714 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b169e450-13a9-4079-b6ec-0fb5cc6136f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:47.178259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b169e450-13a9-4079-b6ec-0fb5cc6136f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:47.178693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-b169e450-13a9-4079-b6ec-0fb5cc6136f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:47.239076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-b169e450-13a9-4079-b6ec-0fb5cc6136f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:47.247378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-b169e450-13a9-4079-b6ec-0fb5cc6136f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083353 Aug 08 09:14:47.247929 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1256/2414] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:47 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:48.268769 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-26733413-a87c-455c-bc6c-49018d55bb1d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:48.269450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-26733413-a87c-455c-bc6c-49018d55bb1d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:48.271800 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=32 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:14:48.276412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26733413-a87c-455c-bc6c-49018d55bb1d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:48.276903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26733413-a87c-455c-bc6c-49018d55bb1d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:48.277383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26733413-a87c-455c-bc6c-49018d55bb1d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:48.278080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26733413-a87c-455c-bc6c-49018d55bb1d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:48.278533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26733413-a87c-455c-bc6c-49018d55bb1d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:48.278964 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-26733413-a87c-455c-bc6c-49018d55bb1d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:48.339932 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-26733413-a87c-455c-bc6c-49018d55bb1d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:48.347371 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-26733413-a87c-455c-bc6c-49018d55bb1d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082819 Aug 08 09:14:48.347929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1159/2415] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:48 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:49.367651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-59741b4d-5008-451b-b9dc-37b665f2e10b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:49.368278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-59741b4d-5008-451b-b9dc-37b665f2e10b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:49.374739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59741b4d-5008-451b-b9dc-37b665f2e10b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:49.375226 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59741b4d-5008-451b-b9dc-37b665f2e10b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:49.375667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59741b4d-5008-451b-b9dc-37b665f2e10b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:49.376357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59741b4d-5008-451b-b9dc-37b665f2e10b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:49.376815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59741b4d-5008-451b-b9dc-37b665f2e10b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:49.377277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-59741b4d-5008-451b-b9dc-37b665f2e10b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:49.438564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-59741b4d-5008-451b-b9dc-37b665f2e10b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:49.446703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-59741b4d-5008-451b-b9dc-37b665f2e10b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083008 Aug 08 09:14:49.447263 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1257/2416] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:49 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:50.467286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5d9e4418-1fbc-4b8c-b6ca-61514d120140 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:50.467891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5d9e4418-1fbc-4b8c-b6ca-61514d120140 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:50.474336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d9e4418-1fbc-4b8c-b6ca-61514d120140 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:50.475743 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d9e4418-1fbc-4b8c-b6ca-61514d120140 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:50.476245 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d9e4418-1fbc-4b8c-b6ca-61514d120140 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:50.476992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d9e4418-1fbc-4b8c-b6ca-61514d120140 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:50.477547 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d9e4418-1fbc-4b8c-b6ca-61514d120140 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:50.478101 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5d9e4418-1fbc-4b8c-b6ca-61514d120140 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:50.544173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5d9e4418-1fbc-4b8c-b6ca-61514d120140 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:50.551639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5d9e4418-1fbc-4b8c-b6ca-61514d120140 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.088205 Aug 08 09:14:50.552198 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1160/2417] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:50 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:14:51.571457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-84818460-671c-418e-aee6-d7b51ffb273f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:51.571990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-84818460-671c-418e-aee6-d7b51ffb273f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:51.578377 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84818460-671c-418e-aee6-d7b51ffb273f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:51.578858 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84818460-671c-418e-aee6-d7b51ffb273f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:51.579299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84818460-671c-418e-aee6-d7b51ffb273f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:51.579985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84818460-671c-418e-aee6-d7b51ffb273f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:51.580440 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84818460-671c-418e-aee6-d7b51ffb273f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:51.580864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-84818460-671c-418e-aee6-d7b51ffb273f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:51.640921 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-84818460-671c-418e-aee6-d7b51ffb273f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:51.649223 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-84818460-671c-418e-aee6-d7b51ffb273f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081775 Aug 08 09:14:51.649786 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1258/2418] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:51 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:52.669550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-27f0e1a6-a15b-4d26-a968-19fc7a09d4a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:52.670166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-27f0e1a6-a15b-4d26-a968-19fc7a09d4a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:52.676649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27f0e1a6-a15b-4d26-a968-19fc7a09d4a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:52.677136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27f0e1a6-a15b-4d26-a968-19fc7a09d4a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:52.677605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27f0e1a6-a15b-4d26-a968-19fc7a09d4a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:52.678833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27f0e1a6-a15b-4d26-a968-19fc7a09d4a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:52.679295 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27f0e1a6-a15b-4d26-a968-19fc7a09d4a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:52.679748 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-27f0e1a6-a15b-4d26-a968-19fc7a09d4a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:52.742141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-27f0e1a6-a15b-4d26-a968-19fc7a09d4a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:52.749836 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-27f0e1a6-a15b-4d26-a968-19fc7a09d4a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084278 Aug 08 09:14:52.750403 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1161/2419] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:52 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:53.769974 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1e12ce8f-8d4c-4cdf-81fc-9765b8be2d5b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:53.770586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1e12ce8f-8d4c-4cdf-81fc-9765b8be2d5b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:53.777695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e12ce8f-8d4c-4cdf-81fc-9765b8be2d5b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:53.778179 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e12ce8f-8d4c-4cdf-81fc-9765b8be2d5b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:53.778623 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e12ce8f-8d4c-4cdf-81fc-9765b8be2d5b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:53.779304 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e12ce8f-8d4c-4cdf-81fc-9765b8be2d5b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:53.779756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e12ce8f-8d4c-4cdf-81fc-9765b8be2d5b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:53.780183 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e12ce8f-8d4c-4cdf-81fc-9765b8be2d5b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:53.840444 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1e12ce8f-8d4c-4cdf-81fc-9765b8be2d5b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:53.847940 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1e12ce8f-8d4c-4cdf-81fc-9765b8be2d5b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082070 Aug 08 09:14:53.848496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1259/2420] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:53 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:54.868260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9a0473b3-f6c0-4062-8271-72057b56d1e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:54.868873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9a0473b3-f6c0-4062-8271-72057b56d1e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:54.875386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a0473b3-f6c0-4062-8271-72057b56d1e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:54.875874 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a0473b3-f6c0-4062-8271-72057b56d1e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:54.876309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a0473b3-f6c0-4062-8271-72057b56d1e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:54.876996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a0473b3-f6c0-4062-8271-72057b56d1e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:54.877489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a0473b3-f6c0-4062-8271-72057b56d1e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:54.877917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9a0473b3-f6c0-4062-8271-72057b56d1e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:54.942085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9a0473b3-f6c0-4062-8271-72057b56d1e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:54.949775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9a0473b3-f6c0-4062-8271-72057b56d1e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085503 Aug 08 09:14:54.950337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1162/2421] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:54 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:55.970399 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0f534d81-52b7-40ed-86bb-7cb65199df94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:55.971023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0f534d81-52b7-40ed-86bb-7cb65199df94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:55.978071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f534d81-52b7-40ed-86bb-7cb65199df94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:55.978558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f534d81-52b7-40ed-86bb-7cb65199df94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:55.979002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f534d81-52b7-40ed-86bb-7cb65199df94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:55.979699 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f534d81-52b7-40ed-86bb-7cb65199df94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:55.980158 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f534d81-52b7-40ed-86bb-7cb65199df94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:55.980591 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0f534d81-52b7-40ed-86bb-7cb65199df94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:56.042823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0f534d81-52b7-40ed-86bb-7cb65199df94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:56.050279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0f534d81-52b7-40ed-86bb-7cb65199df94 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083743 Aug 08 09:14:56.050842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1260/2422] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:55 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:57.071363 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5717144b-65a2-4ff1-85a6-cbe8fbe1e177 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:57.071970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5717144b-65a2-4ff1-85a6-cbe8fbe1e177 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:57.078524 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5717144b-65a2-4ff1-85a6-cbe8fbe1e177 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:57.079011 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5717144b-65a2-4ff1-85a6-cbe8fbe1e177 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:57.079445 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5717144b-65a2-4ff1-85a6-cbe8fbe1e177 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:57.080132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5717144b-65a2-4ff1-85a6-cbe8fbe1e177 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:57.080591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5717144b-65a2-4ff1-85a6-cbe8fbe1e177 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:57.081019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5717144b-65a2-4ff1-85a6-cbe8fbe1e177 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:57.141773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5717144b-65a2-4ff1-85a6-cbe8fbe1e177 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:57.149405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5717144b-65a2-4ff1-85a6-cbe8fbe1e177 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082586 Aug 08 09:14:57.149968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1163/2423] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:57 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:58.168773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2f9a7e65-707d-4c36-88f5-c804190eb059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:58.169423 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2f9a7e65-707d-4c36-88f5-c804190eb059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:58.175963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f9a7e65-707d-4c36-88f5-c804190eb059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:58.176467 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f9a7e65-707d-4c36-88f5-c804190eb059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:58.176993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f9a7e65-707d-4c36-88f5-c804190eb059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:58.177674 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f9a7e65-707d-4c36-88f5-c804190eb059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:58.178136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f9a7e65-707d-4c36-88f5-c804190eb059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:58.178597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2f9a7e65-707d-4c36-88f5-c804190eb059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:58.238792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2f9a7e65-707d-4c36-88f5-c804190eb059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:58.246619 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2f9a7e65-707d-4c36-88f5-c804190eb059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081653 Aug 08 09:14:58.247237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1261/2424] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:58 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:14:59.267997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5edd61e2-02b3-4dc1-bf11-20b55976b8eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:14:59.268613 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5edd61e2-02b3-4dc1-bf11-20b55976b8eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:14:59.275335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5edd61e2-02b3-4dc1-bf11-20b55976b8eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:59.275824 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5edd61e2-02b3-4dc1-bf11-20b55976b8eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:59.276297 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5edd61e2-02b3-4dc1-bf11-20b55976b8eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:59.276987 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5edd61e2-02b3-4dc1-bf11-20b55976b8eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:14:59.277479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5edd61e2-02b3-4dc1-bf11-20b55976b8eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:14:59.277914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5edd61e2-02b3-4dc1-bf11-20b55976b8eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:14:59.341620 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5edd61e2-02b3-4dc1-bf11-20b55976b8eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:14:59.349079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5edd61e2-02b3-4dc1-bf11-20b55976b8eb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084930 Aug 08 09:14:59.349666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1164/2425] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:14:59 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:00.369670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c9a86b5a-b69e-4c11-b97f-f5f91b002efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:00.370310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c9a86b5a-b69e-4c11-b97f-f5f91b002efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:00.376668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9a86b5a-b69e-4c11-b97f-f5f91b002efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:00.377173 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9a86b5a-b69e-4c11-b97f-f5f91b002efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:00.377610 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9a86b5a-b69e-4c11-b97f-f5f91b002efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:00.378290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9a86b5a-b69e-4c11-b97f-f5f91b002efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:00.378743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9a86b5a-b69e-4c11-b97f-f5f91b002efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:00.379168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c9a86b5a-b69e-4c11-b97f-f5f91b002efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:00.446878 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c9a86b5a-b69e-4c11-b97f-f5f91b002efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:00.454422 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c9a86b5a-b69e-4c11-b97f-f5f91b002efa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.088705 Aug 08 09:15:00.458068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1262/2426] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:00 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:01.475631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f7250dab-e983-447f-a47d-8b5d0294ace9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:01.476242 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f7250dab-e983-447f-a47d-8b5d0294ace9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:01.482600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7250dab-e983-447f-a47d-8b5d0294ace9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:01.483082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7250dab-e983-447f-a47d-8b5d0294ace9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:01.483516 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7250dab-e983-447f-a47d-8b5d0294ace9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:01.484196 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7250dab-e983-447f-a47d-8b5d0294ace9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:01.484648 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7250dab-e983-447f-a47d-8b5d0294ace9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:01.485074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f7250dab-e983-447f-a47d-8b5d0294ace9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:01.546129 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f7250dab-e983-447f-a47d-8b5d0294ace9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:01.554012 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f7250dab-e983-447f-a47d-8b5d0294ace9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081680 Aug 08 09:15:01.554663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1165/2427] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:01 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:02.574602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-208e855c-5621-436d-8fe8-9775fbb7ead5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:02.575207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-208e855c-5621-436d-8fe8-9775fbb7ead5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:02.581583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-208e855c-5621-436d-8fe8-9775fbb7ead5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:02.582068 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-208e855c-5621-436d-8fe8-9775fbb7ead5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:02.582507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-208e855c-5621-436d-8fe8-9775fbb7ead5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:02.583194 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-208e855c-5621-436d-8fe8-9775fbb7ead5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:02.583647 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-208e855c-5621-436d-8fe8-9775fbb7ead5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:02.584073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-208e855c-5621-436d-8fe8-9775fbb7ead5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:02.646139 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-208e855c-5621-436d-8fe8-9775fbb7ead5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:02.653710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-208e855c-5621-436d-8fe8-9775fbb7ead5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082921 Aug 08 09:15:02.654286 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1263/2428] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:02 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:03.674002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e36bfdba-430c-48a6-85cd-9831dc0314aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:03.674528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e36bfdba-430c-48a6-85cd-9831dc0314aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:03.681497 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e36bfdba-430c-48a6-85cd-9831dc0314aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:03.681985 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e36bfdba-430c-48a6-85cd-9831dc0314aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:03.682420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e36bfdba-430c-48a6-85cd-9831dc0314aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:03.683108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e36bfdba-430c-48a6-85cd-9831dc0314aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:03.683565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e36bfdba-430c-48a6-85cd-9831dc0314aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:03.683994 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e36bfdba-430c-48a6-85cd-9831dc0314aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:03.687870 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=84 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:15:03.749840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e36bfdba-430c-48a6-85cd-9831dc0314aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:03.758273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e36bfdba-430c-48a6-85cd-9831dc0314aa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.088084 Aug 08 09:15:03.758844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1166/2429] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:03 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:04.779580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-964a8f62-eae3-4b15-bc3d-f0a76f689b5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:04.780221 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-964a8f62-eae3-4b15-bc3d-f0a76f689b5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:04.786602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-964a8f62-eae3-4b15-bc3d-f0a76f689b5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:04.787093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-964a8f62-eae3-4b15-bc3d-f0a76f689b5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:04.787567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-964a8f62-eae3-4b15-bc3d-f0a76f689b5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:04.788746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-964a8f62-eae3-4b15-bc3d-f0a76f689b5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:04.789231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-964a8f62-eae3-4b15-bc3d-f0a76f689b5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:04.789661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-964a8f62-eae3-4b15-bc3d-f0a76f689b5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:04.848766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-964a8f62-eae3-4b15-bc3d-f0a76f689b5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:04.856851 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-964a8f62-eae3-4b15-bc3d-f0a76f689b5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081307 Aug 08 09:15:04.857445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1264/2430] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:04 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:05.997094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3042b6a3-29b3-4ce5-8156-177f4bd44d68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:05.997752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3042b6a3-29b3-4ce5-8156-177f4bd44d68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:06.003561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3042b6a3-29b3-4ce5-8156-177f4bd44d68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:06.004043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3042b6a3-29b3-4ce5-8156-177f4bd44d68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:06.004477 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3042b6a3-29b3-4ce5-8156-177f4bd44d68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:06.005176 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3042b6a3-29b3-4ce5-8156-177f4bd44d68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:06.005634 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3042b6a3-29b3-4ce5-8156-177f4bd44d68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:06.006054 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3042b6a3-29b3-4ce5-8156-177f4bd44d68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:06.218475 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3042b6a3-29b3-4ce5-8156-177f4bd44d68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:06.226479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3042b6a3-29b3-4ce5-8156-177f4bd44d68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.352189 Aug 08 09:15:06.227026 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1167/2431] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:05 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:07.246023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6fe95cee-3818-429f-ae78-7c7e52f8cb8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:07.246766 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6fe95cee-3818-429f-ae78-7c7e52f8cb8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:07.252900 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6fe95cee-3818-429f-ae78-7c7e52f8cb8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:07.253445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6fe95cee-3818-429f-ae78-7c7e52f8cb8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:07.253888 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6fe95cee-3818-429f-ae78-7c7e52f8cb8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:07.254575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6fe95cee-3818-429f-ae78-7c7e52f8cb8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:07.255037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6fe95cee-3818-429f-ae78-7c7e52f8cb8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:07.255463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6fe95cee-3818-429f-ae78-7c7e52f8cb8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:07.259418 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=84 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:15:07.317521 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6fe95cee-3818-429f-ae78-7c7e52f8cb8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:07.325489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6fe95cee-3818-429f-ae78-7c7e52f8cb8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083239 Aug 08 09:15:07.326050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1265/2432] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:07 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:08.346415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4f6facef-b3f8-44b1-a4f0-a226b88f61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:08.347103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4f6facef-b3f8-44b1-a4f0-a226b88f61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:08.353479 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6facef-b3f8-44b1-a4f0-a226b88f61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:08.354301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6facef-b3f8-44b1-a4f0-a226b88f61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:08.354394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6facef-b3f8-44b1-a4f0-a226b88f61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:08.355089 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6facef-b3f8-44b1-a4f0-a226b88f61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:08.355549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6facef-b3f8-44b1-a4f0-a226b88f61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:08.355979 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4f6facef-b3f8-44b1-a4f0-a226b88f61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:08.420427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4f6facef-b3f8-44b1-a4f0-a226b88f61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:08.427982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4f6facef-b3f8-44b1-a4f0-a226b88f61b8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085371 Aug 08 09:15:08.429017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1168/2433] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:08 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:09.448679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1b9dc436-3ee7-48da-9f5b-7ede62a183f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:09.449332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1b9dc436-3ee7-48da-9f5b-7ede62a183f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:09.455859 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b9dc436-3ee7-48da-9f5b-7ede62a183f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:09.456342 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b9dc436-3ee7-48da-9f5b-7ede62a183f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:09.456781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b9dc436-3ee7-48da-9f5b-7ede62a183f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:09.457495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b9dc436-3ee7-48da-9f5b-7ede62a183f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:09.457957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b9dc436-3ee7-48da-9f5b-7ede62a183f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:09.458380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1b9dc436-3ee7-48da-9f5b-7ede62a183f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:09.518746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1b9dc436-3ee7-48da-9f5b-7ede62a183f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:09.527544 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1b9dc436-3ee7-48da-9f5b-7ede62a183f2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083396 Aug 08 09:15:09.528094 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1266/2434] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:09 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:10.548035 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-78fd53de-67aa-4014-bae4-43c9bc94cbd8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:10.548677 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-78fd53de-67aa-4014-bae4-43c9bc94cbd8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:10.555217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78fd53de-67aa-4014-bae4-43c9bc94cbd8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:10.555700 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78fd53de-67aa-4014-bae4-43c9bc94cbd8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:10.556133 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78fd53de-67aa-4014-bae4-43c9bc94cbd8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:10.556825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78fd53de-67aa-4014-bae4-43c9bc94cbd8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:10.557310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78fd53de-67aa-4014-bae4-43c9bc94cbd8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:10.557734 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-78fd53de-67aa-4014-bae4-43c9bc94cbd8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:10.618381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-78fd53de-67aa-4014-bae4-43c9bc94cbd8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:10.625951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-78fd53de-67aa-4014-bae4-43c9bc94cbd8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081877 Aug 08 09:15:10.626496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1169/2435] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:10 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:11.647048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-46c204a4-d481-480b-b371-64d5e28bcb39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:11.647757 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-46c204a4-d481-480b-b371-64d5e28bcb39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:11.654148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46c204a4-d481-480b-b371-64d5e28bcb39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:11.654634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46c204a4-d481-480b-b371-64d5e28bcb39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:11.655073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46c204a4-d481-480b-b371-64d5e28bcb39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:11.655756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46c204a4-d481-480b-b371-64d5e28bcb39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:11.656210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46c204a4-d481-480b-b371-64d5e28bcb39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:11.656633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-46c204a4-d481-480b-b371-64d5e28bcb39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:11.718295 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-46c204a4-d481-480b-b371-64d5e28bcb39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:11.726411 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-46c204a4-d481-480b-b371-64d5e28bcb39 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083653 Aug 08 09:15:11.726964 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1267/2436] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:11 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:12.039015 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:15:12.039195 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:15:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:15:12.747675 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3cb98754-b9e9-49ff-be27-ac24fe7761f7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:12.748289 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3cb98754-b9e9-49ff-be27-ac24fe7761f7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:12.754701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb98754-b9e9-49ff-be27-ac24fe7761f7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:12.755188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb98754-b9e9-49ff-be27-ac24fe7761f7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:12.755626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb98754-b9e9-49ff-be27-ac24fe7761f7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:12.756920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb98754-b9e9-49ff-be27-ac24fe7761f7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:12.757428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb98754-b9e9-49ff-be27-ac24fe7761f7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:12.757894 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3cb98754-b9e9-49ff-be27-ac24fe7761f7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:12.822978 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3cb98754-b9e9-49ff-be27-ac24fe7761f7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:12.830430 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3cb98754-b9e9-49ff-be27-ac24fe7761f7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086610 Aug 08 09:15:12.830977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1170/2437] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:12 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:13.851669 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-76280abe-1266-4685-81be-b1a436559226 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:13.852306 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-76280abe-1266-4685-81be-b1a436559226 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:13.859421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76280abe-1266-4685-81be-b1a436559226 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:13.859909 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76280abe-1266-4685-81be-b1a436559226 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:13.860345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76280abe-1266-4685-81be-b1a436559226 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:13.861066 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76280abe-1266-4685-81be-b1a436559226 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:13.861569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76280abe-1266-4685-81be-b1a436559226 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:13.861994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-76280abe-1266-4685-81be-b1a436559226 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:13.922902 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-76280abe-1266-4685-81be-b1a436559226 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:13.930437 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-76280abe-1266-4685-81be-b1a436559226 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082725 Aug 08 09:15:13.930989 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1268/2438] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:13 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:14.951265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-977f2b01-3e22-4f44-9515-fb90e11eeff9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:14.951885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-977f2b01-3e22-4f44-9515-fb90e11eeff9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:14.958244 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-977f2b01-3e22-4f44-9515-fb90e11eeff9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:14.958729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-977f2b01-3e22-4f44-9515-fb90e11eeff9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:14.959199 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-977f2b01-3e22-4f44-9515-fb90e11eeff9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:14.959890 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-977f2b01-3e22-4f44-9515-fb90e11eeff9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:14.960346 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-977f2b01-3e22-4f44-9515-fb90e11eeff9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:14.960795 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-977f2b01-3e22-4f44-9515-fb90e11eeff9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:15.023169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-977f2b01-3e22-4f44-9515-fb90e11eeff9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:15.030706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-977f2b01-3e22-4f44-9515-fb90e11eeff9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083295 Aug 08 09:15:15.031253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1171/2439] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:14 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:16.051379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-43e066ae-9e98-4211-98a0-f3ba81a2e3f5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:16.052493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-43e066ae-9e98-4211-98a0-f3ba81a2e3f5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:16.059259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43e066ae-9e98-4211-98a0-f3ba81a2e3f5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:16.059806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43e066ae-9e98-4211-98a0-f3ba81a2e3f5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:16.060251 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43e066ae-9e98-4211-98a0-f3ba81a2e3f5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:16.060991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43e066ae-9e98-4211-98a0-f3ba81a2e3f5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:16.061575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43e066ae-9e98-4211-98a0-f3ba81a2e3f5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:16.062037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-43e066ae-9e98-4211-98a0-f3ba81a2e3f5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:16.123010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-43e066ae-9e98-4211-98a0-f3ba81a2e3f5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:16.130373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-43e066ae-9e98-4211-98a0-f3ba81a2e3f5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082806 Aug 08 09:15:16.130922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1269/2440] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:16 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:17.152465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4801885a-f4e8-4204-9f57-77fbbc8079c3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:17.153093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4801885a-f4e8-4204-9f57-77fbbc8079c3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:17.159729 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4801885a-f4e8-4204-9f57-77fbbc8079c3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:17.160217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4801885a-f4e8-4204-9f57-77fbbc8079c3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:17.160660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4801885a-f4e8-4204-9f57-77fbbc8079c3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:17.161377 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4801885a-f4e8-4204-9f57-77fbbc8079c3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:17.161841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4801885a-f4e8-4204-9f57-77fbbc8079c3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:17.162271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4801885a-f4e8-4204-9f57-77fbbc8079c3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:17.225000 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4801885a-f4e8-4204-9f57-77fbbc8079c3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:17.232561 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4801885a-f4e8-4204-9f57-77fbbc8079c3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084867 Aug 08 09:15:17.233118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1172/2441] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:17 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:18.253551 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-15eeb901-e277-48ab-b9a3-13d1d6ff4e5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:18.254162 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-15eeb901-e277-48ab-b9a3-13d1d6ff4e5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:18.256570 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=28 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:15:18.262001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15eeb901-e277-48ab-b9a3-13d1d6ff4e5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:18.262486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15eeb901-e277-48ab-b9a3-13d1d6ff4e5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:18.262925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15eeb901-e277-48ab-b9a3-13d1d6ff4e5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:18.263655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15eeb901-e277-48ab-b9a3-13d1d6ff4e5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:18.264109 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15eeb901-e277-48ab-b9a3-13d1d6ff4e5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:18.264533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15eeb901-e277-48ab-b9a3-13d1d6ff4e5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:18.326693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-15eeb901-e277-48ab-b9a3-13d1d6ff4e5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:18.334244 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-15eeb901-e277-48ab-b9a3-13d1d6ff4e5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084729 Aug 08 09:15:18.334794 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1270/2442] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:18 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:19.355309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1cff9965-1764-44da-b931-000026424701 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:19.355927 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1cff9965-1764-44da-b931-000026424701 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:19.358266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=28 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:15:19.362979 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cff9965-1764-44da-b931-000026424701 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:19.363480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cff9965-1764-44da-b931-000026424701 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:19.363909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cff9965-1764-44da-b931-000026424701 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:19.364599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cff9965-1764-44da-b931-000026424701 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:19.365059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cff9965-1764-44da-b931-000026424701 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:19.365517 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1cff9965-1764-44da-b931-000026424701 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:19.428831 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1cff9965-1764-44da-b931-000026424701 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:19.436899 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1cff9965-1764-44da-b931-000026424701 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085524 Aug 08 09:15:19.437494 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1173/2443] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:19 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:20.457787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6273d460-740d-461e-8898-b6bbaf8834a9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:20.458401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6273d460-740d-461e-8898-b6bbaf8834a9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:20.465569 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6273d460-740d-461e-8898-b6bbaf8834a9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:20.466050 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6273d460-740d-461e-8898-b6bbaf8834a9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:20.466485 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6273d460-740d-461e-8898-b6bbaf8834a9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:20.467169 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6273d460-740d-461e-8898-b6bbaf8834a9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:20.467622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6273d460-740d-461e-8898-b6bbaf8834a9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:20.468047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6273d460-740d-461e-8898-b6bbaf8834a9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:20.528681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6273d460-740d-461e-8898-b6bbaf8834a9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:20.536314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6273d460-740d-461e-8898-b6bbaf8834a9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082329 Aug 08 09:15:20.536861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1271/2444] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:20 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:21.558038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9e8a8989-2954-4576-9314-ea3bc5976a61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:21.558583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9e8a8989-2954-4576-9314-ea3bc5976a61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:21.565204 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e8a8989-2954-4576-9314-ea3bc5976a61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:21.565696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e8a8989-2954-4576-9314-ea3bc5976a61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:21.566134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e8a8989-2954-4576-9314-ea3bc5976a61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:21.566820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e8a8989-2954-4576-9314-ea3bc5976a61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:21.567280 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e8a8989-2954-4576-9314-ea3bc5976a61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:21.567707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9e8a8989-2954-4576-9314-ea3bc5976a61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:21.630854 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9e8a8989-2954-4576-9314-ea3bc5976a61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:21.638387 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9e8a8989-2954-4576-9314-ea3bc5976a61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085206 Aug 08 09:15:21.638940 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1174/2445] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:21 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:22.659412 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-15f8b299-0d74-49bc-bdf4-773be05d1269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:22.660030 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-15f8b299-0d74-49bc-bdf4-773be05d1269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:22.667081 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15f8b299-0d74-49bc-bdf4-773be05d1269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:22.672546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15f8b299-0d74-49bc-bdf4-773be05d1269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:22.672546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15f8b299-0d74-49bc-bdf4-773be05d1269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:22.672546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15f8b299-0d74-49bc-bdf4-773be05d1269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:22.672546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15f8b299-0d74-49bc-bdf4-773be05d1269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:22.672918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-15f8b299-0d74-49bc-bdf4-773be05d1269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:22.730011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-15f8b299-0d74-49bc-bdf4-773be05d1269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:22.737429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-15f8b299-0d74-49bc-bdf4-773be05d1269 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081812 Aug 08 09:15:22.737982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1272/2446] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:22 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:15:22.847343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:15:22.847535 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:15:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:15:23.758236 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-405d47b9-eee5-478b-abfd-77f984f4b507 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:23.762287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-405d47b9-eee5-478b-abfd-77f984f4b507 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:23.765635 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-405d47b9-eee5-478b-abfd-77f984f4b507 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:23.766121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-405d47b9-eee5-478b-abfd-77f984f4b507 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:23.766555 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-405d47b9-eee5-478b-abfd-77f984f4b507 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:23.767240 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-405d47b9-eee5-478b-abfd-77f984f4b507 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:23.767697 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-405d47b9-eee5-478b-abfd-77f984f4b507 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:23.768162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-405d47b9-eee5-478b-abfd-77f984f4b507 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:23.830139 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-405d47b9-eee5-478b-abfd-77f984f4b507 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:23.838421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-405d47b9-eee5-478b-abfd-77f984f4b507 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084091 Aug 08 09:15:23.842525 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1175/2447] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:23 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:24.858520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-35cbe5e1-50ee-4701-be1b-4e858357f09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:24.859141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-35cbe5e1-50ee-4701-be1b-4e858357f09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:24.865533 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35cbe5e1-50ee-4701-be1b-4e858357f09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:24.866020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35cbe5e1-50ee-4701-be1b-4e858357f09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:24.866461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35cbe5e1-50ee-4701-be1b-4e858357f09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:24.867646 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35cbe5e1-50ee-4701-be1b-4e858357f09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:24.868274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35cbe5e1-50ee-4701-be1b-4e858357f09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:24.868707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-35cbe5e1-50ee-4701-be1b-4e858357f09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:24.931073 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-35cbe5e1-50ee-4701-be1b-4e858357f09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:24.938622 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-35cbe5e1-50ee-4701-be1b-4e858357f09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083974 Aug 08 09:15:24.939170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1273/2448] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:24 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:25.019966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:15:25.020448 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:15:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:15:25.960499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1a0cbeff-75a8-4e69-b224-533d5d384cde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:25.961760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1a0cbeff-75a8-4e69-b224-533d5d384cde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:25.968279 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a0cbeff-75a8-4e69-b224-533d5d384cde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:25.968768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a0cbeff-75a8-4e69-b224-533d5d384cde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:25.969298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a0cbeff-75a8-4e69-b224-533d5d384cde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:25.969993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a0cbeff-75a8-4e69-b224-533d5d384cde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:25.970450 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a0cbeff-75a8-4e69-b224-533d5d384cde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:25.970876 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1a0cbeff-75a8-4e69-b224-533d5d384cde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:26.034645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1a0cbeff-75a8-4e69-b224-533d5d384cde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:26.042757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1a0cbeff-75a8-4e69-b224-533d5d384cde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086072 Aug 08 09:15:26.043317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1176/2449] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:25 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:27.062795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bcaf1339-e269-484b-a0a6-997e84a4b473 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:27.063402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bcaf1339-e269-484b-a0a6-997e84a4b473 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:27.069844 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcaf1339-e269-484b-a0a6-997e84a4b473 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:27.070324 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcaf1339-e269-484b-a0a6-997e84a4b473 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:27.070756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcaf1339-e269-484b-a0a6-997e84a4b473 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:27.071439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcaf1339-e269-484b-a0a6-997e84a4b473 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:27.071890 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcaf1339-e269-484b-a0a6-997e84a4b473 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:27.072314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bcaf1339-e269-484b-a0a6-997e84a4b473 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:27.132557 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bcaf1339-e269-484b-a0a6-997e84a4b473 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:27.140088 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bcaf1339-e269-484b-a0a6-997e84a4b473 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081233 Aug 08 09:15:27.140639 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1274/2450] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:27 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:28.161520 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1e800f7e-ea73-47e4-8e9b-5f576feeee27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:28.162144 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1e800f7e-ea73-47e4-8e9b-5f576feeee27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:28.169122 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e800f7e-ea73-47e4-8e9b-5f576feeee27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:28.169639 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e800f7e-ea73-47e4-8e9b-5f576feeee27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:28.170080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e800f7e-ea73-47e4-8e9b-5f576feeee27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:28.170768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e800f7e-ea73-47e4-8e9b-5f576feeee27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:28.171229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e800f7e-ea73-47e4-8e9b-5f576feeee27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:28.171661 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1e800f7e-ea73-47e4-8e9b-5f576feeee27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:28.233271 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1e800f7e-ea73-47e4-8e9b-5f576feeee27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:28.240826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1e800f7e-ea73-47e4-8e9b-5f576feeee27 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083138 Aug 08 09:15:28.241413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1177/2451] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:28 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:29.261960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-31b35139-99fd-4967-aab7-2ff3359d2032 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:29.262603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-31b35139-99fd-4967-aab7-2ff3359d2032 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:29.268979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31b35139-99fd-4967-aab7-2ff3359d2032 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:29.269497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31b35139-99fd-4967-aab7-2ff3359d2032 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:29.270197 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31b35139-99fd-4967-aab7-2ff3359d2032 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:29.270875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31b35139-99fd-4967-aab7-2ff3359d2032 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:29.271333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31b35139-99fd-4967-aab7-2ff3359d2032 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:29.271759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-31b35139-99fd-4967-aab7-2ff3359d2032 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:29.332631 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-31b35139-99fd-4967-aab7-2ff3359d2032 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:29.340588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-31b35139-99fd-4967-aab7-2ff3359d2032 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082580 Aug 08 09:15:29.341156 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1275/2452] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:29 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:30.361235 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-780600ac-a1c8-4e6a-b4fc-6a86731581d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:30.361880 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-780600ac-a1c8-4e6a-b4fc-6a86731581d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:30.368291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-780600ac-a1c8-4e6a-b4fc-6a86731581d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:30.368775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-780600ac-a1c8-4e6a-b4fc-6a86731581d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:30.369233 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-780600ac-a1c8-4e6a-b4fc-6a86731581d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:30.369922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-780600ac-a1c8-4e6a-b4fc-6a86731581d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:30.370378 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-780600ac-a1c8-4e6a-b4fc-6a86731581d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:30.370801 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-780600ac-a1c8-4e6a-b4fc-6a86731581d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:30.434829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-780600ac-a1c8-4e6a-b4fc-6a86731581d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:30.442333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-780600ac-a1c8-4e6a-b4fc-6a86731581d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084962 Aug 08 09:15:30.442887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1178/2453] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:30 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:30.714174 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fb247930-6cbb-45c2-bc4f-77f79b376b0d tempest-TestShelveInstance-654509028 tempest-TestShelveInstance-654509028-project] Calling method '.version_select at 0x7f4795e50a60>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:30.790882 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fb247930-6cbb-45c2-bc4f-77f79b376b0d tempest-TestShelveInstance-654509028 tempest-TestShelveInstance-654509028-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2077275754" status: 202 len: 0 microversion: 2.1 time: 0.080651 Aug 08 09:15:30.791462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1276/2454] 10.222.0.33 () {58 vars in 1254 bytes} [Mon Aug 8 09:15:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2077275754 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 09:15:31.463491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e85abea1-989f-4ba5-9a19-6471b9b71daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:31.464194 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e85abea1-989f-4ba5-9a19-6471b9b71daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:31.470480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e85abea1-989f-4ba5-9a19-6471b9b71daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:31.470965 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e85abea1-989f-4ba5-9a19-6471b9b71daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:31.471397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e85abea1-989f-4ba5-9a19-6471b9b71daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:31.472082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e85abea1-989f-4ba5-9a19-6471b9b71daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:31.472569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e85abea1-989f-4ba5-9a19-6471b9b71daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:31.472990 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e85abea1-989f-4ba5-9a19-6471b9b71daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:31.536209 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e85abea1-989f-4ba5-9a19-6471b9b71daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:31.543805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e85abea1-989f-4ba5-9a19-6471b9b71daf tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084483 Aug 08 09:15:31.544369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1179/2455] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:31 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:32.565895 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-abf0c82b-0405-4cb7-a670-9b32bf82da9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:32.566515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-abf0c82b-0405-4cb7-a670-9b32bf82da9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:32.573990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-abf0c82b-0405-4cb7-a670-9b32bf82da9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:32.574484 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-abf0c82b-0405-4cb7-a670-9b32bf82da9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:32.575105 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-abf0c82b-0405-4cb7-a670-9b32bf82da9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:32.576024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-abf0c82b-0405-4cb7-a670-9b32bf82da9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:32.576496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-abf0c82b-0405-4cb7-a670-9b32bf82da9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:32.576932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-abf0c82b-0405-4cb7-a670-9b32bf82da9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:32.642684 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-abf0c82b-0405-4cb7-a670-9b32bf82da9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:32.656008 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-abf0c82b-0405-4cb7-a670-9b32bf82da9e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.094494 Aug 08 09:15:32.657670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1277/2456] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:32 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:33.684543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-337bcb25-88c6-44e1-8c0a-30c366341793 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:33.687726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-337bcb25-88c6-44e1-8c0a-30c366341793 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:33.702174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-337bcb25-88c6-44e1-8c0a-30c366341793 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:33.703044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-337bcb25-88c6-44e1-8c0a-30c366341793 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:33.703702 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-337bcb25-88c6-44e1-8c0a-30c366341793 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:33.704531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-337bcb25-88c6-44e1-8c0a-30c366341793 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:33.705090 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-337bcb25-88c6-44e1-8c0a-30c366341793 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:33.705663 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-337bcb25-88c6-44e1-8c0a-30c366341793 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:33.738912 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=86 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:15:33.786452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-337bcb25-88c6-44e1-8c0a-30c366341793 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:33.795527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-337bcb25-88c6-44e1-8c0a-30c366341793 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.116436 Aug 08 09:15:33.796230 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1180/2457] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:33 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:34.817164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-77b77062-0678-4537-8c57-49cbcfae092e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:34.817164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-77b77062-0678-4537-8c57-49cbcfae092e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:34.824333 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b77062-0678-4537-8c57-49cbcfae092e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:34.824829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b77062-0678-4537-8c57-49cbcfae092e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:34.826301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b77062-0678-4537-8c57-49cbcfae092e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:34.826301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b77062-0678-4537-8c57-49cbcfae092e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:34.826497 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b77062-0678-4537-8c57-49cbcfae092e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:34.826932 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-77b77062-0678-4537-8c57-49cbcfae092e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:34.911944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-77b77062-0678-4537-8c57-49cbcfae092e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:34.919394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-77b77062-0678-4537-8c57-49cbcfae092e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.106848 Aug 08 09:15:34.919950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1278/2458] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:34 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:35.940120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-bd0d43c1-3a49-46f4-a6cb-e428e65ee337 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:35.941563 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-bd0d43c1-3a49-46f4-a6cb-e428e65ee337 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:35.948647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd0d43c1-3a49-46f4-a6cb-e428e65ee337 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:35.949177 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd0d43c1-3a49-46f4-a6cb-e428e65ee337 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:35.950107 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd0d43c1-3a49-46f4-a6cb-e428e65ee337 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:35.950809 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd0d43c1-3a49-46f4-a6cb-e428e65ee337 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:35.951265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd0d43c1-3a49-46f4-a6cb-e428e65ee337 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:35.951692 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-bd0d43c1-3a49-46f4-a6cb-e428e65ee337 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:36.014094 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-bd0d43c1-3a49-46f4-a6cb-e428e65ee337 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:36.022726 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-bd0d43c1-3a49-46f4-a6cb-e428e65ee337 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086733 Aug 08 09:15:36.023653 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1181/2459] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:35 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:37.044664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-731899d2-eeeb-47b9-becf-d91b8207958d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:37.045996 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-731899d2-eeeb-47b9-becf-d91b8207958d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:37.052606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-731899d2-eeeb-47b9-becf-d91b8207958d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:37.057113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-731899d2-eeeb-47b9-becf-d91b8207958d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:37.057113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-731899d2-eeeb-47b9-becf-d91b8207958d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:37.057113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-731899d2-eeeb-47b9-becf-d91b8207958d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:37.057113 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-731899d2-eeeb-47b9-becf-d91b8207958d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:37.057556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-731899d2-eeeb-47b9-becf-d91b8207958d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:37.144456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-731899d2-eeeb-47b9-becf-d91b8207958d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:37.153247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-731899d2-eeeb-47b9-becf-d91b8207958d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.112633 Aug 08 09:15:37.153976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1279/2460] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:37 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:38.173469 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dbec214b-f529-4191-8171-0b0f43025909 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:38.174081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dbec214b-f529-4191-8171-0b0f43025909 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:38.180616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbec214b-f529-4191-8171-0b0f43025909 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:38.181104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbec214b-f529-4191-8171-0b0f43025909 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:38.181573 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbec214b-f529-4191-8171-0b0f43025909 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:38.182312 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbec214b-f529-4191-8171-0b0f43025909 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:38.182789 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbec214b-f529-4191-8171-0b0f43025909 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:38.183195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dbec214b-f529-4191-8171-0b0f43025909 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:38.245792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dbec214b-f529-4191-8171-0b0f43025909 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:38.253333 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dbec214b-f529-4191-8171-0b0f43025909 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083739 Aug 08 09:15:38.253892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1182/2461] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:38 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:39.274866 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5ac5e0c8-be15-4b7b-a1b8-86bd31918c2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:39.275576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5ac5e0c8-be15-4b7b-a1b8-86bd31918c2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:39.282430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ac5e0c8-be15-4b7b-a1b8-86bd31918c2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:39.282930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ac5e0c8-be15-4b7b-a1b8-86bd31918c2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:39.283436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ac5e0c8-be15-4b7b-a1b8-86bd31918c2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:39.284192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ac5e0c8-be15-4b7b-a1b8-86bd31918c2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:39.284715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ac5e0c8-be15-4b7b-a1b8-86bd31918c2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:39.285240 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ac5e0c8-be15-4b7b-a1b8-86bd31918c2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:39.289621 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=84 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:15:39.349604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5ac5e0c8-be15-4b7b-a1b8-86bd31918c2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:39.357644 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5ac5e0c8-be15-4b7b-a1b8-86bd31918c2f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087290 Aug 08 09:15:39.358408 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1280/2462] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:39 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:40.379752 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fea3db59-47fb-406a-8927-2c5d0453f344 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:40.380400 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fea3db59-47fb-406a-8927-2c5d0453f344 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:40.386832 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fea3db59-47fb-406a-8927-2c5d0453f344 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:40.387322 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fea3db59-47fb-406a-8927-2c5d0453f344 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:40.387760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fea3db59-47fb-406a-8927-2c5d0453f344 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:40.388452 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fea3db59-47fb-406a-8927-2c5d0453f344 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:40.388914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fea3db59-47fb-406a-8927-2c5d0453f344 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:40.389381 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fea3db59-47fb-406a-8927-2c5d0453f344 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:40.451495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fea3db59-47fb-406a-8927-2c5d0453f344 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:40.458986 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fea3db59-47fb-406a-8927-2c5d0453f344 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083100 Aug 08 09:15:40.459543 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1183/2463] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:40 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:41.480476 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f0d28636-7798-4c64-8680-9d585245ec26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:41.481090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f0d28636-7798-4c64-8680-9d585245ec26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:41.487491 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d28636-7798-4c64-8680-9d585245ec26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:41.487976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d28636-7798-4c64-8680-9d585245ec26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:41.488412 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d28636-7798-4c64-8680-9d585245ec26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:41.489093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d28636-7798-4c64-8680-9d585245ec26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:41.489577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d28636-7798-4c64-8680-9d585245ec26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:41.490005 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f0d28636-7798-4c64-8680-9d585245ec26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:41.551564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f0d28636-7798-4c64-8680-9d585245ec26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:41.559085 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f0d28636-7798-4c64-8680-9d585245ec26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082800 Aug 08 09:15:41.559634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1281/2464] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:41 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:42.579941 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4aca7838-c5cb-4978-ae08-92a6b8bb68f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:42.580553 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4aca7838-c5cb-4978-ae08-92a6b8bb68f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:42.587853 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aca7838-c5cb-4978-ae08-92a6b8bb68f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:42.588348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aca7838-c5cb-4978-ae08-92a6b8bb68f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:42.588798 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aca7838-c5cb-4978-ae08-92a6b8bb68f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:42.589535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aca7838-c5cb-4978-ae08-92a6b8bb68f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:42.590003 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aca7838-c5cb-4978-ae08-92a6b8bb68f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:42.590438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4aca7838-c5cb-4978-ae08-92a6b8bb68f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:42.651849 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4aca7838-c5cb-4978-ae08-92a6b8bb68f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:42.659403 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4aca7838-c5cb-4978-ae08-92a6b8bb68f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083434 Aug 08 09:15:42.659971 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1184/2465] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:42 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:43.681256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a2450111-6730-4005-88b4-bda29e1475e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:43.681800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a2450111-6730-4005-88b4-bda29e1475e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:43.688117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2450111-6730-4005-88b4-bda29e1475e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:43.688606 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2450111-6730-4005-88b4-bda29e1475e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:43.689046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2450111-6730-4005-88b4-bda29e1475e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:43.689756 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2450111-6730-4005-88b4-bda29e1475e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:43.690214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2450111-6730-4005-88b4-bda29e1475e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:43.690638 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a2450111-6730-4005-88b4-bda29e1475e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:43.754500 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a2450111-6730-4005-88b4-bda29e1475e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:43.762132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a2450111-6730-4005-88b4-bda29e1475e4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085449 Aug 08 09:15:43.762687 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1282/2466] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:43 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:44.783336 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5e4dfa19-edf3-4fa2-9cca-bf420128699e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:44.783966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5e4dfa19-edf3-4fa2-9cca-bf420128699e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:44.790667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e4dfa19-edf3-4fa2-9cca-bf420128699e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:44.791292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e4dfa19-edf3-4fa2-9cca-bf420128699e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:44.791737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e4dfa19-edf3-4fa2-9cca-bf420128699e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:44.792428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e4dfa19-edf3-4fa2-9cca-bf420128699e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:44.792896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e4dfa19-edf3-4fa2-9cca-bf420128699e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:44.793365 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e4dfa19-edf3-4fa2-9cca-bf420128699e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:44.854446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5e4dfa19-edf3-4fa2-9cca-bf420128699e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:44.861840 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5e4dfa19-edf3-4fa2-9cca-bf420128699e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082575 Aug 08 09:15:44.862405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1185/2467] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:44 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:45.882388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dcd01a24-059b-4422-81ea-cb8abac0bf99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:45.883828 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dcd01a24-059b-4422-81ea-cb8abac0bf99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:45.890215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcd01a24-059b-4422-81ea-cb8abac0bf99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:45.890695 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcd01a24-059b-4422-81ea-cb8abac0bf99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:45.891133 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcd01a24-059b-4422-81ea-cb8abac0bf99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:45.891820 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcd01a24-059b-4422-81ea-cb8abac0bf99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:45.892276 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcd01a24-059b-4422-81ea-cb8abac0bf99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:45.892704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dcd01a24-059b-4422-81ea-cb8abac0bf99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:45.954126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-dcd01a24-059b-4422-81ea-cb8abac0bf99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:45.961772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dcd01a24-059b-4422-81ea-cb8abac0bf99 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083202 Aug 08 09:15:45.962327 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1283/2468] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:45 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:46.982633 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-44d56873-f589-410a-8b1e-0e8e62328c26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:46.983253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-44d56873-f589-410a-8b1e-0e8e62328c26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:46.989650 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44d56873-f589-410a-8b1e-0e8e62328c26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:46.990142 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44d56873-f589-410a-8b1e-0e8e62328c26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:46.990585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44d56873-f589-410a-8b1e-0e8e62328c26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:46.991274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44d56873-f589-410a-8b1e-0e8e62328c26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:46.991735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44d56873-f589-410a-8b1e-0e8e62328c26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:46.992793 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-44d56873-f589-410a-8b1e-0e8e62328c26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:47.054217 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-44d56873-f589-410a-8b1e-0e8e62328c26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:47.062429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-44d56873-f589-410a-8b1e-0e8e62328c26 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083605 Aug 08 09:15:47.062987 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1186/2469] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:46 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:48.082210 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0cdb3b8f-037f-4f5c-a348-4c68d6dc4424 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:48.082759 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0cdb3b8f-037f-4f5c-a348-4c68d6dc4424 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:48.089216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cdb3b8f-037f-4f5c-a348-4c68d6dc4424 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:48.089710 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cdb3b8f-037f-4f5c-a348-4c68d6dc4424 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:48.090157 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cdb3b8f-037f-4f5c-a348-4c68d6dc4424 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:48.090849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cdb3b8f-037f-4f5c-a348-4c68d6dc4424 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:48.091320 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cdb3b8f-037f-4f5c-a348-4c68d6dc4424 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:48.091755 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0cdb3b8f-037f-4f5c-a348-4c68d6dc4424 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:48.154936 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0cdb3b8f-037f-4f5c-a348-4c68d6dc4424 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:48.162406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0cdb3b8f-037f-4f5c-a348-4c68d6dc4424 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084097 Aug 08 09:15:48.162961 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1284/2470] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:48 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:49.182806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-091a196d-67ff-4477-8c21-c861986e001e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:49.183413 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-091a196d-67ff-4477-8c21-c861986e001e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:49.189994 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-091a196d-67ff-4477-8c21-c861986e001e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:49.190478 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-091a196d-67ff-4477-8c21-c861986e001e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:49.190913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-091a196d-67ff-4477-8c21-c861986e001e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:49.191591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-091a196d-67ff-4477-8c21-c861986e001e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:49.192049 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-091a196d-67ff-4477-8c21-c861986e001e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:49.192476 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-091a196d-67ff-4477-8c21-c861986e001e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:49.252666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-091a196d-67ff-4477-8c21-c861986e001e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:49.260802 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-091a196d-67ff-4477-8c21-c861986e001e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081882 Aug 08 09:15:49.261383 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1187/2471] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:49 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:50.282372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d22d92f2-6560-4664-8c8f-2df23dbe3edc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:50.282975 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d22d92f2-6560-4664-8c8f-2df23dbe3edc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:50.285394 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:15:50.290693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22d92f2-6560-4664-8c8f-2df23dbe3edc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:50.296703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22d92f2-6560-4664-8c8f-2df23dbe3edc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:50.296703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22d92f2-6560-4664-8c8f-2df23dbe3edc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:50.296703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22d92f2-6560-4664-8c8f-2df23dbe3edc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:50.296703 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22d92f2-6560-4664-8c8f-2df23dbe3edc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:50.297059 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d22d92f2-6560-4664-8c8f-2df23dbe3edc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:50.354870 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d22d92f2-6560-4664-8c8f-2df23dbe3edc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:50.362649 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d22d92f2-6560-4664-8c8f-2df23dbe3edc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084227 Aug 08 09:15:50.363207 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1285/2472] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:50 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:51.383455 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2be171f7-ee40-4db4-b446-2e4e4b9f444d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:51.384065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2be171f7-ee40-4db4-b446-2e4e4b9f444d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:51.386384 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=30 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:15:51.390961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2be171f7-ee40-4db4-b446-2e4e4b9f444d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:51.391444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2be171f7-ee40-4db4-b446-2e4e4b9f444d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:51.391887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2be171f7-ee40-4db4-b446-2e4e4b9f444d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:51.392569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2be171f7-ee40-4db4-b446-2e4e4b9f444d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:51.393028 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2be171f7-ee40-4db4-b446-2e4e4b9f444d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:51.393534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2be171f7-ee40-4db4-b446-2e4e4b9f444d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:51.455441 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2be171f7-ee40-4db4-b446-2e4e4b9f444d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:51.463004 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2be171f7-ee40-4db4-b446-2e4e4b9f444d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083400 Aug 08 09:15:51.463556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1188/2473] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:51 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:52.487898 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e0f4c15d-2431-49b4-86e0-d76cb0ba378a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:52.488547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e0f4c15d-2431-49b4-86e0-d76cb0ba378a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:52.494983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0f4c15d-2431-49b4-86e0-d76cb0ba378a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:52.495469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0f4c15d-2431-49b4-86e0-d76cb0ba378a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:52.495910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0f4c15d-2431-49b4-86e0-d76cb0ba378a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:52.496593 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0f4c15d-2431-49b4-86e0-d76cb0ba378a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:52.497053 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0f4c15d-2431-49b4-86e0-d76cb0ba378a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:52.497510 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e0f4c15d-2431-49b4-86e0-d76cb0ba378a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:52.561016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e0f4c15d-2431-49b4-86e0-d76cb0ba378a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:52.568416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e0f4c15d-2431-49b4-86e0-d76cb0ba378a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084435 Aug 08 09:15:52.568967 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1286/2474] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:52 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:53.588022 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5e55a27a-c7a3-443f-8fd4-93c8b3d055a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:53.588631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5e55a27a-c7a3-443f-8fd4-93c8b3d055a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:53.594991 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e55a27a-c7a3-443f-8fd4-93c8b3d055a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:53.595482 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e55a27a-c7a3-443f-8fd4-93c8b3d055a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:53.595920 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e55a27a-c7a3-443f-8fd4-93c8b3d055a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:53.596600 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e55a27a-c7a3-443f-8fd4-93c8b3d055a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:53.597053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e55a27a-c7a3-443f-8fd4-93c8b3d055a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:53.597501 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e55a27a-c7a3-443f-8fd4-93c8b3d055a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:53.659548 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5e55a27a-c7a3-443f-8fd4-93c8b3d055a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:53.667977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5e55a27a-c7a3-443f-8fd4-93c8b3d055a0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083691 Aug 08 09:15:53.668529 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1189/2475] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:53 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:54.689875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d5cdfd0a-aa0d-4255-995a-00a3705b52d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:54.690456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d5cdfd0a-aa0d-4255-995a-00a3705b52d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:54.697774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5cdfd0a-aa0d-4255-995a-00a3705b52d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:54.698260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5cdfd0a-aa0d-4255-995a-00a3705b52d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:54.698705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5cdfd0a-aa0d-4255-995a-00a3705b52d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:54.699386 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5cdfd0a-aa0d-4255-995a-00a3705b52d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:54.699836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5cdfd0a-aa0d-4255-995a-00a3705b52d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:54.700260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d5cdfd0a-aa0d-4255-995a-00a3705b52d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:54.762445 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d5cdfd0a-aa0d-4255-995a-00a3705b52d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:54.769810 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d5cdfd0a-aa0d-4255-995a-00a3705b52d3 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084243 Aug 08 09:15:54.770368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1287/2476] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:54 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:55.790944 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1acbc7df-43ba-4f48-bbb2-7ac877c3df85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:55.791514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1acbc7df-43ba-4f48-bbb2-7ac877c3df85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:55.797984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1acbc7df-43ba-4f48-bbb2-7ac877c3df85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:55.798468 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1acbc7df-43ba-4f48-bbb2-7ac877c3df85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:55.798902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1acbc7df-43ba-4f48-bbb2-7ac877c3df85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:55.799588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1acbc7df-43ba-4f48-bbb2-7ac877c3df85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:55.800051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1acbc7df-43ba-4f48-bbb2-7ac877c3df85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:55.800474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1acbc7df-43ba-4f48-bbb2-7ac877c3df85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:55.860980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1acbc7df-43ba-4f48-bbb2-7ac877c3df85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:55.868459 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1acbc7df-43ba-4f48-bbb2-7ac877c3df85 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081920 Aug 08 09:15:55.869001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1190/2477] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:55 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:56.889299 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d48a664c-d411-4c2d-968b-4c13d4650c7a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:56.889923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d48a664c-d411-4c2d-968b-4c13d4650c7a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:56.896586 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d48a664c-d411-4c2d-968b-4c13d4650c7a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:56.897072 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d48a664c-d411-4c2d-968b-4c13d4650c7a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:56.897537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d48a664c-d411-4c2d-968b-4c13d4650c7a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:56.898277 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d48a664c-d411-4c2d-968b-4c13d4650c7a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:56.898893 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d48a664c-d411-4c2d-968b-4c13d4650c7a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:56.899331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d48a664c-d411-4c2d-968b-4c13d4650c7a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:56.962516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d48a664c-d411-4c2d-968b-4c13d4650c7a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:56.970249 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d48a664c-d411-4c2d-968b-4c13d4650c7a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084831 Aug 08 09:15:56.970808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1288/2478] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:56 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:57.990792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-46a11127-0fb9-4437-8ff4-eadc3ce03c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:57.991411 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-46a11127-0fb9-4437-8ff4-eadc3ce03c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:57.998461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46a11127-0fb9-4437-8ff4-eadc3ce03c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:57.998960 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46a11127-0fb9-4437-8ff4-eadc3ce03c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:57.999400 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46a11127-0fb9-4437-8ff4-eadc3ce03c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:58.000089 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46a11127-0fb9-4437-8ff4-eadc3ce03c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:58.000550 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46a11127-0fb9-4437-8ff4-eadc3ce03c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:58.000976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-46a11127-0fb9-4437-8ff4-eadc3ce03c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:58.061761 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-46a11127-0fb9-4437-8ff4-eadc3ce03c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:58.068997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-46a11127-0fb9-4437-8ff4-eadc3ce03c88 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082167 Aug 08 09:15:58.069587 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1191/2479] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:57 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:15:59.089595 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6a9137a5-4653-46e2-a125-c7ad7f0b65d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:15:59.090237 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6a9137a5-4653-46e2-a125-c7ad7f0b65d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:15:59.096542 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a9137a5-4653-46e2-a125-c7ad7f0b65d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:59.097063 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a9137a5-4653-46e2-a125-c7ad7f0b65d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:59.097546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a9137a5-4653-46e2-a125-c7ad7f0b65d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:59.098234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a9137a5-4653-46e2-a125-c7ad7f0b65d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:15:59.098693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a9137a5-4653-46e2-a125-c7ad7f0b65d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:15:59.099125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a9137a5-4653-46e2-a125-c7ad7f0b65d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:15:59.159734 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6a9137a5-4653-46e2-a125-c7ad7f0b65d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:15:59.167214 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6a9137a5-4653-46e2-a125-c7ad7f0b65d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081455 Aug 08 09:15:59.167770 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1289/2480] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:15:59 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:00.188079 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-1b285465-8af7-4afd-980e-b09c287bd09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:00.188701 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-1b285465-8af7-4afd-980e-b09c287bd09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:00.196184 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b285465-8af7-4afd-980e-b09c287bd09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:00.196685 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b285465-8af7-4afd-980e-b09c287bd09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:00.197126 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b285465-8af7-4afd-980e-b09c287bd09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:00.197868 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b285465-8af7-4afd-980e-b09c287bd09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:00.198328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b285465-8af7-4afd-980e-b09c287bd09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:00.198760 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-1b285465-8af7-4afd-980e-b09c287bd09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:00.263622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-1b285465-8af7-4afd-980e-b09c287bd09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:00.271335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-1b285465-8af7-4afd-980e-b09c287bd09b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086941 Aug 08 09:16:00.271895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1192/2481] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:00 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:01.292293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f327bcee-2a97-42eb-a315-33791e49aa09 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:01.292912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f327bcee-2a97-42eb-a315-33791e49aa09 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:01.299421 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f327bcee-2a97-42eb-a315-33791e49aa09 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:01.299907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f327bcee-2a97-42eb-a315-33791e49aa09 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:01.300355 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f327bcee-2a97-42eb-a315-33791e49aa09 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:01.301074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f327bcee-2a97-42eb-a315-33791e49aa09 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:01.301567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f327bcee-2a97-42eb-a315-33791e49aa09 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:01.302001 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f327bcee-2a97-42eb-a315-33791e49aa09 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:01.364999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f327bcee-2a97-42eb-a315-33791e49aa09 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:01.372935 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f327bcee-2a97-42eb-a315-33791e49aa09 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084798 Aug 08 09:16:01.373525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1290/2482] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:01 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:02.394041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0b274172-e0d8-4853-8a6e-a9f5fca9949f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:02.394656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0b274172-e0d8-4853-8a6e-a9f5fca9949f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:02.401490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b274172-e0d8-4853-8a6e-a9f5fca9949f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:02.401983 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b274172-e0d8-4853-8a6e-a9f5fca9949f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:02.402419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b274172-e0d8-4853-8a6e-a9f5fca9949f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:02.403108 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b274172-e0d8-4853-8a6e-a9f5fca9949f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:02.403573 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b274172-e0d8-4853-8a6e-a9f5fca9949f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:02.404001 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0b274172-e0d8-4853-8a6e-a9f5fca9949f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:02.465709 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0b274172-e0d8-4853-8a6e-a9f5fca9949f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:02.473290 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0b274172-e0d8-4853-8a6e-a9f5fca9949f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083025 Aug 08 09:16:02.473856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1193/2483] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:02 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:03.494416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-387c095a-96bf-4dc3-900e-98554e70e627 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:03.495076 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-387c095a-96bf-4dc3-900e-98554e70e627 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:03.501556 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-387c095a-96bf-4dc3-900e-98554e70e627 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:03.502047 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-387c095a-96bf-4dc3-900e-98554e70e627 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:03.502492 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-387c095a-96bf-4dc3-900e-98554e70e627 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:03.503185 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-387c095a-96bf-4dc3-900e-98554e70e627 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:03.503648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-387c095a-96bf-4dc3-900e-98554e70e627 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:03.504082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-387c095a-96bf-4dc3-900e-98554e70e627 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:03.564984 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-387c095a-96bf-4dc3-900e-98554e70e627 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:03.573070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-387c095a-96bf-4dc3-900e-98554e70e627 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082782 Aug 08 09:16:03.573670 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1291/2484] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:03 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:04.593519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-def434b4-ab5c-4754-9fe6-3ee67a0ba259 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:04.594137 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-def434b4-ab5c-4754-9fe6-3ee67a0ba259 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:04.600428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-def434b4-ab5c-4754-9fe6-3ee67a0ba259 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:04.600917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-def434b4-ab5c-4754-9fe6-3ee67a0ba259 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:04.601406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-def434b4-ab5c-4754-9fe6-3ee67a0ba259 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:04.602096 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-def434b4-ab5c-4754-9fe6-3ee67a0ba259 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:04.602556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-def434b4-ab5c-4754-9fe6-3ee67a0ba259 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:04.603130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-def434b4-ab5c-4754-9fe6-3ee67a0ba259 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:04.607006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=82 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:16:04.663625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-def434b4-ab5c-4754-9fe6-3ee67a0ba259 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:04.671481 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-def434b4-ab5c-4754-9fe6-3ee67a0ba259 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081936 Aug 08 09:16:04.672042 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1194/2485] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:04 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:05.692892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-11b67ea0-25f8-4017-a360-871d91adbd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:05.693553 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-11b67ea0-25f8-4017-a360-871d91adbd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:05.700501 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11b67ea0-25f8-4017-a360-871d91adbd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:05.700985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11b67ea0-25f8-4017-a360-871d91adbd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:05.701461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11b67ea0-25f8-4017-a360-871d91adbd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:05.702164 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11b67ea0-25f8-4017-a360-871d91adbd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:05.702612 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11b67ea0-25f8-4017-a360-871d91adbd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:05.703040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-11b67ea0-25f8-4017-a360-871d91adbd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:05.766298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-11b67ea0-25f8-4017-a360-871d91adbd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:05.773872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-11b67ea0-25f8-4017-a360-871d91adbd28 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084792 Aug 08 09:16:05.774515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1292/2486] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:05 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:06.795246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-50430340-a53e-44b4-8e99-89fb00641c63 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:06.795791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-50430340-a53e-44b4-8e99-89fb00641c63 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:06.801778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50430340-a53e-44b4-8e99-89fb00641c63 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:06.802266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50430340-a53e-44b4-8e99-89fb00641c63 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:06.802704 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50430340-a53e-44b4-8e99-89fb00641c63 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:06.803398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50430340-a53e-44b4-8e99-89fb00641c63 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:06.803856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50430340-a53e-44b4-8e99-89fb00641c63 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:06.804282 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50430340-a53e-44b4-8e99-89fb00641c63 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:06.864173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-50430340-a53e-44b4-8e99-89fb00641c63 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:06.872488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-50430340-a53e-44b4-8e99-89fb00641c63 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081348 Aug 08 09:16:06.873051 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1195/2487] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:06 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:07.893601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4d75b97e-fa58-4e67-8c49-b1ba72c1ff52 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:07.894199 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4d75b97e-fa58-4e67-8c49-b1ba72c1ff52 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:07.900388 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d75b97e-fa58-4e67-8c49-b1ba72c1ff52 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:07.900868 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d75b97e-fa58-4e67-8c49-b1ba72c1ff52 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:07.901345 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d75b97e-fa58-4e67-8c49-b1ba72c1ff52 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:07.902031 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d75b97e-fa58-4e67-8c49-b1ba72c1ff52 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:07.902487 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d75b97e-fa58-4e67-8c49-b1ba72c1ff52 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:07.902913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d75b97e-fa58-4e67-8c49-b1ba72c1ff52 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:07.962910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4d75b97e-fa58-4e67-8c49-b1ba72c1ff52 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:07.970268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4d75b97e-fa58-4e67-8c49-b1ba72c1ff52 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.080617 Aug 08 09:16:07.970821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1293/2488] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:07 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:08.990888 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-24d32ffd-0bcb-4fb8-b8cc-bb6f337cfac4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:08.991508 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-24d32ffd-0bcb-4fb8-b8cc-bb6f337cfac4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:08.998554 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24d32ffd-0bcb-4fb8-b8cc-bb6f337cfac4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:08.999046 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24d32ffd-0bcb-4fb8-b8cc-bb6f337cfac4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:08.999488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24d32ffd-0bcb-4fb8-b8cc-bb6f337cfac4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:09.000183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24d32ffd-0bcb-4fb8-b8cc-bb6f337cfac4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:09.000646 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24d32ffd-0bcb-4fb8-b8cc-bb6f337cfac4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:09.001077 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24d32ffd-0bcb-4fb8-b8cc-bb6f337cfac4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:09.061958 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-24d32ffd-0bcb-4fb8-b8cc-bb6f337cfac4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:09.069521 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-24d32ffd-0bcb-4fb8-b8cc-bb6f337cfac4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082496 Aug 08 09:16:09.070084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1196/2489] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:08 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:10.090198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-854c821d-6686-40c6-80f1-424f51aef404 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:10.090877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-854c821d-6686-40c6-80f1-424f51aef404 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:10.097247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854c821d-6686-40c6-80f1-424f51aef404 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:10.099287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854c821d-6686-40c6-80f1-424f51aef404 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:10.099287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854c821d-6686-40c6-80f1-424f51aef404 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:10.099968 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854c821d-6686-40c6-80f1-424f51aef404 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:10.100430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854c821d-6686-40c6-80f1-424f51aef404 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:10.100861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-854c821d-6686-40c6-80f1-424f51aef404 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:10.167582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-854c821d-6686-40c6-80f1-424f51aef404 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:10.175142 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-854c821d-6686-40c6-80f1-424f51aef404 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.089681 Aug 08 09:16:10.175702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1294/2490] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:10 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:11.195008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-750d7f87-812f-40ca-9879-8ac770bd6611 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:11.195623 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-750d7f87-812f-40ca-9879-8ac770bd6611 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:11.202098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-750d7f87-812f-40ca-9879-8ac770bd6611 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:11.202583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-750d7f87-812f-40ca-9879-8ac770bd6611 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:11.203020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-750d7f87-812f-40ca-9879-8ac770bd6611 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:11.203706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-750d7f87-812f-40ca-9879-8ac770bd6611 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:11.204164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-750d7f87-812f-40ca-9879-8ac770bd6611 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:11.204589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-750d7f87-812f-40ca-9879-8ac770bd6611 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:11.265503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-750d7f87-812f-40ca-9879-8ac770bd6611 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:11.273198 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-750d7f87-812f-40ca-9879-8ac770bd6611 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081985 Aug 08 09:16:11.273746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1197/2491] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:11 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:12.294228 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-39a65060-b487-4c4d-8cba-339aa8830993 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:12.294843 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-39a65060-b487-4c4d-8cba-339aa8830993 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:12.301260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a65060-b487-4c4d-8cba-339aa8830993 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:12.301749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a65060-b487-4c4d-8cba-339aa8830993 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:12.302222 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a65060-b487-4c4d-8cba-339aa8830993 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:12.302913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a65060-b487-4c4d-8cba-339aa8830993 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:12.303427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a65060-b487-4c4d-8cba-339aa8830993 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:12.303861 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-39a65060-b487-4c4d-8cba-339aa8830993 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:12.307152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=90 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:16:12.364597 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-39a65060-b487-4c4d-8cba-339aa8830993 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:12.372571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-39a65060-b487-4c4d-8cba-339aa8830993 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082703 Aug 08 09:16:12.373125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1295/2492] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:12 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:13.392737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-09a5b4c2-18cf-436e-9489-3a7a0f21c188 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:13.393377 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-09a5b4c2-18cf-436e-9489-3a7a0f21c188 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:13.400099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09a5b4c2-18cf-436e-9489-3a7a0f21c188 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:13.400595 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09a5b4c2-18cf-436e-9489-3a7a0f21c188 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:13.401032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09a5b4c2-18cf-436e-9489-3a7a0f21c188 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:13.401746 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09a5b4c2-18cf-436e-9489-3a7a0f21c188 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:13.402205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09a5b4c2-18cf-436e-9489-3a7a0f21c188 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:13.402631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-09a5b4c2-18cf-436e-9489-3a7a0f21c188 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:13.464145 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-09a5b4c2-18cf-436e-9489-3a7a0f21c188 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:13.471584 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-09a5b4c2-18cf-436e-9489-3a7a0f21c188 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082675 Aug 08 09:16:13.472134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1198/2493] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:13 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:14.491152 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-27ea51c0-c82b-4236-a48b-fa157c4abae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:14.491772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-27ea51c0-c82b-4236-a48b-fa157c4abae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:14.498344 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27ea51c0-c82b-4236-a48b-fa157c4abae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:14.498829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27ea51c0-c82b-4236-a48b-fa157c4abae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:14.499271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27ea51c0-c82b-4236-a48b-fa157c4abae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:14.499957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27ea51c0-c82b-4236-a48b-fa157c4abae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:14.500413 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27ea51c0-c82b-4236-a48b-fa157c4abae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:14.500842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-27ea51c0-c82b-4236-a48b-fa157c4abae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:14.572910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-27ea51c0-c82b-4236-a48b-fa157c4abae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:14.581516 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-27ea51c0-c82b-4236-a48b-fa157c4abae9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.093942 Aug 08 09:16:14.582323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1296/2494] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:14 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:15.601992 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fbf1f123-9e82-4e7f-b407-2b69f11fb73f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:15.602609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fbf1f123-9e82-4e7f-b407-2b69f11fb73f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:15.609114 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbf1f123-9e82-4e7f-b407-2b69f11fb73f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:15.609626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbf1f123-9e82-4e7f-b407-2b69f11fb73f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:15.610063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbf1f123-9e82-4e7f-b407-2b69f11fb73f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:15.610763 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbf1f123-9e82-4e7f-b407-2b69f11fb73f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:15.611215 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbf1f123-9e82-4e7f-b407-2b69f11fb73f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:15.611641 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fbf1f123-9e82-4e7f-b407-2b69f11fb73f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:15.674470 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fbf1f123-9e82-4e7f-b407-2b69f11fb73f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:15.681862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fbf1f123-9e82-4e7f-b407-2b69f11fb73f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083725 Aug 08 09:16:15.682420 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1199/2495] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:15 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:16.703571 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-922f723f-9c70-48ee-93c4-703a68bfe7e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:16.704090 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-922f723f-9c70-48ee-93c4-703a68bfe7e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:16.710671 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-922f723f-9c70-48ee-93c4-703a68bfe7e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:16.711159 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-922f723f-9c70-48ee-93c4-703a68bfe7e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:16.711600 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-922f723f-9c70-48ee-93c4-703a68bfe7e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:16.712867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-922f723f-9c70-48ee-93c4-703a68bfe7e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:16.713373 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-922f723f-9c70-48ee-93c4-703a68bfe7e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:16.713808 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-922f723f-9c70-48ee-93c4-703a68bfe7e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:16.776354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-922f723f-9c70-48ee-93c4-703a68bfe7e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:16.783802 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-922f723f-9c70-48ee-93c4-703a68bfe7e0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084142 Aug 08 09:16:16.784364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1297/2496] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:16 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:17.805269 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7cf406de-85c1-4707-b7fa-e355e64fa0bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:17.806538 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7cf406de-85c1-4707-b7fa-e355e64fa0bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:17.813002 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7cf406de-85c1-4707-b7fa-e355e64fa0bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:17.813518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7cf406de-85c1-4707-b7fa-e355e64fa0bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:17.813948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7cf406de-85c1-4707-b7fa-e355e64fa0bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:17.814626 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7cf406de-85c1-4707-b7fa-e355e64fa0bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:17.815082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7cf406de-85c1-4707-b7fa-e355e64fa0bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:17.815503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7cf406de-85c1-4707-b7fa-e355e64fa0bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:17.880211 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7cf406de-85c1-4707-b7fa-e355e64fa0bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:17.885460 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7cf406de-85c1-4707-b7fa-e355e64fa0bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084106 Aug 08 09:16:17.886014 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1200/2497] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:17 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:18.905930 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3de2a2a0-23bc-44eb-aea8-36a15908a52a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:18.906538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3de2a2a0-23bc-44eb-aea8-36a15908a52a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:18.912907 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3de2a2a0-23bc-44eb-aea8-36a15908a52a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:18.913422 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3de2a2a0-23bc-44eb-aea8-36a15908a52a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:18.913860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3de2a2a0-23bc-44eb-aea8-36a15908a52a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:18.914541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3de2a2a0-23bc-44eb-aea8-36a15908a52a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:18.915071 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3de2a2a0-23bc-44eb-aea8-36a15908a52a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:18.915558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3de2a2a0-23bc-44eb-aea8-36a15908a52a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:18.978478 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3de2a2a0-23bc-44eb-aea8-36a15908a52a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:18.985879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3de2a2a0-23bc-44eb-aea8-36a15908a52a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083748 Aug 08 09:16:18.986432 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1298/2498] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:18 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:20.006724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d34fcc1b-1f87-40bd-bb24-9195a71df5e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:20.007367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d34fcc1b-1f87-40bd-bb24-9195a71df5e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:20.014181 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d34fcc1b-1f87-40bd-bb24-9195a71df5e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:20.014720 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d34fcc1b-1f87-40bd-bb24-9195a71df5e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:20.015162 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d34fcc1b-1f87-40bd-bb24-9195a71df5e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:20.015857 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d34fcc1b-1f87-40bd-bb24-9195a71df5e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:20.016348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d34fcc1b-1f87-40bd-bb24-9195a71df5e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:20.016778 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d34fcc1b-1f87-40bd-bb24-9195a71df5e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:20.079485 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d34fcc1b-1f87-40bd-bb24-9195a71df5e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:20.087982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d34fcc1b-1f87-40bd-bb24-9195a71df5e7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084363 Aug 08 09:16:20.088503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1201/2499] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:20 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:21.108343 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6a604c57-2530-4750-89dc-4f0fce6f97bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:21.108986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6a604c57-2530-4750-89dc-4f0fce6f97bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:21.111305 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=28 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:16:21.115875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a604c57-2530-4750-89dc-4f0fce6f97bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:21.116357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a604c57-2530-4750-89dc-4f0fce6f97bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:21.116792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a604c57-2530-4750-89dc-4f0fce6f97bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:21.117531 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a604c57-2530-4750-89dc-4f0fce6f97bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:21.117986 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a604c57-2530-4750-89dc-4f0fce6f97bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:21.119002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6a604c57-2530-4750-89dc-4f0fce6f97bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:21.180495 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6a604c57-2530-4750-89dc-4f0fce6f97bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:21.188642 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6a604c57-2530-4750-89dc-4f0fce6f97bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084097 Aug 08 09:16:21.189230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1299/2500] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:21 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:22.209435 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-cece561e-f587-4bd3-a36f-7ff784b7d8a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:22.210081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-cece561e-f587-4bd3-a36f-7ff784b7d8a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:22.213057 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=28 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:16:22.217768 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cece561e-f587-4bd3-a36f-7ff784b7d8a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:22.218255 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cece561e-f587-4bd3-a36f-7ff784b7d8a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:22.218695 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cece561e-f587-4bd3-a36f-7ff784b7d8a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:22.219414 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cece561e-f587-4bd3-a36f-7ff784b7d8a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:22.219886 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cece561e-f587-4bd3-a36f-7ff784b7d8a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:22.220317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-cece561e-f587-4bd3-a36f-7ff784b7d8a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:22.282085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-cece561e-f587-4bd3-a36f-7ff784b7d8a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:22.289891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-cece561e-f587-4bd3-a36f-7ff784b7d8a8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084020 Aug 08 09:16:22.290892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1202/2501] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:22 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:23.311617 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2396cc88-366d-4d23-af65-430a31379935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:23.312235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2396cc88-366d-4d23-af65-430a31379935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:23.318826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2396cc88-366d-4d23-af65-430a31379935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:23.319317 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2396cc88-366d-4d23-af65-430a31379935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:23.319762 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2396cc88-366d-4d23-af65-430a31379935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:23.320449 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2396cc88-366d-4d23-af65-430a31379935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:23.320910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2396cc88-366d-4d23-af65-430a31379935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:23.321376 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2396cc88-366d-4d23-af65-430a31379935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:23.387496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2396cc88-366d-4d23-af65-430a31379935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:23.394994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2396cc88-366d-4d23-af65-430a31379935 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087256 Aug 08 09:16:23.395554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1300/2502] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:23 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:24.415218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0136f4fe-b72d-416c-b6b3-c90501083439 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:24.415980 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0136f4fe-b72d-416c-b6b3-c90501083439 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:24.422963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0136f4fe-b72d-416c-b6b3-c90501083439 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:24.423456 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0136f4fe-b72d-416c-b6b3-c90501083439 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:24.423903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0136f4fe-b72d-416c-b6b3-c90501083439 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:24.424601 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0136f4fe-b72d-416c-b6b3-c90501083439 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:24.425061 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0136f4fe-b72d-416c-b6b3-c90501083439 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:24.425526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0136f4fe-b72d-416c-b6b3-c90501083439 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:24.486568 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0136f4fe-b72d-416c-b6b3-c90501083439 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:24.494533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0136f4fe-b72d-416c-b6b3-c90501083439 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082694 Aug 08 09:16:24.495098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1203/2503] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:24 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:25.515354 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3dadb1d9-5338-4b21-932d-b51ffb56a2cc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:25.515969 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3dadb1d9-5338-4b21-932d-b51ffb56a2cc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:25.522526 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dadb1d9-5338-4b21-932d-b51ffb56a2cc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:25.523007 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dadb1d9-5338-4b21-932d-b51ffb56a2cc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:25.523439 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dadb1d9-5338-4b21-932d-b51ffb56a2cc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:25.524117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dadb1d9-5338-4b21-932d-b51ffb56a2cc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:25.524567 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dadb1d9-5338-4b21-932d-b51ffb56a2cc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:25.524993 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3dadb1d9-5338-4b21-932d-b51ffb56a2cc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:25.584795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3dadb1d9-5338-4b21-932d-b51ffb56a2cc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:25.593007 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3dadb1d9-5338-4b21-932d-b51ffb56a2cc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081438 Aug 08 09:16:25.593603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1301/2504] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:25 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:26.613757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-566d5712-2f76-4ed3-9379-92620d14f9fb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:26.614397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-566d5712-2f76-4ed3-9379-92620d14f9fb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:26.620959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-566d5712-2f76-4ed3-9379-92620d14f9fb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:26.621492 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-566d5712-2f76-4ed3-9379-92620d14f9fb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:26.621937 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-566d5712-2f76-4ed3-9379-92620d14f9fb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:26.622642 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-566d5712-2f76-4ed3-9379-92620d14f9fb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:26.623105 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-566d5712-2f76-4ed3-9379-92620d14f9fb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:26.623531 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-566d5712-2f76-4ed3-9379-92620d14f9fb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:26.690891 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-566d5712-2f76-4ed3-9379-92620d14f9fb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:26.698902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-566d5712-2f76-4ed3-9379-92620d14f9fb tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.088996 Aug 08 09:16:26.699465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1204/2505] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:26 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:27.720096 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3ca19c39-46b2-4c81-a48c-711f9544a100 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:27.720634 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3ca19c39-46b2-4c81-a48c-711f9544a100 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:27.727087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca19c39-46b2-4c81-a48c-711f9544a100 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:27.727576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca19c39-46b2-4c81-a48c-711f9544a100 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:27.728048 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca19c39-46b2-4c81-a48c-711f9544a100 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:27.728910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca19c39-46b2-4c81-a48c-711f9544a100 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:27.729404 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca19c39-46b2-4c81-a48c-711f9544a100 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:27.729834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3ca19c39-46b2-4c81-a48c-711f9544a100 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:27.794581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3ca19c39-46b2-4c81-a48c-711f9544a100 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:27.802065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3ca19c39-46b2-4c81-a48c-711f9544a100 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085888 Aug 08 09:16:27.802628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1302/2506] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:27 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:28.823722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b725a162-8f5c-4a79-8c6a-abaf4ac7fc33 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:28.824348 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b725a162-8f5c-4a79-8c6a-abaf4ac7fc33 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:28.830723 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b725a162-8f5c-4a79-8c6a-abaf4ac7fc33 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:28.831216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b725a162-8f5c-4a79-8c6a-abaf4ac7fc33 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:28.831660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b725a162-8f5c-4a79-8c6a-abaf4ac7fc33 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:28.832362 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b725a162-8f5c-4a79-8c6a-abaf4ac7fc33 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:28.832828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b725a162-8f5c-4a79-8c6a-abaf4ac7fc33 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:28.833288 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b725a162-8f5c-4a79-8c6a-abaf4ac7fc33 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:28.894405 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b725a162-8f5c-4a79-8c6a-abaf4ac7fc33 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:28.902825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b725a162-8f5c-4a79-8c6a-abaf4ac7fc33 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084019 Aug 08 09:16:28.909873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1205/2507] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:28 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:29.922583 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-53ef3dc3-e9e7-4a83-adef-78bcaf74f721 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:29.923234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-53ef3dc3-e9e7-4a83-adef-78bcaf74f721 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:29.930038 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ef3dc3-e9e7-4a83-adef-78bcaf74f721 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:29.938110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ef3dc3-e9e7-4a83-adef-78bcaf74f721 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:29.938110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ef3dc3-e9e7-4a83-adef-78bcaf74f721 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:29.938110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ef3dc3-e9e7-4a83-adef-78bcaf74f721 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:29.938110 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ef3dc3-e9e7-4a83-adef-78bcaf74f721 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:29.938575 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-53ef3dc3-e9e7-4a83-adef-78bcaf74f721 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:29.998660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-53ef3dc3-e9e7-4a83-adef-78bcaf74f721 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:30.006220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-53ef3dc3-e9e7-4a83-adef-78bcaf74f721 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087507 Aug 08 09:16:30.006777 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1303/2508] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:29 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:31.028400 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3412bf68-c367-4fa9-8b4f-de70e0961dfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:31.029117 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3412bf68-c367-4fa9-8b4f-de70e0961dfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:31.035579 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3412bf68-c367-4fa9-8b4f-de70e0961dfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:31.036067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3412bf68-c367-4fa9-8b4f-de70e0961dfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:31.036504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3412bf68-c367-4fa9-8b4f-de70e0961dfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:31.037218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3412bf68-c367-4fa9-8b4f-de70e0961dfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:31.037674 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3412bf68-c367-4fa9-8b4f-de70e0961dfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:31.038098 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3412bf68-c367-4fa9-8b4f-de70e0961dfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:31.102398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3412bf68-c367-4fa9-8b4f-de70e0961dfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:31.109944 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3412bf68-c367-4fa9-8b4f-de70e0961dfa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086408 Aug 08 09:16:31.110506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1206/2509] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:31 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:32.130973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-bb62e17f-42ea-48f4-bd89-9dc952e66d20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:32.131585 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-bb62e17f-42ea-48f4-bd89-9dc952e66d20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:32.138469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb62e17f-42ea-48f4-bd89-9dc952e66d20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:32.138951 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb62e17f-42ea-48f4-bd89-9dc952e66d20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:32.139384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb62e17f-42ea-48f4-bd89-9dc952e66d20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:32.140065 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb62e17f-42ea-48f4-bd89-9dc952e66d20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:32.140520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb62e17f-42ea-48f4-bd89-9dc952e66d20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:32.140943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-bb62e17f-42ea-48f4-bd89-9dc952e66d20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:32.206454 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-bb62e17f-42ea-48f4-bd89-9dc952e66d20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:32.215302 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-bb62e17f-42ea-48f4-bd89-9dc952e66d20 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.088109 Aug 08 09:16:32.215875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1304/2510] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:32 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:33.236228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b2eee57f-b6eb-4715-a611-e27a03d4f74b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:33.236844 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b2eee57f-b6eb-4715-a611-e27a03d4f74b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:33.243950 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2eee57f-b6eb-4715-a611-e27a03d4f74b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:33.244519 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2eee57f-b6eb-4715-a611-e27a03d4f74b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:33.245120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2eee57f-b6eb-4715-a611-e27a03d4f74b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:33.245970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2eee57f-b6eb-4715-a611-e27a03d4f74b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:33.246681 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2eee57f-b6eb-4715-a611-e27a03d4f74b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:33.247125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b2eee57f-b6eb-4715-a611-e27a03d4f74b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:33.311818 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b2eee57f-b6eb-4715-a611-e27a03d4f74b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:33.319572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b2eee57f-b6eb-4715-a611-e27a03d4f74b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087270 Aug 08 09:16:33.320201 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1207/2511] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:33 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:34.341137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d726d183-7461-40f1-9e32-982a32c356c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:34.341744 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d726d183-7461-40f1-9e32-982a32c356c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:34.348633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d726d183-7461-40f1-9e32-982a32c356c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:34.349219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d726d183-7461-40f1-9e32-982a32c356c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:34.349667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d726d183-7461-40f1-9e32-982a32c356c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:34.350368 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d726d183-7461-40f1-9e32-982a32c356c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:34.350838 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d726d183-7461-40f1-9e32-982a32c356c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:34.351273 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d726d183-7461-40f1-9e32-982a32c356c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:34.415246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d726d183-7461-40f1-9e32-982a32c356c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:34.423011 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d726d183-7461-40f1-9e32-982a32c356c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086426 Aug 08 09:16:34.423578 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1305/2512] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:34 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:35.443592 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4a978678-d794-47dd-95d7-e264d62e637f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:35.444205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4a978678-d794-47dd-95d7-e264d62e637f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:35.451031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4a978678-d794-47dd-95d7-e264d62e637f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:35.451512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4a978678-d794-47dd-95d7-e264d62e637f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:35.451946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4a978678-d794-47dd-95d7-e264d62e637f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:35.452627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4a978678-d794-47dd-95d7-e264d62e637f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:35.453080 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4a978678-d794-47dd-95d7-e264d62e637f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:35.453742 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4a978678-d794-47dd-95d7-e264d62e637f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:35.456489 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=84 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:16:35.517310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-4a978678-d794-47dd-95d7-e264d62e637f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:35.524984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4a978678-d794-47dd-95d7-e264d62e637f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085268 Aug 08 09:16:35.525572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1208/2513] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:35 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:36.547601 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-dd095132-062d-4206-80fe-5a370df90c2c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:36.548215 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-dd095132-062d-4206-80fe-5a370df90c2c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:36.554271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd095132-062d-4206-80fe-5a370df90c2c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:36.554764 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd095132-062d-4206-80fe-5a370df90c2c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:36.556702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd095132-062d-4206-80fe-5a370df90c2c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:36.556702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd095132-062d-4206-80fe-5a370df90c2c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:36.556702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd095132-062d-4206-80fe-5a370df90c2c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:36.556920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-dd095132-062d-4206-80fe-5a370df90c2c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:36.620823 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-dd095132-062d-4206-80fe-5a370df90c2c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:36.628547 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-dd095132-062d-4206-80fe-5a370df90c2c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085808 Aug 08 09:16:36.629103 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1306/2514] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:36 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:37.650828 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b99c346c-068d-4e79-a634-4912901327c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:37.651437 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b99c346c-068d-4e79-a634-4912901327c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:37.657442 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b99c346c-068d-4e79-a634-4912901327c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:37.657932 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b99c346c-068d-4e79-a634-4912901327c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:37.658367 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b99c346c-068d-4e79-a634-4912901327c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:37.659060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b99c346c-068d-4e79-a634-4912901327c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:37.659512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b99c346c-068d-4e79-a634-4912901327c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:37.659934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b99c346c-068d-4e79-a634-4912901327c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:37.721753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b99c346c-068d-4e79-a634-4912901327c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:37.736534 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b99c346c-068d-4e79-a634-4912901327c6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.090455 Aug 08 09:16:37.740335 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1209/2515] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:37 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:38.759087 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a36e9166-d988-4a32-826b-f99503fbba29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:38.763180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a36e9166-d988-4a32-826b-f99503fbba29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:38.766217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36e9166-d988-4a32-826b-f99503fbba29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:38.766713 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36e9166-d988-4a32-826b-f99503fbba29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:38.767156 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36e9166-d988-4a32-826b-f99503fbba29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:38.767853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36e9166-d988-4a32-826b-f99503fbba29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:38.768316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36e9166-d988-4a32-826b-f99503fbba29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:38.768790 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36e9166-d988-4a32-826b-f99503fbba29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:38.798667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:16:38.799210 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:16:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:16:38.835144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a36e9166-d988-4a32-826b-f99503fbba29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:38.844062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a36e9166-d988-4a32-826b-f99503fbba29 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.088797 Aug 08 09:16:38.844652 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1307/2516] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:38 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:39.864382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-fde2fda5-b3fd-45f5-abf9-7e24d75ebb5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:39.864916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-fde2fda5-b3fd-45f5-abf9-7e24d75ebb5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:39.871232 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fde2fda5-b3fd-45f5-abf9-7e24d75ebb5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:39.871717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fde2fda5-b3fd-45f5-abf9-7e24d75ebb5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:39.877656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fde2fda5-b3fd-45f5-abf9-7e24d75ebb5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:39.877656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fde2fda5-b3fd-45f5-abf9-7e24d75ebb5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:39.877656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fde2fda5-b3fd-45f5-abf9-7e24d75ebb5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:39.877656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-fde2fda5-b3fd-45f5-abf9-7e24d75ebb5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:39.935233 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-fde2fda5-b3fd-45f5-abf9-7e24d75ebb5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:39.943386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-fde2fda5-b3fd-45f5-abf9-7e24d75ebb5e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083042 Aug 08 09:16:39.943939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1210/2517] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:39 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:40.963957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9548ac1d-79ee-4b43-988e-62bc9ca3a383 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:40.964576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9548ac1d-79ee-4b43-988e-62bc9ca3a383 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:40.971614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9548ac1d-79ee-4b43-988e-62bc9ca3a383 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:40.972097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9548ac1d-79ee-4b43-988e-62bc9ca3a383 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:40.972537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9548ac1d-79ee-4b43-988e-62bc9ca3a383 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:40.973250 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9548ac1d-79ee-4b43-988e-62bc9ca3a383 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:40.973715 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9548ac1d-79ee-4b43-988e-62bc9ca3a383 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:40.974143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9548ac1d-79ee-4b43-988e-62bc9ca3a383 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:41.037649 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9548ac1d-79ee-4b43-988e-62bc9ca3a383 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:41.045787 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9548ac1d-79ee-4b43-988e-62bc9ca3a383 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085036 Aug 08 09:16:41.046359 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1308/2518] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:40 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:42.066425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-74b96264-8d9a-412c-8e51-e26bc1463c8e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:42.067038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-74b96264-8d9a-412c-8e51-e26bc1463c8e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:42.073425 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74b96264-8d9a-412c-8e51-e26bc1463c8e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:42.073913 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74b96264-8d9a-412c-8e51-e26bc1463c8e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:42.074349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74b96264-8d9a-412c-8e51-e26bc1463c8e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:42.075040 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74b96264-8d9a-412c-8e51-e26bc1463c8e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:42.075499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74b96264-8d9a-412c-8e51-e26bc1463c8e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:42.075931 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-74b96264-8d9a-412c-8e51-e26bc1463c8e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:42.137135 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-74b96264-8d9a-412c-8e51-e26bc1463c8e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:42.145192 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-74b96264-8d9a-412c-8e51-e26bc1463c8e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082679 Aug 08 09:16:42.145751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1211/2519] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:42 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:43.166308 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-5ed8a6fe-89eb-439d-a107-24d8581596da tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:43.166917 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-5ed8a6fe-89eb-439d-a107-24d8581596da tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:43.173554 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ed8a6fe-89eb-439d-a107-24d8581596da tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:43.174035 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ed8a6fe-89eb-439d-a107-24d8581596da tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:43.174468 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ed8a6fe-89eb-439d-a107-24d8581596da tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:43.175148 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ed8a6fe-89eb-439d-a107-24d8581596da tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:43.175598 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ed8a6fe-89eb-439d-a107-24d8581596da tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:43.176021 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-5ed8a6fe-89eb-439d-a107-24d8581596da tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:43.178546 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=84 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:16:43.238149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-5ed8a6fe-89eb-439d-a107-24d8581596da tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:43.245427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-5ed8a6fe-89eb-439d-a107-24d8581596da tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082895 Aug 08 09:16:43.245983 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1309/2520] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:43 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:44.266432 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-530bc61d-120a-4dd8-9e6e-17b16d3cf7a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:44.267078 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-530bc61d-120a-4dd8-9e6e-17b16d3cf7a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:44.273943 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-530bc61d-120a-4dd8-9e6e-17b16d3cf7a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:44.274428 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-530bc61d-120a-4dd8-9e6e-17b16d3cf7a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:44.274867 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-530bc61d-120a-4dd8-9e6e-17b16d3cf7a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:44.275555 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-530bc61d-120a-4dd8-9e6e-17b16d3cf7a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:44.276044 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-530bc61d-120a-4dd8-9e6e-17b16d3cf7a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:44.276473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-530bc61d-120a-4dd8-9e6e-17b16d3cf7a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:44.337589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-530bc61d-120a-4dd8-9e6e-17b16d3cf7a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:44.345547 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-530bc61d-120a-4dd8-9e6e-17b16d3cf7a1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082969 Aug 08 09:16:44.346099 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1212/2521] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:44 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:45.035059 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:16:45.035267 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:16:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:16:45.366745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0e2ef668-897b-41b7-915b-9d717591fd4f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:45.367364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0e2ef668-897b-41b7-915b-9d717591fd4f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:45.373971 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2ef668-897b-41b7-915b-9d717591fd4f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:45.374460 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2ef668-897b-41b7-915b-9d717591fd4f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:45.374899 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2ef668-897b-41b7-915b-9d717591fd4f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:45.375588 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2ef668-897b-41b7-915b-9d717591fd4f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:45.376042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2ef668-897b-41b7-915b-9d717591fd4f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:45.376469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0e2ef668-897b-41b7-915b-9d717591fd4f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:45.440387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0e2ef668-897b-41b7-915b-9d717591fd4f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:45.447931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0e2ef668-897b-41b7-915b-9d717591fd4f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085043 Aug 08 09:16:45.448490 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1310/2522] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:45 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:46.469415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9432e1d4-bb73-4938-b48f-cd37c9d22d45 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:46.470085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9432e1d4-bb73-4938-b48f-cd37c9d22d45 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:46.476631 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9432e1d4-bb73-4938-b48f-cd37c9d22d45 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:46.477127 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9432e1d4-bb73-4938-b48f-cd37c9d22d45 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:46.477621 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9432e1d4-bb73-4938-b48f-cd37c9d22d45 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:46.478318 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9432e1d4-bb73-4938-b48f-cd37c9d22d45 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:46.478784 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9432e1d4-bb73-4938-b48f-cd37c9d22d45 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:46.479214 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9432e1d4-bb73-4938-b48f-cd37c9d22d45 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:46.546682 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9432e1d4-bb73-4938-b48f-cd37c9d22d45 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:46.555170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9432e1d4-bb73-4938-b48f-cd37c9d22d45 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.090362 Aug 08 09:16:46.565337 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1213/2523] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:46 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:47.575589 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-3abc769c-1c4d-4447-8b86-09de4e029097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:47.576405 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-3abc769c-1c4d-4447-8b86-09de4e029097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:47.582812 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3abc769c-1c4d-4447-8b86-09de4e029097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:47.583268 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3abc769c-1c4d-4447-8b86-09de4e029097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:47.583701 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3abc769c-1c4d-4447-8b86-09de4e029097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:47.584382 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3abc769c-1c4d-4447-8b86-09de4e029097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:47.584834 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3abc769c-1c4d-4447-8b86-09de4e029097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:47.585291 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-3abc769c-1c4d-4447-8b86-09de4e029097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:47.645548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-3abc769c-1c4d-4447-8b86-09de4e029097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:47.653135 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-3abc769c-1c4d-4447-8b86-09de4e029097 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081433 Aug 08 09:16:47.653708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1311/2524] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:47 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:48.673690 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-b398b989-b396-4cce-ad38-63d1761341f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:48.674228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-b398b989-b396-4cce-ad38-63d1761341f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:48.680443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b398b989-b396-4cce-ad38-63d1761341f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:48.680924 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b398b989-b396-4cce-ad38-63d1761341f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:48.681395 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b398b989-b396-4cce-ad38-63d1761341f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:48.682082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b398b989-b396-4cce-ad38-63d1761341f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:48.682533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b398b989-b396-4cce-ad38-63d1761341f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:48.682951 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-b398b989-b396-4cce-ad38-63d1761341f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:48.745106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-b398b989-b396-4cce-ad38-63d1761341f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:48.753858 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-b398b989-b396-4cce-ad38-63d1761341f1 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084095 Aug 08 09:16:48.755773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1214/2525] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:48 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:49.776165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8c0430cf-67c1-4438-bfac-8642310e2d8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:49.776705 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8c0430cf-67c1-4438-bfac-8642310e2d8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:49.783800 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c0430cf-67c1-4438-bfac-8642310e2d8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:49.784290 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c0430cf-67c1-4438-bfac-8642310e2d8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:49.784733 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c0430cf-67c1-4438-bfac-8642310e2d8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:49.785463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c0430cf-67c1-4438-bfac-8642310e2d8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:49.785922 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c0430cf-67c1-4438-bfac-8642310e2d8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:49.786350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c0430cf-67c1-4438-bfac-8642310e2d8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:49.849843 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8c0430cf-67c1-4438-bfac-8642310e2d8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:49.857662 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8c0430cf-67c1-4438-bfac-8642310e2d8a tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085558 Aug 08 09:16:49.858225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1312/2526] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:49 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:50.878771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c35a40bf-28af-4489-b0a5-610f99dbcd8d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:50.879390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c35a40bf-28af-4489-b0a5-610f99dbcd8d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:50.885820 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c35a40bf-28af-4489-b0a5-610f99dbcd8d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:50.886309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c35a40bf-28af-4489-b0a5-610f99dbcd8d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:50.886751 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c35a40bf-28af-4489-b0a5-610f99dbcd8d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:50.887439 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c35a40bf-28af-4489-b0a5-610f99dbcd8d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:50.887899 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c35a40bf-28af-4489-b0a5-610f99dbcd8d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:50.888417 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c35a40bf-28af-4489-b0a5-610f99dbcd8d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:50.948382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c35a40bf-28af-4489-b0a5-610f99dbcd8d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:50.956546 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c35a40bf-28af-4489-b0a5-610f99dbcd8d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081651 Aug 08 09:16:50.957104 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1215/2527] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:50 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:16:51.976205 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d1aa8d9d-6dc9-4e6a-9388-4dfe2f5ccd5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:51.976855 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d1aa8d9d-6dc9-4e6a-9388-4dfe2f5ccd5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:51.979220 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=28 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:16:51.983856 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1aa8d9d-6dc9-4e6a-9388-4dfe2f5ccd5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:51.984337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1aa8d9d-6dc9-4e6a-9388-4dfe2f5ccd5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:51.984772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1aa8d9d-6dc9-4e6a-9388-4dfe2f5ccd5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:51.985489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1aa8d9d-6dc9-4e6a-9388-4dfe2f5ccd5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:51.985950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1aa8d9d-6dc9-4e6a-9388-4dfe2f5ccd5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:51.991581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d1aa8d9d-6dc9-4e6a-9388-4dfe2f5ccd5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:52.048271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d1aa8d9d-6dc9-4e6a-9388-4dfe2f5ccd5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:52.056070 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d1aa8d9d-6dc9-4e6a-9388-4dfe2f5ccd5f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083578 Aug 08 09:16:52.056633 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1313/2528] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:51 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:53.075764 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c4f52e99-168e-46d9-917c-9c33d5bb05ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:53.077075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c4f52e99-168e-46d9-917c-9c33d5bb05ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:53.079429 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=28 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:16:53.084068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4f52e99-168e-46d9-917c-9c33d5bb05ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:53.084564 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4f52e99-168e-46d9-917c-9c33d5bb05ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:53.085008 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4f52e99-168e-46d9-917c-9c33d5bb05ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:53.085762 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4f52e99-168e-46d9-917c-9c33d5bb05ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:53.086226 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4f52e99-168e-46d9-917c-9c33d5bb05ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:53.089446 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c4f52e99-168e-46d9-917c-9c33d5bb05ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:53.147978 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c4f52e99-168e-46d9-917c-9c33d5bb05ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:53.155572 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c4f52e99-168e-46d9-917c-9c33d5bb05ab tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083665 Aug 08 09:16:53.156130 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1216/2529] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:53 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:54.175910 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ecf7341e-4e7d-4ec0-a9ad-3c81464eba41 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:54.176590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ecf7341e-4e7d-4ec0-a9ad-3c81464eba41 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:54.182994 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ecf7341e-4e7d-4ec0-a9ad-3c81464eba41 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:54.183480 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ecf7341e-4e7d-4ec0-a9ad-3c81464eba41 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:54.183918 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ecf7341e-4e7d-4ec0-a9ad-3c81464eba41 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:54.184604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ecf7341e-4e7d-4ec0-a9ad-3c81464eba41 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:54.185062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ecf7341e-4e7d-4ec0-a9ad-3c81464eba41 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:54.185525 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ecf7341e-4e7d-4ec0-a9ad-3c81464eba41 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:54.250598 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ecf7341e-4e7d-4ec0-a9ad-3c81464eba41 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:54.258564 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ecf7341e-4e7d-4ec0-a9ad-3c81464eba41 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086504 Aug 08 09:16:54.259124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1314/2530] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:54 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:55.284017 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-096c8aad-0e78-4707-af59-e2823f6d4031 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:55.284645 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-096c8aad-0e78-4707-af59-e2823f6d4031 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:55.291183 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-096c8aad-0e78-4707-af59-e2823f6d4031 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:55.291676 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-096c8aad-0e78-4707-af59-e2823f6d4031 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:55.292120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-096c8aad-0e78-4707-af59-e2823f6d4031 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:55.292821 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-096c8aad-0e78-4707-af59-e2823f6d4031 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:55.293315 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-096c8aad-0e78-4707-af59-e2823f6d4031 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:55.293749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-096c8aad-0e78-4707-af59-e2823f6d4031 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:55.354300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-096c8aad-0e78-4707-af59-e2823f6d4031 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:55.362461 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-096c8aad-0e78-4707-af59-e2823f6d4031 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086423 Aug 08 09:16:55.363030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1217/2531] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:55 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:56.382959 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-234758b7-cf33-49f9-9dc9-ed7866b8038c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:56.383580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-234758b7-cf33-49f9-9dc9-ed7866b8038c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:56.390256 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-234758b7-cf33-49f9-9dc9-ed7866b8038c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:56.390755 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-234758b7-cf33-49f9-9dc9-ed7866b8038c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:56.391224 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-234758b7-cf33-49f9-9dc9-ed7866b8038c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:56.391915 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-234758b7-cf33-49f9-9dc9-ed7866b8038c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:56.392378 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-234758b7-cf33-49f9-9dc9-ed7866b8038c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:56.392809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-234758b7-cf33-49f9-9dc9-ed7866b8038c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:56.454612 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-234758b7-cf33-49f9-9dc9-ed7866b8038c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:56.462002 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-234758b7-cf33-49f9-9dc9-ed7866b8038c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082922 Aug 08 09:16:56.462570 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1315/2532] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:56 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:57.484372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-6e82eb07-4052-4b11-ad6a-94f49fec0d9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:57.484984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-6e82eb07-4052-4b11-ad6a-94f49fec0d9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:57.491416 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e82eb07-4052-4b11-ad6a-94f49fec0d9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:57.491888 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e82eb07-4052-4b11-ad6a-94f49fec0d9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:57.492328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e82eb07-4052-4b11-ad6a-94f49fec0d9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:57.493007 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e82eb07-4052-4b11-ad6a-94f49fec0d9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:57.493488 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e82eb07-4052-4b11-ad6a-94f49fec0d9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:57.493912 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-6e82eb07-4052-4b11-ad6a-94f49fec0d9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:57.555504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-6e82eb07-4052-4b11-ad6a-94f49fec0d9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:57.563640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-6e82eb07-4052-4b11-ad6a-94f49fec0d9b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083216 Aug 08 09:16:57.564189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1218/2533] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:57 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:58.584420 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-272806c4-1dbc-498b-906e-541860ea7ae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:58.584952 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-272806c4-1dbc-498b-906e-541860ea7ae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:58.591323 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-272806c4-1dbc-498b-906e-541860ea7ae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:58.591840 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-272806c4-1dbc-498b-906e-541860ea7ae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:58.592301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-272806c4-1dbc-498b-906e-541860ea7ae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:58.592985 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-272806c4-1dbc-498b-906e-541860ea7ae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:58.593469 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-272806c4-1dbc-498b-906e-541860ea7ae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:58.593897 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-272806c4-1dbc-498b-906e-541860ea7ae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:58.657809 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-272806c4-1dbc-498b-906e-541860ea7ae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:58.665170 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-272806c4-1dbc-498b-906e-541860ea7ae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084630 Aug 08 09:16:58.665720 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1316/2534] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:58 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:16:59.686085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3c368567-fc65-4e98-8747-62f7087b48d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:16:59.686636 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3c368567-fc65-4e98-8747-62f7087b48d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:16:59.693023 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3c368567-fc65-4e98-8747-62f7087b48d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:59.693541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3c368567-fc65-4e98-8747-62f7087b48d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:59.693981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3c368567-fc65-4e98-8747-62f7087b48d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:59.694696 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3c368567-fc65-4e98-8747-62f7087b48d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:16:59.695154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3c368567-fc65-4e98-8747-62f7087b48d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:16:59.695589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3c368567-fc65-4e98-8747-62f7087b48d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:16:59.758427 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3c368567-fc65-4e98-8747-62f7087b48d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:16:59.766691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3c368567-fc65-4e98-8747-62f7087b48d9 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084524 Aug 08 09:16:59.767254 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1219/2535] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:16:59 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:00.788022 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-80035cfb-ba07-4524-aa9b-f2cddca4ae55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:00.788536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-80035cfb-ba07-4524-aa9b-f2cddca4ae55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:00.795023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80035cfb-ba07-4524-aa9b-f2cddca4ae55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:00.796140 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80035cfb-ba07-4524-aa9b-f2cddca4ae55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:00.796658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80035cfb-ba07-4524-aa9b-f2cddca4ae55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:00.797374 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80035cfb-ba07-4524-aa9b-f2cddca4ae55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:00.797925 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80035cfb-ba07-4524-aa9b-f2cddca4ae55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:00.798372 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-80035cfb-ba07-4524-aa9b-f2cddca4ae55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:00.860149 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-80035cfb-ba07-4524-aa9b-f2cddca4ae55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:00.867581 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-80035cfb-ba07-4524-aa9b-f2cddca4ae55 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083668 Aug 08 09:17:00.868154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1317/2536] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:00 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:01.887398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f6aac64a-9967-4df8-8d86-9e1cd862c1fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:01.888019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f6aac64a-9967-4df8-8d86-9e1cd862c1fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:01.894643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6aac64a-9967-4df8-8d86-9e1cd862c1fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:01.895136 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6aac64a-9967-4df8-8d86-9e1cd862c1fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:01.895580 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6aac64a-9967-4df8-8d86-9e1cd862c1fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:01.896275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6aac64a-9967-4df8-8d86-9e1cd862c1fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:01.896740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6aac64a-9967-4df8-8d86-9e1cd862c1fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:01.897190 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f6aac64a-9967-4df8-8d86-9e1cd862c1fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:01.959786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f6aac64a-9967-4df8-8d86-9e1cd862c1fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:01.967770 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f6aac64a-9967-4df8-8d86-9e1cd862c1fa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083656 Aug 08 09:17:01.968541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1220/2537] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:01 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:02.988426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-cc8b2850-e522-4019-9934-948f52fa93d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:02.989043 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-cc8b2850-e522-4019-9934-948f52fa93d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:02.995548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8b2850-e522-4019-9934-948f52fa93d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:02.996036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8b2850-e522-4019-9934-948f52fa93d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:02.996473 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8b2850-e522-4019-9934-948f52fa93d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:02.997184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8b2850-e522-4019-9934-948f52fa93d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:02.997645 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8b2850-e522-4019-9934-948f52fa93d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:02.998074 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-cc8b2850-e522-4019-9934-948f52fa93d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:03.063200 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-cc8b2850-e522-4019-9934-948f52fa93d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:03.070957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-cc8b2850-e522-4019-9934-948f52fa93d5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086625 Aug 08 09:17:03.071514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1318/2538] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:02 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:04.091576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-abb6b649-23a5-4a91-a825-40c834c19c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:04.092188 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-abb6b649-23a5-4a91-a825-40c834c19c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:04.098754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abb6b649-23a5-4a91-a825-40c834c19c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:04.099301 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abb6b649-23a5-4a91-a825-40c834c19c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:04.099735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abb6b649-23a5-4a91-a825-40c834c19c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:04.100473 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abb6b649-23a5-4a91-a825-40c834c19c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:04.100926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abb6b649-23a5-4a91-a825-40c834c19c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:04.101376 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-abb6b649-23a5-4a91-a825-40c834c19c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:04.163152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-abb6b649-23a5-4a91-a825-40c834c19c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:04.170717 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-abb6b649-23a5-4a91-a825-40c834c19c95 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083100 Aug 08 09:17:04.171264 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1221/2539] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:04 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:05.193100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-25da009e-5324-4c98-b2d2-815cce05c358 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:05.193747 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-25da009e-5324-4c98-b2d2-815cce05c358 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:05.200100 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25da009e-5324-4c98-b2d2-815cce05c358 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:05.200582 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25da009e-5324-4c98-b2d2-815cce05c358 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:05.201016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25da009e-5324-4c98-b2d2-815cce05c358 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:05.201728 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25da009e-5324-4c98-b2d2-815cce05c358 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:05.202180 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25da009e-5324-4c98-b2d2-815cce05c358 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:05.203367 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-25da009e-5324-4c98-b2d2-815cce05c358 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:05.263274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-25da009e-5324-4c98-b2d2-815cce05c358 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:05.271425 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-25da009e-5324-4c98-b2d2-815cce05c358 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083017 Aug 08 09:17:05.271982 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1319/2540] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:05 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:06.291833 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-83b18c42-0a90-4d86-a562-e25530ddd3ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:06.292444 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-83b18c42-0a90-4d86-a562-e25530ddd3ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:06.299573 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-83b18c42-0a90-4d86-a562-e25530ddd3ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:06.300066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-83b18c42-0a90-4d86-a562-e25530ddd3ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:06.300507 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-83b18c42-0a90-4d86-a562-e25530ddd3ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:06.301223 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-83b18c42-0a90-4d86-a562-e25530ddd3ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:06.301693 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-83b18c42-0a90-4d86-a562-e25530ddd3ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:06.302120 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-83b18c42-0a90-4d86-a562-e25530ddd3ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:06.304660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=84 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:17:06.363321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-83b18c42-0a90-4d86-a562-e25530ddd3ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:06.370970 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-83b18c42-0a90-4d86-a562-e25530ddd3ae tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083058 Aug 08 09:17:06.371528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1222/2541] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:06 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:07.391919 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6d065e10-3c77-4628-9a67-af3754b713ca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:07.392537 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6d065e10-3c77-4628-9a67-af3754b713ca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:07.398792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d065e10-3c77-4628-9a67-af3754b713ca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:07.399278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d065e10-3c77-4628-9a67-af3754b713ca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:07.399735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d065e10-3c77-4628-9a67-af3754b713ca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:07.400409 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d065e10-3c77-4628-9a67-af3754b713ca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:07.400864 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d065e10-3c77-4628-9a67-af3754b713ca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:07.401331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6d065e10-3c77-4628-9a67-af3754b713ca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:07.467126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6d065e10-3c77-4628-9a67-af3754b713ca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:07.474972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6d065e10-3c77-4628-9a67-af3754b713ca tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.087063 Aug 08 09:17:07.475532 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1320/2542] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:07 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:08.495605 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d5900ca5-ef8d-476b-b7ad-b77fbb85cfe4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:08.496216 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d5900ca5-ef8d-476b-b7ad-b77fbb85cfe4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:08.502806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5900ca5-ef8d-476b-b7ad-b77fbb85cfe4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:08.503291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5900ca5-ef8d-476b-b7ad-b77fbb85cfe4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:08.503730 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5900ca5-ef8d-476b-b7ad-b77fbb85cfe4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:08.504412 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5900ca5-ef8d-476b-b7ad-b77fbb85cfe4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:08.504867 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5900ca5-ef8d-476b-b7ad-b77fbb85cfe4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:08.505322 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d5900ca5-ef8d-476b-b7ad-b77fbb85cfe4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:08.568082 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d5900ca5-ef8d-476b-b7ad-b77fbb85cfe4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:08.575449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d5900ca5-ef8d-476b-b7ad-b77fbb85cfe4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083665 Aug 08 09:17:08.575996 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1223/2543] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:08 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:09.595743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-d04f1db6-b752-4154-bb22-99d562882aaa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:09.596351 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-d04f1db6-b752-4154-bb22-99d562882aaa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:09.602691 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d04f1db6-b752-4154-bb22-99d562882aaa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:09.603171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d04f1db6-b752-4154-bb22-99d562882aaa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:09.603604 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d04f1db6-b752-4154-bb22-99d562882aaa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:09.604284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d04f1db6-b752-4154-bb22-99d562882aaa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:09.604743 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d04f1db6-b752-4154-bb22-99d562882aaa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:09.605230 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-d04f1db6-b752-4154-bb22-99d562882aaa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:09.664667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-d04f1db6-b752-4154-bb22-99d562882aaa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:09.672247 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-d04f1db6-b752-4154-bb22-99d562882aaa tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.080343 Aug 08 09:17:09.672749 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1321/2544] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:09 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:10.691881 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-f19c0226-9306-415d-b114-6e16a2e25c1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:10.692411 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-f19c0226-9306-415d-b114-6e16a2e25c1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:10.698756 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f19c0226-9306-415d-b114-6e16a2e25c1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:10.707998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f19c0226-9306-415d-b114-6e16a2e25c1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:10.707998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f19c0226-9306-415d-b114-6e16a2e25c1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:10.707998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f19c0226-9306-415d-b114-6e16a2e25c1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:10.707998 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f19c0226-9306-415d-b114-6e16a2e25c1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:10.708330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-f19c0226-9306-415d-b114-6e16a2e25c1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:10.761947 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-f19c0226-9306-415d-b114-6e16a2e25c1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:10.770041 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-f19c0226-9306-415d-b114-6e16a2e25c1c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082114 Aug 08 09:17:10.773651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1224/2545] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:10 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:11.790739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fd8a173d-5760-44e8-a151-8f39286074bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:11.791278 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fd8a173d-5760-44e8-a151-8f39286074bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:11.797824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd8a173d-5760-44e8-a151-8f39286074bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:11.798307 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd8a173d-5760-44e8-a151-8f39286074bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:11.798745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd8a173d-5760-44e8-a151-8f39286074bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:11.799428 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd8a173d-5760-44e8-a151-8f39286074bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:11.799886 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd8a173d-5760-44e8-a151-8f39286074bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:11.800310 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fd8a173d-5760-44e8-a151-8f39286074bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:11.864390 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fd8a173d-5760-44e8-a151-8f39286074bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:11.871914 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fd8a173d-5760-44e8-a151-8f39286074bc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085166 Aug 08 09:17:11.872474 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1322/2546] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:11 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:12.892246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-56be5b61-04af-40b0-8e6a-325cd204d199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:12.892858 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-56be5b61-04af-40b0-8e6a-325cd204d199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:12.899495 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56be5b61-04af-40b0-8e6a-325cd204d199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:12.899977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56be5b61-04af-40b0-8e6a-325cd204d199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:12.900415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56be5b61-04af-40b0-8e6a-325cd204d199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:12.901103 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56be5b61-04af-40b0-8e6a-325cd204d199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:12.901585 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56be5b61-04af-40b0-8e6a-325cd204d199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:12.902020 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-56be5b61-04af-40b0-8e6a-325cd204d199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:12.965503 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-56be5b61-04af-40b0-8e6a-325cd204d199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:12.973963 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-56be5b61-04af-40b0-8e6a-325cd204d199 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086114 Aug 08 09:17:12.974518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1225/2547] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:12 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:13.994529 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-48c9041f-9c37-41d6-ac5b-268ecfd75592 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:13.995253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-48c9041f-9c37-41d6-ac5b-268ecfd75592 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:14.001822 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c9041f-9c37-41d6-ac5b-268ecfd75592 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:14.002316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c9041f-9c37-41d6-ac5b-268ecfd75592 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:14.002765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c9041f-9c37-41d6-ac5b-268ecfd75592 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:14.003457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c9041f-9c37-41d6-ac5b-268ecfd75592 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:14.003923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c9041f-9c37-41d6-ac5b-268ecfd75592 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:14.004357 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48c9041f-9c37-41d6-ac5b-268ecfd75592 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:14.008231 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=84 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:17:14.065626 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-48c9041f-9c37-41d6-ac5b-268ecfd75592 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:14.073198 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-48c9041f-9c37-41d6-ac5b-268ecfd75592 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082481 Aug 08 09:17:14.073772 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1323/2548] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:13 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:15.093847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-666eb632-be36-4d16-9ab9-443bd22a39c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:15.094451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-666eb632-be36-4d16-9ab9-443bd22a39c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:15.100865 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-666eb632-be36-4d16-9ab9-443bd22a39c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:15.101356 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-666eb632-be36-4d16-9ab9-443bd22a39c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:15.101795 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-666eb632-be36-4d16-9ab9-443bd22a39c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:15.102480 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-666eb632-be36-4d16-9ab9-443bd22a39c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:15.102934 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-666eb632-be36-4d16-9ab9-443bd22a39c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:15.103361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-666eb632-be36-4d16-9ab9-443bd22a39c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:15.164095 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-666eb632-be36-4d16-9ab9-443bd22a39c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:15.172908 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-666eb632-be36-4d16-9ab9-443bd22a39c5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082978 Aug 08 09:17:15.173490 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1226/2549] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:15 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:16.193795 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-ae8fe133-f112-450f-899d-1c550e5da49e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:16.194430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-ae8fe133-f112-450f-899d-1c550e5da49e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:16.200658 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae8fe133-f112-450f-899d-1c550e5da49e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:16.201154 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae8fe133-f112-450f-899d-1c550e5da49e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:16.201602 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae8fe133-f112-450f-899d-1c550e5da49e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:16.202280 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae8fe133-f112-450f-899d-1c550e5da49e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:16.203393 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae8fe133-f112-450f-899d-1c550e5da49e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:16.203867 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-ae8fe133-f112-450f-899d-1c550e5da49e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:16.266217 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-ae8fe133-f112-450f-899d-1c550e5da49e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:16.273746 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-ae8fe133-f112-450f-899d-1c550e5da49e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083511 Aug 08 09:17:16.274309 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1324/2550] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:16 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:17.294125 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-dd9c7c3b-9548-416c-9bba-1a424b1dbe40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:17.294731 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-dd9c7c3b-9548-416c-9bba-1a424b1dbe40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:17.301804 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9c7c3b-9548-416c-9bba-1a424b1dbe40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:17.302283 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9c7c3b-9548-416c-9bba-1a424b1dbe40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:17.302715 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9c7c3b-9548-416c-9bba-1a424b1dbe40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:17.303397 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9c7c3b-9548-416c-9bba-1a424b1dbe40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:17.303855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9c7c3b-9548-416c-9bba-1a424b1dbe40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:17.304276 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-dd9c7c3b-9548-416c-9bba-1a424b1dbe40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:17.366981 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-dd9c7c3b-9548-416c-9bba-1a424b1dbe40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:17.374500 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-dd9c7c3b-9548-416c-9bba-1a424b1dbe40 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084226 Aug 08 09:17:17.375151 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1227/2551] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:17 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:18.395305 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-89b96072-ab19-49b5-a232-19d5f0a7da18 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:18.395912 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-89b96072-ab19-49b5-a232-19d5f0a7da18 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:18.402584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b96072-ab19-49b5-a232-19d5f0a7da18 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:18.403064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b96072-ab19-49b5-a232-19d5f0a7da18 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:18.403498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b96072-ab19-49b5-a232-19d5f0a7da18 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:18.404178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b96072-ab19-49b5-a232-19d5f0a7da18 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:18.404628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b96072-ab19-49b5-a232-19d5f0a7da18 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:18.405051 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-89b96072-ab19-49b5-a232-19d5f0a7da18 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:18.467335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-89b96072-ab19-49b5-a232-19d5f0a7da18 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:18.475740 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-89b96072-ab19-49b5-a232-19d5f0a7da18 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084355 Aug 08 09:17:18.476300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1325/2552] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:18 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:17:19.496311 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-d87e6a6f-84e3-4df4-95e0-cd768193757c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:19.496911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-d87e6a6f-84e3-4df4-95e0-cd768193757c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:19.504111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d87e6a6f-84e3-4df4-95e0-cd768193757c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:19.504593 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d87e6a6f-84e3-4df4-95e0-cd768193757c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:19.505030 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d87e6a6f-84e3-4df4-95e0-cd768193757c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:19.505737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d87e6a6f-84e3-4df4-95e0-cd768193757c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:19.506195 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d87e6a6f-84e3-4df4-95e0-cd768193757c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:19.506617 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-d87e6a6f-84e3-4df4-95e0-cd768193757c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:19.567614 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-d87e6a6f-84e3-4df4-95e0-cd768193757c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:19.575047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-d87e6a6f-84e3-4df4-95e0-cd768193757c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082660 Aug 08 09:17:19.575611 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1228/2553] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:19 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:20.595369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-48d4fe08-6e03-4dc1-8e40-f7609ea0a198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:20.595941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-48d4fe08-6e03-4dc1-8e40-f7609ea0a198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:20.602269 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d4fe08-6e03-4dc1-8e40-f7609ea0a198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:20.602750 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d4fe08-6e03-4dc1-8e40-f7609ea0a198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:20.603184 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d4fe08-6e03-4dc1-8e40-f7609ea0a198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:20.603862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d4fe08-6e03-4dc1-8e40-f7609ea0a198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:20.604316 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d4fe08-6e03-4dc1-8e40-f7609ea0a198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:20.604739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-48d4fe08-6e03-4dc1-8e40-f7609ea0a198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:20.668923 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-48d4fe08-6e03-4dc1-8e40-f7609ea0a198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:20.676860 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-48d4fe08-6e03-4dc1-8e40-f7609ea0a198 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085553 Aug 08 09:17:20.677447 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1326/2554] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:20 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:21.697737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-866cb286-499c-469f-9ad8-1b1180dd8657 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:21.698350 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-866cb286-499c-469f-9ad8-1b1180dd8657 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:21.705249 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866cb286-499c-469f-9ad8-1b1180dd8657 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:21.705737 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866cb286-499c-469f-9ad8-1b1180dd8657 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:21.706169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866cb286-499c-469f-9ad8-1b1180dd8657 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:21.706856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866cb286-499c-469f-9ad8-1b1180dd8657 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:21.707307 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866cb286-499c-469f-9ad8-1b1180dd8657 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:21.707732 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-866cb286-499c-469f-9ad8-1b1180dd8657 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:21.768905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-866cb286-499c-469f-9ad8-1b1180dd8657 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:21.776649 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-866cb286-499c-469f-9ad8-1b1180dd8657 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082826 Aug 08 09:17:21.779964 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1229/2555] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:21 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:22.798369 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-60088075-f6e2-4160-a2cf-3e0302f7b921 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:22.798944 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-60088075-f6e2-4160-a2cf-3e0302f7b921 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:22.801279 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=28 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:17:22.806024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60088075-f6e2-4160-a2cf-3e0302f7b921 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:22.806515 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60088075-f6e2-4160-a2cf-3e0302f7b921 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:22.806957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60088075-f6e2-4160-a2cf-3e0302f7b921 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:22.807655 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60088075-f6e2-4160-a2cf-3e0302f7b921 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:22.808143 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60088075-f6e2-4160-a2cf-3e0302f7b921 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:22.808576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-60088075-f6e2-4160-a2cf-3e0302f7b921 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:22.872577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-60088075-f6e2-4160-a2cf-3e0302f7b921 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:22.880584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-60088075-f6e2-4160-a2cf-3e0302f7b921 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086819 Aug 08 09:17:22.881168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1327/2556] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:22 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:23.900164 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-51069eb3-135e-469a-813a-946c0136b46e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:23.900786 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-51069eb3-135e-469a-813a-946c0136b46e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:23.903106 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=28 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:17:23.907901 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51069eb3-135e-469a-813a-946c0136b46e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:23.908391 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51069eb3-135e-469a-813a-946c0136b46e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:23.908837 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51069eb3-135e-469a-813a-946c0136b46e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:23.909565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51069eb3-135e-469a-813a-946c0136b46e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:23.913773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51069eb3-135e-469a-813a-946c0136b46e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:23.913773 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-51069eb3-135e-469a-813a-946c0136b46e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:23.972173 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-51069eb3-135e-469a-813a-946c0136b46e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:23.979535 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-51069eb3-135e-469a-813a-946c0136b46e tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083496 Aug 08 09:17:23.980092 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1230/2557] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:23 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:25.000234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9938c264-7e1b-4831-9418-ae4d8021c059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:25.000842 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9938c264-7e1b-4831-9418-ae4d8021c059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:25.007225 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9938c264-7e1b-4831-9418-ae4d8021c059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:25.007706 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9938c264-7e1b-4831-9418-ae4d8021c059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:25.008136 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9938c264-7e1b-4831-9418-ae4d8021c059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:25.008815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9938c264-7e1b-4831-9418-ae4d8021c059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:25.009296 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9938c264-7e1b-4831-9418-ae4d8021c059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:25.009719 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9938c264-7e1b-4831-9418-ae4d8021c059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:25.073029 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9938c264-7e1b-4831-9418-ae4d8021c059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:25.081211 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9938c264-7e1b-4831-9418-ae4d8021c059 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084973 Aug 08 09:17:25.081767 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1328/2558] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:24 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:26.101693 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7b5563d7-ec03-4045-b883-70f9655e4153 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:26.102317 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7b5563d7-ec03-4045-b883-70f9655e4153 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:26.108699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b5563d7-ec03-4045-b883-70f9655e4153 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:26.109213 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b5563d7-ec03-4045-b883-70f9655e4153 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:26.109659 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b5563d7-ec03-4045-b883-70f9655e4153 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:26.110357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b5563d7-ec03-4045-b883-70f9655e4153 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:26.110842 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b5563d7-ec03-4045-b883-70f9655e4153 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:26.111278 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7b5563d7-ec03-4045-b883-70f9655e4153 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:26.171827 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7b5563d7-ec03-4045-b883-70f9655e4153 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:26.179306 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7b5563d7-ec03-4045-b883-70f9655e4153 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081523 Aug 08 09:17:26.179863 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1231/2559] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:26 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:27.200144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-9b31a1fe-3db5-464b-a06b-1fb110435dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:27.200765 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-9b31a1fe-3db5-464b-a06b-1fb110435dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:27.208380 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b31a1fe-3db5-464b-a06b-1fb110435dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:27.208872 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b31a1fe-3db5-464b-a06b-1fb110435dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:27.209347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b31a1fe-3db5-464b-a06b-1fb110435dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:27.210042 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b31a1fe-3db5-464b-a06b-1fb110435dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:27.210508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b31a1fe-3db5-464b-a06b-1fb110435dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:27.210943 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-9b31a1fe-3db5-464b-a06b-1fb110435dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:27.271166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-9b31a1fe-3db5-464b-a06b-1fb110435dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:27.279283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-9b31a1fe-3db5-464b-a06b-1fb110435dde tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082601 Aug 08 09:17:27.279854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1329/2560] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:27 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:28.301100 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-662c7af9-0832-4e24-bb22-d91fe91eeea7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:28.301740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-662c7af9-0832-4e24-bb22-d91fe91eeea7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:28.310948 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-662c7af9-0832-4e24-bb22-d91fe91eeea7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:28.311464 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-662c7af9-0832-4e24-bb22-d91fe91eeea7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:28.311909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-662c7af9-0832-4e24-bb22-d91fe91eeea7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:28.312607 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-662c7af9-0832-4e24-bb22-d91fe91eeea7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:28.313284 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-662c7af9-0832-4e24-bb22-d91fe91eeea7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:28.313724 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-662c7af9-0832-4e24-bb22-d91fe91eeea7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:28.379068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-662c7af9-0832-4e24-bb22-d91fe91eeea7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:28.386877 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-662c7af9-0832-4e24-bb22-d91fe91eeea7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.090867 Aug 08 09:17:28.387436 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1232/2561] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:28 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:29.409979 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e3c43b6a-60a3-4b71-9aa6-7e0262519474 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:29.410596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e3c43b6a-60a3-4b71-9aa6-7e0262519474 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:29.417075 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3c43b6a-60a3-4b71-9aa6-7e0262519474 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:29.417587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3c43b6a-60a3-4b71-9aa6-7e0262519474 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:29.418020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3c43b6a-60a3-4b71-9aa6-7e0262519474 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:29.418704 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3c43b6a-60a3-4b71-9aa6-7e0262519474 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:29.419159 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3c43b6a-60a3-4b71-9aa6-7e0262519474 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:29.419580 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e3c43b6a-60a3-4b71-9aa6-7e0262519474 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:29.482955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e3c43b6a-60a3-4b71-9aa6-7e0262519474 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:29.490877 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e3c43b6a-60a3-4b71-9aa6-7e0262519474 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084865 Aug 08 09:17:29.491432 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1330/2562] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:29 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:30.511654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-674eaa37-8924-4287-882a-6586db2d0dfd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:30.512265 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-674eaa37-8924-4287-882a-6586db2d0dfd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:30.519311 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-674eaa37-8924-4287-882a-6586db2d0dfd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:30.519792 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-674eaa37-8924-4287-882a-6586db2d0dfd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:30.520231 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-674eaa37-8924-4287-882a-6586db2d0dfd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:30.520911 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-674eaa37-8924-4287-882a-6586db2d0dfd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:30.521401 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-674eaa37-8924-4287-882a-6586db2d0dfd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:30.521825 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-674eaa37-8924-4287-882a-6586db2d0dfd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:30.582286 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-674eaa37-8924-4287-882a-6586db2d0dfd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:30.589654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-674eaa37-8924-4287-882a-6586db2d0dfd tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081869 Aug 08 09:17:30.590208 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1233/2563] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:30 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:31.609950 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-99cf1e63-8733-4902-88bd-d72497e2bd7f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:31.610558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-99cf1e63-8733-4902-88bd-d72497e2bd7f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:31.617062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99cf1e63-8733-4902-88bd-d72497e2bd7f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:31.617577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99cf1e63-8733-4902-88bd-d72497e2bd7f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:31.618016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99cf1e63-8733-4902-88bd-d72497e2bd7f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:31.618693 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99cf1e63-8733-4902-88bd-d72497e2bd7f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:31.619144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99cf1e63-8733-4902-88bd-d72497e2bd7f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:31.619565 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-99cf1e63-8733-4902-88bd-d72497e2bd7f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:31.680461 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-99cf1e63-8733-4902-88bd-d72497e2bd7f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:31.687847 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-99cf1e63-8733-4902-88bd-d72497e2bd7f tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081708 Aug 08 09:17:31.688398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1331/2564] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:31 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:32.707937 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-471b1db4-bc9f-4698-a3ed-595dbf081bd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:32.708506 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-471b1db4-bc9f-4698-a3ed-595dbf081bd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:32.715097 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-471b1db4-bc9f-4698-a3ed-595dbf081bd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:32.715589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-471b1db4-bc9f-4698-a3ed-595dbf081bd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:32.716033 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-471b1db4-bc9f-4698-a3ed-595dbf081bd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:32.716757 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-471b1db4-bc9f-4698-a3ed-595dbf081bd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:32.717246 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-471b1db4-bc9f-4698-a3ed-595dbf081bd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:32.717679 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-471b1db4-bc9f-4698-a3ed-595dbf081bd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:32.779070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-471b1db4-bc9f-4698-a3ed-595dbf081bd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:32.787063 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-471b1db4-bc9f-4698-a3ed-595dbf081bd0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083131 Aug 08 09:17:32.787622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1234/2565] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:32 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:33.808541 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-7d650eab-0887-48fd-9d4f-c0290f29b856 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:33.809128 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-7d650eab-0887-48fd-9d4f-c0290f29b856 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:33.816178 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d650eab-0887-48fd-9d4f-c0290f29b856 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:33.816667 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d650eab-0887-48fd-9d4f-c0290f29b856 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:33.817129 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d650eab-0887-48fd-9d4f-c0290f29b856 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:33.817853 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d650eab-0887-48fd-9d4f-c0290f29b856 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:33.818314 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d650eab-0887-48fd-9d4f-c0290f29b856 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:33.818755 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-7d650eab-0887-48fd-9d4f-c0290f29b856 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:33.882660 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-7d650eab-0887-48fd-9d4f-c0290f29b856 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:33.890153 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-7d650eab-0887-48fd-9d4f-c0290f29b856 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085574 Aug 08 09:17:33.890874 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1332/2566] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:33 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:34.911141 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-3969d623-32a0-43d3-949a-a68aaceb70de tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:34.911761 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-3969d623-32a0-43d3-949a-a68aaceb70de tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:34.918131 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3969d623-32a0-43d3-949a-a68aaceb70de tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:34.918622 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3969d623-32a0-43d3-949a-a68aaceb70de tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:34.919066 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3969d623-32a0-43d3-949a-a68aaceb70de tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:34.919759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3969d623-32a0-43d3-949a-a68aaceb70de tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:34.920221 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3969d623-32a0-43d3-949a-a68aaceb70de tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:34.920656 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-3969d623-32a0-43d3-949a-a68aaceb70de tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:34.983085 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-3969d623-32a0-43d3-949a-a68aaceb70de tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:34.990735 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-3969d623-32a0-43d3-949a-a68aaceb70de tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083566 Aug 08 09:17:34.991300 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1235/2567] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:34 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:36.011752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f9890fe0-5c60-43d0-8080-1a3647999e68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:36.012362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f9890fe0-5c60-43d0-8080-1a3647999e68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:36.018775 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9890fe0-5c60-43d0-8080-1a3647999e68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:36.019253 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9890fe0-5c60-43d0-8080-1a3647999e68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:36.019688 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9890fe0-5c60-43d0-8080-1a3647999e68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:36.020383 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9890fe0-5c60-43d0-8080-1a3647999e68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:36.020816 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9890fe0-5c60-43d0-8080-1a3647999e68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:36.021271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f9890fe0-5c60-43d0-8080-1a3647999e68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:36.083239 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f9890fe0-5c60-43d0-8080-1a3647999e68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:36.090558 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f9890fe0-5c60-43d0-8080-1a3647999e68 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082641 Aug 08 09:17:36.091108 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1333/2568] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:36 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:37.111342 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-40748d3c-ee1b-43c0-ab2d-90bcd55278c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:37.111939 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-40748d3c-ee1b-43c0-ab2d-90bcd55278c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:37.118034 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40748d3c-ee1b-43c0-ab2d-90bcd55278c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:37.118549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40748d3c-ee1b-43c0-ab2d-90bcd55278c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:37.118997 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40748d3c-ee1b-43c0-ab2d-90bcd55278c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:37.119691 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40748d3c-ee1b-43c0-ab2d-90bcd55278c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:37.120152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40748d3c-ee1b-43c0-ab2d-90bcd55278c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:37.120583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-40748d3c-ee1b-43c0-ab2d-90bcd55278c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:37.124571 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=84 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:17:37.181308 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-40748d3c-ee1b-43c0-ab2d-90bcd55278c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:37.188670 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-40748d3c-ee1b-43c0-ab2d-90bcd55278c0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081423 Aug 08 09:17:37.189914 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1236/2569] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:37 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:38.209232 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-a36422dd-6201-4b5f-968d-437fdcdee8d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:38.209854 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-a36422dd-6201-4b5f-968d-437fdcdee8d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:38.216137 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36422dd-6201-4b5f-968d-437fdcdee8d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:38.216614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36422dd-6201-4b5f-968d-437fdcdee8d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:38.217052 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36422dd-6201-4b5f-968d-437fdcdee8d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:38.217771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36422dd-6201-4b5f-968d-437fdcdee8d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:38.218229 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36422dd-6201-4b5f-968d-437fdcdee8d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:38.218656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-a36422dd-6201-4b5f-968d-437fdcdee8d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:38.283901 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-a36422dd-6201-4b5f-968d-437fdcdee8d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:38.291577 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-a36422dd-6201-4b5f-968d-437fdcdee8d0 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086230 Aug 08 09:17:38.292144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1334/2570] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:38 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:39.310988 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-c9e315bc-9025-4141-bba9-fa9ccff43501 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:39.311604 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-c9e315bc-9025-4141-bba9-fa9ccff43501 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:39.318093 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9e315bc-9025-4141-bba9-fa9ccff43501 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:39.318578 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9e315bc-9025-4141-bba9-fa9ccff43501 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:39.319015 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9e315bc-9025-4141-bba9-fa9ccff43501 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:39.319699 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9e315bc-9025-4141-bba9-fa9ccff43501 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:39.320152 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9e315bc-9025-4141-bba9-fa9ccff43501 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:39.320575 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-c9e315bc-9025-4141-bba9-fa9ccff43501 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:39.381374 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-c9e315bc-9025-4141-bba9-fa9ccff43501 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:39.388667 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-c9e315bc-9025-4141-bba9-fa9ccff43501 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081502 Aug 08 09:17:39.389238 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1237/2571] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:39 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:40.412347 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6dc56edd-96de-4603-b6f4-933e564632dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:40.412955 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6dc56edd-96de-4603-b6f4-933e564632dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:40.419692 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc56edd-96de-4603-b6f4-933e564632dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:40.420176 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc56edd-96de-4603-b6f4-933e564632dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:40.420611 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc56edd-96de-4603-b6f4-933e564632dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:40.421328 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc56edd-96de-4603-b6f4-933e564632dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:40.421781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc56edd-96de-4603-b6f4-933e564632dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:40.422259 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6dc56edd-96de-4603-b6f4-933e564632dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:40.482845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6dc56edd-96de-4603-b6f4-933e564632dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:40.490957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6dc56edd-96de-4603-b6f4-933e564632dc tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083302 Aug 08 09:17:40.491507 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1335/2572] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:40 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:41.511287 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ca48d54e-44f4-4c57-93e1-bb30fd856de8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:41.511907 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ca48d54e-44f4-4c57-93e1-bb30fd856de8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:41.518375 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca48d54e-44f4-4c57-93e1-bb30fd856de8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:41.518862 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca48d54e-44f4-4c57-93e1-bb30fd856de8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:41.519303 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca48d54e-44f4-4c57-93e1-bb30fd856de8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:41.519995 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca48d54e-44f4-4c57-93e1-bb30fd856de8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:41.520457 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca48d54e-44f4-4c57-93e1-bb30fd856de8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:41.520887 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ca48d54e-44f4-4c57-93e1-bb30fd856de8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:41.581496 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ca48d54e-44f4-4c57-93e1-bb30fd856de8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:41.589043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ca48d54e-44f4-4c57-93e1-bb30fd856de8 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081679 Aug 08 09:17:41.589625 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1238/2573] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:41 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:42.609430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-999746ed-b005-41c4-a7db-e1a249124f60 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:42.610045 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-999746ed-b005-41c4-a7db-e1a249124f60 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:42.616398 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-999746ed-b005-41c4-a7db-e1a249124f60 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:42.616882 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-999746ed-b005-41c4-a7db-e1a249124f60 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:42.617361 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-999746ed-b005-41c4-a7db-e1a249124f60 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:42.618046 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-999746ed-b005-41c4-a7db-e1a249124f60 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:42.618502 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-999746ed-b005-41c4-a7db-e1a249124f60 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:42.618931 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-999746ed-b005-41c4-a7db-e1a249124f60 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:42.683518 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-999746ed-b005-41c4-a7db-e1a249124f60 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:42.691590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-999746ed-b005-41c4-a7db-e1a249124f60 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.086089 Aug 08 09:17:42.692147 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1336/2574] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:42 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:43.711926 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-7dd5c8c3-5855-4aeb-a352-620b810beae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:43.712458 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-7dd5c8c3-5855-4aeb-a352-620b810beae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:43.718909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dd5c8c3-5855-4aeb-a352-620b810beae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:43.719406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dd5c8c3-5855-4aeb-a352-620b810beae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:43.719847 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dd5c8c3-5855-4aeb-a352-620b810beae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:43.721298 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dd5c8c3-5855-4aeb-a352-620b810beae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:43.721841 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dd5c8c3-5855-4aeb-a352-620b810beae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:43.722281 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-7dd5c8c3-5855-4aeb-a352-620b810beae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:43.785999 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-7dd5c8c3-5855-4aeb-a352-620b810beae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:43.793749 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-7dd5c8c3-5855-4aeb-a352-620b810beae6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085751 Aug 08 09:17:43.794597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1239/2575] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:43 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:44.815599 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-626f9a5e-9c01-4e19-a6e3-07ff1aabda8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:44.816126 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-626f9a5e-9c01-4e19-a6e3-07ff1aabda8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:44.822489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-626f9a5e-9c01-4e19-a6e3-07ff1aabda8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:44.822960 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-626f9a5e-9c01-4e19-a6e3-07ff1aabda8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:44.823391 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-626f9a5e-9c01-4e19-a6e3-07ff1aabda8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:44.824067 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-626f9a5e-9c01-4e19-a6e3-07ff1aabda8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:44.824514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-626f9a5e-9c01-4e19-a6e3-07ff1aabda8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:44.824938 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-626f9a5e-9c01-4e19-a6e3-07ff1aabda8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:44.827429 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=84 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:17:44.886806 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-626f9a5e-9c01-4e19-a6e3-07ff1aabda8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:44.894981 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-626f9a5e-9c01-4e19-a6e3-07ff1aabda8c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083993 Aug 08 09:17:44.895524 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1337/2576] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:44 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:45.915555 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-24c65bd9-a54b-42ed-bb1d-410b094d19a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:45.916170 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-24c65bd9-a54b-42ed-bb1d-410b094d19a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:45.922483 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24c65bd9-a54b-42ed-bb1d-410b094d19a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:45.922966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24c65bd9-a54b-42ed-bb1d-410b094d19a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:45.923922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24c65bd9-a54b-42ed-bb1d-410b094d19a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:45.924591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24c65bd9-a54b-42ed-bb1d-410b094d19a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:45.925038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24c65bd9-a54b-42ed-bb1d-410b094d19a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:45.925487 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-24c65bd9-a54b-42ed-bb1d-410b094d19a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:45.985229 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-24c65bd9-a54b-42ed-bb1d-410b094d19a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:45.993169 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-24c65bd9-a54b-42ed-bb1d-410b094d19a6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081478 Aug 08 09:17:45.993728 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1240/2577] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:45 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:47.014362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-8c43f617-b2cd-45c0-941f-c37244be0e3b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:47.014995 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-8c43f617-b2cd-45c0-941f-c37244be0e3b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:47.022016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c43f617-b2cd-45c0-941f-c37244be0e3b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:47.022496 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c43f617-b2cd-45c0-941f-c37244be0e3b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:47.022927 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c43f617-b2cd-45c0-941f-c37244be0e3b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:47.023668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c43f617-b2cd-45c0-941f-c37244be0e3b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:47.024121 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c43f617-b2cd-45c0-941f-c37244be0e3b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:47.024794 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-8c43f617-b2cd-45c0-941f-c37244be0e3b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:47.087845 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-8c43f617-b2cd-45c0-941f-c37244be0e3b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:47.095271 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-8c43f617-b2cd-45c0-941f-c37244be0e3b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084738 Aug 08 09:17:47.095829 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1338/2578] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:47 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:17:48.115740 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-141a0f73-db04-4e07-bf13-5f8cb63c70ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:48.116357 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-141a0f73-db04-4e07-bf13-5f8cb63c70ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:48.122741 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-141a0f73-db04-4e07-bf13-5f8cb63c70ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:48.123227 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-141a0f73-db04-4e07-bf13-5f8cb63c70ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:48.123666 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-141a0f73-db04-4e07-bf13-5f8cb63c70ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:48.124351 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-141a0f73-db04-4e07-bf13-5f8cb63c70ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:48.124806 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-141a0f73-db04-4e07-bf13-5f8cb63c70ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:48.125266 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-141a0f73-db04-4e07-bf13-5f8cb63c70ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:48.185918 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-141a0f73-db04-4e07-bf13-5f8cb63c70ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:48.193449 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-141a0f73-db04-4e07-bf13-5f8cb63c70ce tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081540 Aug 08 09:17:48.194032 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1241/2579] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:48 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:49.214171 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-4d9fd011-9c54-4874-9f6b-a77457e1dcd7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:49.214781 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-4d9fd011-9c54-4874-9f6b-a77457e1dcd7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:49.221664 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d9fd011-9c54-4874-9f6b-a77457e1dcd7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:49.222141 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d9fd011-9c54-4874-9f6b-a77457e1dcd7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:49.222576 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d9fd011-9c54-4874-9f6b-a77457e1dcd7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:49.223255 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d9fd011-9c54-4874-9f6b-a77457e1dcd7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:49.223707 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d9fd011-9c54-4874-9f6b-a77457e1dcd7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:49.224130 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-4d9fd011-9c54-4874-9f6b-a77457e1dcd7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:49.286771 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-4d9fd011-9c54-4874-9f6b-a77457e1dcd7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:49.294260 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-4d9fd011-9c54-4874-9f6b-a77457e1dcd7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083895 Aug 08 09:17:49.294819 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1339/2580] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:49 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:17:50.315537 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-397cdb61-46c8-4ae3-a815-6d0acd8899ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:50.316074 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-397cdb61-46c8-4ae3-a815-6d0acd8899ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:50.322638 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-397cdb61-46c8-4ae3-a815-6d0acd8899ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:50.323128 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-397cdb61-46c8-4ae3-a815-6d0acd8899ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:50.323569 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-397cdb61-46c8-4ae3-a815-6d0acd8899ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:50.324260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-397cdb61-46c8-4ae3-a815-6d0acd8899ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:50.324722 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-397cdb61-46c8-4ae3-a815-6d0acd8899ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:50.325178 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-397cdb61-46c8-4ae3-a815-6d0acd8899ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:50.386382 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-397cdb61-46c8-4ae3-a815-6d0acd8899ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:50.394355 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-397cdb61-46c8-4ae3-a815-6d0acd8899ef tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082978 Aug 08 09:17:50.394917 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1242/2581] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:50 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:51.415061 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-c25b9df8-74ce-4dc8-a509-945bb27ee133 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:51.415668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-c25b9df8-74ce-4dc8-a509-945bb27ee133 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:51.422117 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25b9df8-74ce-4dc8-a509-945bb27ee133 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:51.422596 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25b9df8-74ce-4dc8-a509-945bb27ee133 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:51.423024 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25b9df8-74ce-4dc8-a509-945bb27ee133 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:51.424313 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25b9df8-74ce-4dc8-a509-945bb27ee133 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:51.424774 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25b9df8-74ce-4dc8-a509-945bb27ee133 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:51.425216 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-c25b9df8-74ce-4dc8-a509-945bb27ee133 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:51.487661 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-c25b9df8-74ce-4dc8-a509-945bb27ee133 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:51.495060 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-c25b9df8-74ce-4dc8-a509-945bb27ee133 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083914 Aug 08 09:17:51.495614 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1340/2582] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:51 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:52.515599 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-613c9448-98e8-4071-85c6-aa76ba280534 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:52.516209 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-613c9448-98e8-4071-85c6-aa76ba280534 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:52.522558 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-613c9448-98e8-4071-85c6-aa76ba280534 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:52.523038 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-613c9448-98e8-4071-85c6-aa76ba280534 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:52.523474 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-613c9448-98e8-4071-85c6-aa76ba280534 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:52.524154 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-613c9448-98e8-4071-85c6-aa76ba280534 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:52.524609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-613c9448-98e8-4071-85c6-aa76ba280534 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:52.525314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-613c9448-98e8-4071-85c6-aa76ba280534 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:52.586056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-613c9448-98e8-4071-85c6-aa76ba280534 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:52.593499 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-613c9448-98e8-4071-85c6-aa76ba280534 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081707 Aug 08 09:17:52.594056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1243/2583] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:52 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:53.613752 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-0b33e7d9-9eac-451f-be4e-ef2f76b2dd61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:53.614358 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-0b33e7d9-9eac-451f-be4e-ef2f76b2dd61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:53.616680 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=28 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:17:53.621325 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b33e7d9-9eac-451f-be4e-ef2f76b2dd61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:53.621803 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b33e7d9-9eac-451f-be4e-ef2f76b2dd61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:53.622234 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b33e7d9-9eac-451f-be4e-ef2f76b2dd61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:53.622913 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b33e7d9-9eac-451f-be4e-ef2f76b2dd61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:53.623364 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b33e7d9-9eac-451f-be4e-ef2f76b2dd61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:53.631898 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-0b33e7d9-9eac-451f-be4e-ef2f76b2dd61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:53.698332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-0b33e7d9-9eac-451f-be4e-ef2f76b2dd61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:53.707057 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-0b33e7d9-9eac-451f-be4e-ef2f76b2dd61 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.097031 Aug 08 09:17:53.707732 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1341/2584] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:53 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:54.727994 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-2e878d01-54ad-4540-8a99-ef7ea88a9cc4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:54.728528 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-2e878d01-54ad-4540-8a99-ef7ea88a9cc4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:54.730879 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=28 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:17:54.735465 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e878d01-54ad-4540-8a99-ef7ea88a9cc4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:54.785602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e878d01-54ad-4540-8a99-ef7ea88a9cc4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:54.785602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e878d01-54ad-4540-8a99-ef7ea88a9cc4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:54.785602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e878d01-54ad-4540-8a99-ef7ea88a9cc4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:54.785602 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e878d01-54ad-4540-8a99-ef7ea88a9cc4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:54.786060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-2e878d01-54ad-4540-8a99-ef7ea88a9cc4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:54.799662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-2e878d01-54ad-4540-8a99-ef7ea88a9cc4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:54.807218 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-2e878d01-54ad-4540-8a99-ef7ea88a9cc4 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083136 Aug 08 09:17:54.807771 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1244/2585] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:54 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:55.827905 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-6129f30b-3c25-42f1-bad6-111ef427b9e6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:55.828427 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-6129f30b-3c25-42f1-bad6-111ef427b9e6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:55.834904 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6129f30b-3c25-42f1-bad6-111ef427b9e6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:55.835384 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6129f30b-3c25-42f1-bad6-111ef427b9e6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:55.835824 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6129f30b-3c25-42f1-bad6-111ef427b9e6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:55.836514 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6129f30b-3c25-42f1-bad6-111ef427b9e6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:55.836976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6129f30b-3c25-42f1-bad6-111ef427b9e6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:55.837436 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-6129f30b-3c25-42f1-bad6-111ef427b9e6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:55.900097 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-6129f30b-3c25-42f1-bad6-111ef427b9e6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:55.907644 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-6129f30b-3c25-42f1-bad6-111ef427b9e6 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083669 Aug 08 09:17:55.908745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1342/2586] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:55 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:56.928372 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-9d9bf270-6e20-411f-9f65-3d94928a6297 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:56.928984 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-9d9bf270-6e20-411f-9f65-3d94928a6297 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:56.935398 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d9bf270-6e20-411f-9f65-3d94928a6297 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:56.935882 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d9bf270-6e20-411f-9f65-3d94928a6297 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:56.936321 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d9bf270-6e20-411f-9f65-3d94928a6297 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:56.937005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d9bf270-6e20-411f-9f65-3d94928a6297 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:56.937486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d9bf270-6e20-411f-9f65-3d94928a6297 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:56.937916 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-9d9bf270-6e20-411f-9f65-3d94928a6297 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:57.002260 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-9d9bf270-6e20-411f-9f65-3d94928a6297 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:57.009624 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-9d9bf270-6e20-411f-9f65-3d94928a6297 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.085545 Aug 08 09:17:57.010174 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1245/2587] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:56 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:58.030632 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-e360c5e0-949e-4736-9aac-85d3ddf0e94d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:58.031248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-e360c5e0-949e-4736-9aac-85d3ddf0e94d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:58.037875 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e360c5e0-949e-4736-9aac-85d3ddf0e94d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:58.038362 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e360c5e0-949e-4736-9aac-85d3ddf0e94d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:58.038805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e360c5e0-949e-4736-9aac-85d3ddf0e94d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:58.039494 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e360c5e0-949e-4736-9aac-85d3ddf0e94d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:58.039957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e360c5e0-949e-4736-9aac-85d3ddf0e94d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:58.040387 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-e360c5e0-949e-4736-9aac-85d3ddf0e94d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:58.100132 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-e360c5e0-949e-4736-9aac-85d3ddf0e94d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:58.107545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-e360c5e0-949e-4736-9aac-85d3ddf0e94d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.080759 Aug 08 09:17:58.108101 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1343/2588] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:58 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:17:59.127909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-e7d979b9-3983-41c2-a368-05cffcd1123b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:17:59.128526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-e7d979b9-3983-41c2-a368-05cffcd1123b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:17:59.134961 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7d979b9-3983-41c2-a368-05cffcd1123b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:59.135451 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7d979b9-3983-41c2-a368-05cffcd1123b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:59.135895 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7d979b9-3983-41c2-a368-05cffcd1123b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:59.136591 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7d979b9-3983-41c2-a368-05cffcd1123b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:17:59.137052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7d979b9-3983-41c2-a368-05cffcd1123b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:17:59.137514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-e7d979b9-3983-41c2-a368-05cffcd1123b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:17:59.198016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-e7d979b9-3983-41c2-a368-05cffcd1123b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:17:59.205794 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-e7d979b9-3983-41c2-a368-05cffcd1123b tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081829 Aug 08 09:17:59.206361 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1246/2589] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:17:59 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:18:00.226010 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-2e8c8305-ddfd-4282-b2ca-abf7f43f0117 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:18:00.226543 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-2e8c8305-ddfd-4282-b2ca-abf7f43f0117 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:18:00.232852 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e8c8305-ddfd-4282-b2ca-abf7f43f0117 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:00.233389 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e8c8305-ddfd-4282-b2ca-abf7f43f0117 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:00.233815 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e8c8305-ddfd-4282-b2ca-abf7f43f0117 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:00.234493 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e8c8305-ddfd-4282-b2ca-abf7f43f0117 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:00.234946 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e8c8305-ddfd-4282-b2ca-abf7f43f0117 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:00.235416 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-2e8c8305-ddfd-4282-b2ca-abf7f43f0117 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:00.298016 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-2e8c8305-ddfd-4282-b2ca-abf7f43f0117 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:18:00.306082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-2e8c8305-ddfd-4282-b2ca-abf7f43f0117 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.084032 Aug 08 09:18:00.306665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1344/2590] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:18:00 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:18:01.327512 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-ebf27b79-7733-44be-8839-baeeebb4b47c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:18:01.328121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-ebf27b79-7733-44be-8839-baeeebb4b47c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:18:01.335362 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf27b79-7733-44be-8839-baeeebb4b47c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:01.335845 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf27b79-7733-44be-8839-baeeebb4b47c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:01.336275 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf27b79-7733-44be-8839-baeeebb4b47c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:01.336954 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf27b79-7733-44be-8839-baeeebb4b47c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:01.337433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf27b79-7733-44be-8839-baeeebb4b47c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:01.337858 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-ebf27b79-7733-44be-8839-baeeebb4b47c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:01.399394 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-ebf27b79-7733-44be-8839-baeeebb4b47c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:18:01.407040 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-ebf27b79-7733-44be-8839-baeeebb4b47c tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.083401 Aug 08 09:18:01.407630 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1247/2591] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:18:01 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:18:02.431735 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f6e276a4-2436-45b0-a592-3e1b44f2b3a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:18:02.432350 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f6e276a4-2436-45b0-a592-3e1b44f2b3a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:18:02.438903 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6e276a4-2436-45b0-a592-3e1b44f2b3a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:02.440242 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6e276a4-2436-45b0-a592-3e1b44f2b3a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:02.440685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6e276a4-2436-45b0-a592-3e1b44f2b3a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:02.441402 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6e276a4-2436-45b0-a592-3e1b44f2b3a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:02.441886 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6e276a4-2436-45b0-a592-3e1b44f2b3a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:02.442686 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f6e276a4-2436-45b0-a592-3e1b44f2b3a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:02.501346 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f6e276a4-2436-45b0-a592-3e1b44f2b3a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:18:02.509433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f6e276a4-2436-45b0-a592-3e1b44f2b3a2 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081480 Aug 08 09:18:02.509991 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1345/2592] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:18:02 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:18:03.530353 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-5e81e017-50e5-4556-b709-2e7489ec8364 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:18:03.530959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-5e81e017-50e5-4556-b709-2e7489ec8364 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:18:03.537935 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e81e017-50e5-4556-b709-2e7489ec8364 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:03.538421 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e81e017-50e5-4556-b709-2e7489ec8364 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:03.538855 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e81e017-50e5-4556-b709-2e7489ec8364 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:03.539533 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e81e017-50e5-4556-b709-2e7489ec8364 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:03.539993 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e81e017-50e5-4556-b709-2e7489ec8364 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:03.540418 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-5e81e017-50e5-4556-b709-2e7489ec8364 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:03.600957 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-5e81e017-50e5-4556-b709-2e7489ec8364 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:18:03.608330 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-5e81e017-50e5-4556-b709-2e7489ec8364 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.081821 Aug 08 09:18:03.608892 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1248/2593] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:18:03 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:18:04.629849 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f4250408-33c5-4a1a-aa33-aa5aaf3ed067 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:18:04.630456 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f4250408-33c5-4a1a-aa33-aa5aaf3ed067 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:18:04.636773 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4250408-33c5-4a1a-aa33-aa5aaf3ed067 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:04.637285 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4250408-33c5-4a1a-aa33-aa5aaf3ed067 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:04.637717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4250408-33c5-4a1a-aa33-aa5aaf3ed067 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:04.638401 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4250408-33c5-4a1a-aa33-aa5aaf3ed067 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:04.638879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4250408-33c5-4a1a-aa33-aa5aaf3ed067 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:04.639266 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f4250408-33c5-4a1a-aa33-aa5aaf3ed067 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:04.855379 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f4250408-33c5-4a1a-aa33-aa5aaf3ed067 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:18:04.863212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f4250408-33c5-4a1a-aa33-aa5aaf3ed067 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.237816 Aug 08 09:18:04.863760 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1346/2594] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:18:04 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:18:05.883988 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-50a16022-215c-4c5a-99c3-a5b5e37104b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:18:05.884618 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-50a16022-215c-4c5a-99c3-a5b5e37104b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:18:05.891341 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50a16022-215c-4c5a-99c3-a5b5e37104b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:05.891835 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50a16022-215c-4c5a-99c3-a5b5e37104b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:05.893072 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50a16022-215c-4c5a-99c3-a5b5e37104b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:05.893805 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50a16022-215c-4c5a-99c3-a5b5e37104b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:05.894273 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50a16022-215c-4c5a-99c3-a5b5e37104b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:05.894714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-50a16022-215c-4c5a-99c3-a5b5e37104b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:06.004759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-50a16022-215c-4c5a-99c3-a5b5e37104b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:18:06.012294 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-50a16022-215c-4c5a-99c3-a5b5e37104b7 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.132542 Aug 08 09:18:06.012856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1249/2595] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:18:05 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:18:07.033656 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f94862e7-6fd4-49f8-9b1e-ec0e090ed47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:18:07.034300 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f94862e7-6fd4-49f8-9b1e-ec0e090ed47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: cae15222-d37a-43e4-bf78-a97c7c3d16c8] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:18:07.040666 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f94862e7-6fd4-49f8-9b1e-ec0e090ed47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:07.041168 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f94862e7-6fd4-49f8-9b1e-ec0e090ed47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:07.041618 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f94862e7-6fd4-49f8-9b1e-ec0e090ed47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:07.042332 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f94862e7-6fd4-49f8-9b1e-ec0e090ed47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:07.042862 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f94862e7-6fd4-49f8-9b1e-ec0e090ed47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:07.043295 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f94862e7-6fd4-49f8-9b1e-ec0e090ed47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:07.104486 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f94862e7-6fd4-49f8-9b1e-ec0e090ed47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd870619247a47ac810fea1aa636ac65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87616891fa34cd9aca388a5d101f3f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:18:07.112805 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f94862e7-6fd4-49f8-9b1e-ec0e090ed47d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8" status: 200 len: 1226 microversion: 2.1 time: 0.082348 Aug 08 09:18:07.113396 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1347/2596] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:18:07 2022] GET /compute/v2.1/servers/cae15222-d37a-43e4-bf78-a97c7c3d16c8 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:18:07.636121 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:18:07.636651 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:18:07.643047 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:07.643556 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:07.643994 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:07.644678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:07.645134 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:07.645586 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:07.648075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=84 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:18:07.659419 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.wsgi [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] HTTP exception thrown: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Request method failure captured: Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: request: DELETE /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b HTTP/1.1 Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept: application/json Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Accept-Encoding: identity Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Connection: close Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Length: 0 Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Content-Type: application/json Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Host: 10.222.0.33 Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Openstack-System-Scope: None Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: User-Agent: python-urllib3/1.26.11 Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Auth-Token: gAAAAABi8MzXjMQz1Kp56xcb_Sm5-oSaYF-Mq61EeqQE2-thU_paPGDqAIYZVnVf9V2iQL_lCA-Il33XwMOKv8GTTwR56oXScdfARptj3eVX2Z3g9UJeynBsTWKJVNZNVnITKpxrQm7yTN1cdVPTdIeMaT1rBGPBs7CTI7pOVYiB8hzhF0ujB0Q Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Id: None Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Domain-Name: None Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Identity-Status: Confirmed Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Is-Admin-Project: True Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Id: default Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Domain-Name: Default Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Id: e87616891fa34cd9aca388a5d101f3f9 Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Project-Name: tempest-TestVolumeBootPattern-650232808 Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Role: member,reader Aug 08 09:18:07.661043 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Roles: member,reader Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant: tempest-TestVolumeBootPattern-650232808 Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Id: e87616891fa34cd9aca388a5d101f3f9 Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-Tenant-Name: tempest-TestVolumeBootPattern-650232808 Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User: tempest-TestVolumeBootPattern-650232808-project Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Id: default Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Domain-Name: Default Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Id: cd870619247a47ac810fea1aa636ac65 Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: X-User-Name: tempest-TestVolumeBootPattern-650232808-project Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: method: > Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: exception: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 09:18:07.662522 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: action_args: {'id': '817d5956-5363-4c2c-be67-9c273e9cc34b'} Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 09:18:07.663518 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 09:18:07.664873 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR nova.api.openstack.wsgi Aug 08 09:18:07.668608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Returning 404 to user: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. {{(pid=124672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 09:18:07.668608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-452eb1e8-777b-42e1-911b-2c6d3feeb30d tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "DELETE /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 404 len: 111 microversion: 2.1 time: 0.030256 Aug 08 09:18:07.668608 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1250/2597] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 09:18:07 2022] DELETE /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 09:18:07.675036 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:18:07.675654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] [instance: 817d5956-5363-4c2c-be67-9c273e9cc34b] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:18:07.681531 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:07.682020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:07.682459 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:07.683144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:18:07.683603 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:18:07.684037 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:18:07.697963 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] HTTP exception thrown: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Request method failure captured: Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b HTTP/1.1 Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8MzXjMQz1Kp56xcb_Sm5-oSaYF-Mq61EeqQE2-thU_paPGDqAIYZVnVf9V2iQL_lCA-Il33XwMOKv8GTTwR56oXScdfARptj3eVX2Z3g9UJeynBsTWKJVNZNVnITKpxrQm7yTN1cdVPTdIeMaT1rBGPBs7CTI7pOVYiB8hzhF0ujB0Q Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: e87616891fa34cd9aca388a5d101f3f9 Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-TestVolumeBootPattern-650232808 Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 09:18:07.699629 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e87616891fa34cd9aca388a5d101f3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-TestVolumeBootPattern-650232808 Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: e87616891fa34cd9aca388a5d101f3f9 Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-TestVolumeBootPattern-650232808 Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-TestVolumeBootPattern-650232808-project Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: cd870619247a47ac810fea1aa636ac65 Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-TestVolumeBootPattern-650232808-project Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 09:18:07.700949 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '817d5956-5363-4c2c-be67-9c273e9cc34b'} Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 09:18:07.701871 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. Aug 08 09:18:07.703188 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:18:07.704366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Returning 404 to user: Instance 817d5956-5363-4c2c-be67-9c273e9cc34b could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 09:18:07.704366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-536ff0df-cda8-42a9-a916-d0076b474dc5 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b" status: 404 len: 111 microversion: 2.1 time: 0.030367 Aug 08 09:18:07.704366 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1348/2598] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:18:07 2022] GET /compute/v2.1/servers/817d5956-5363-4c2c-be67-9c273e9cc34b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 09:18:28.626545 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:18:28.627174 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:18:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:18:32.049165 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:18:32.049825 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:18:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:18:42.855520 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:18:42.856119 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:18:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:18:45.029016 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:18:45.029609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:18:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:19:58.806438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:19:58.807081 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:19:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:20:05.042654 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:20:05.043274 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:20:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:21:22.235618 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR oslo.messaging._drivers.impl_rabbit [-] [39c83939-a7ca-4419-8906-18d3d34dd571] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 08 09:21:22.237045 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=13 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:21:22.240976 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-207301668", "imageRef": "6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41", "flavorRef": "452", "networks": [{"uuid": "0594f4ef-2c8a-4834-894f-6a2a75461dda"}]}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 09:21:22.295759 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.network.neutron [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] validate_networks() for [('0594f4ef-2c8a-4834-894f-6a2a75461dda', None, None, None, None, None)] {{(pid=124672) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 09:21:22.697253 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Flavor limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 09:21:22.697686 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Image limits 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 09:21:22.698166 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Flavor pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 09:21:22.698588 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Image pref 0:0:0 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 09:21:22.699006 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.virt.hardware [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 09:21:22.708115 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:22.708609 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:22.709052 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:22.709813 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:22.710291 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:22.710706 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:22.727823 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Getting quotas for project b0ea80c4a39f47e1a9f3d050c46fe2bb. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 09:21:22.732779 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.quota [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Getting quotas for user d89b729776114f7ab97c7a99f5a777c2 and project b0ea80c4a39f47e1a9f3d050c46fe2bb. Resources: {'instances', 'cores', 'ram'} {{(pid=124672) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 09:21:22.743753 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Going to run 1 instances... {{(pid=124672) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 09:21:22.746019 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ba18ad8-f2a5-43f3-a9c9-90d6bf042d41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 09:21:22.885219 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-de59c154-1114-4960-b935-1271c2cbf4db tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651205 Aug 08 09:21:22.885856 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1251/2599] 10.222.0.33 () {60 vars in 1147 bytes} [Mon Aug 8 09:21:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 09:21:22.895414 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2a96b11-9f37-47d2-92cf-6f6e0744a816] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 08 09:21:22.896219 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=15 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:21:22.896953 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=67 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:21:22.900739 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-70e51fcc-71b8-4b98-afd3-4e6a1025e4b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:22.901620 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-70e51fcc-71b8-4b98-afd3-4e6a1025e4b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:22.963615 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-70e51fcc-71b8-4b98-afd3-4e6a1025e4b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:22.971248 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-70e51fcc-71b8-4b98-afd3-4e6a1025e4b8 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1218 microversion: 2.1 time: 0.077950 Aug 08 09:21:22.975262 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1349/2600] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:22 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:21:23.992905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-79bf7770-5038-4be8-8d02-c22b95dd255f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:23.993568 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-79bf7770-5038-4be8-8d02-c22b95dd255f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:24.004589 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bf7770-5038-4be8-8d02-c22b95dd255f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:24.005076 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bf7770-5038-4be8-8d02-c22b95dd255f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:24.005536 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bf7770-5038-4be8-8d02-c22b95dd255f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:24.006228 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bf7770-5038-4be8-8d02-c22b95dd255f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:24.006678 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bf7770-5038-4be8-8d02-c22b95dd255f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:24.007102 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-79bf7770-5038-4be8-8d02-c22b95dd255f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:24.010707 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] [39c83939-a7ca-4419-8906-18d3d34dd571] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 59296. Aug 08 09:21:24.070815 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-79bf7770-5038-4be8-8d02-c22b95dd255f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:24.078888 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-79bf7770-5038-4be8-8d02-c22b95dd255f tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1222 microversion: 2.1 time: 0.090830 Aug 08 09:21:24.079422 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1252/2601] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:23 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:21:25.099548 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-438dd094-5da8-41c9-a8ab-e65fc382ed50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:25.100093 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-438dd094-5da8-41c9-a8ab-e65fc382ed50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:25.107406 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-438dd094-5da8-41c9-a8ab-e65fc382ed50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:25.107896 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-438dd094-5da8-41c9-a8ab-e65fc382ed50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:25.108340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-438dd094-5da8-41c9-a8ab-e65fc382ed50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:25.109254 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-438dd094-5da8-41c9-a8ab-e65fc382ed50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:25.109821 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-438dd094-5da8-41c9-a8ab-e65fc382ed50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:25.110257 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-438dd094-5da8-41c9-a8ab-e65fc382ed50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:25.116238 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2a96b11-9f37-47d2-92cf-6f6e0744a816] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 59302. Aug 08 09:21:25.208737 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-438dd094-5da8-41c9-a8ab-e65fc382ed50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:25.216430 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-438dd094-5da8-41c9-a8ab-e65fc382ed50 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1288 microversion: 2.1 time: 0.120820 Aug 08 09:21:25.216992 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1350/2602] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:25 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1288 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:21:26.237754 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-0ded07f4-868c-4e70-96c0-07be754d8b22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:26.238369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-0ded07f4-868c-4e70-96c0-07be754d8b22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:26.245310 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ded07f4-868c-4e70-96c0-07be754d8b22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:26.245922 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ded07f4-868c-4e70-96c0-07be754d8b22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:26.246386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ded07f4-868c-4e70-96c0-07be754d8b22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:26.247111 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ded07f4-868c-4e70-96c0-07be754d8b22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:26.247594 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ded07f4-868c-4e70-96c0-07be754d8b22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:26.248056 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-0ded07f4-868c-4e70-96c0-07be754d8b22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:26.468919 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-0ded07f4-868c-4e70-96c0-07be754d8b22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:26.476369 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-0ded07f4-868c-4e70-96c0-07be754d8b22 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1318 microversion: 2.1 time: 0.242901 Aug 08 09:21:26.476925 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1253/2603] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:26 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:21:26.681976 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-b3c4c5eb-32c4-4659-bb85-d4f5185e3c7f req-fb96e43e-8027-4cb1-a21c-758e3d2b5b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e352c27-dae1-493b-a0d4-03510db9fdd5", "tag": "5bb806cf-ac5f-40c1-874b-781b0ee3385a"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 09:21:26.692301 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-b3c4c5eb-32c4-4659-bb85-d4f5185e3c7f req-fb96e43e-8027-4cb1-a21c-758e3d2b5b47 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:26.692784 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-b3c4c5eb-32c4-4659-bb85-d4f5185e3c7f req-fb96e43e-8027-4cb1-a21c-758e3d2b5b47 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:26.693287 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-b3c4c5eb-32c4-4659-bb85-d4f5185e3c7f req-fb96e43e-8027-4cb1-a21c-758e3d2b5b47 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:26.704284 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-b3c4c5eb-32c4-4659-bb85-d4f5185e3c7f req-fb96e43e-8027-4cb1-a21c-758e3d2b5b47 service nova] Creating event network-changed:5bb806cf-ac5f-40c1-874b-781b0ee3385a for instance 0e352c27-dae1-493b-a0d4-03510db9fdd5 on hv-cinder-83697 Aug 08 09:21:26.710209 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-b3c4c5eb-32c4-4659-bb85-d4f5185e3c7f req-fb96e43e-8027-4cb1-a21c-758e3d2b5b47 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093781 Aug 08 09:21:26.710836 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1351/2604] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 09:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 09:21:27.497703 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-73066a09-910e-4165-af77-6a0be88886e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:27.498314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-73066a09-910e-4165-af77-6a0be88886e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:27.505581 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73066a09-910e-4165-af77-6a0be88886e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:27.506068 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73066a09-910e-4165-af77-6a0be88886e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:27.506504 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73066a09-910e-4165-af77-6a0be88886e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:27.507189 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73066a09-910e-4165-af77-6a0be88886e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:27.507647 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73066a09-910e-4165-af77-6a0be88886e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:27.508067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-73066a09-910e-4165-af77-6a0be88886e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:27.634859 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-73066a09-910e-4165-af77-6a0be88886e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:27.642843 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-73066a09-910e-4165-af77-6a0be88886e2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1318 microversion: 2.1 time: 0.149117 Aug 08 09:21:27.643662 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1254/2605] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:27 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:21:28.710941 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fe09d16a-7acc-40d6-8743-9afb0ce41c53 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:28.711681 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fe09d16a-7acc-40d6-8743-9afb0ce41c53 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:28.718340 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe09d16a-7acc-40d6-8743-9afb0ce41c53 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:28.718990 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe09d16a-7acc-40d6-8743-9afb0ce41c53 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:28.719433 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe09d16a-7acc-40d6-8743-9afb0ce41c53 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:28.720125 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe09d16a-7acc-40d6-8743-9afb0ce41c53 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:28.720587 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe09d16a-7acc-40d6-8743-9afb0ce41c53 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:28.721020 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe09d16a-7acc-40d6-8743-9afb0ce41c53 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:28.929293 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fe09d16a-7acc-40d6-8743-9afb0ce41c53 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:28.938144 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fe09d16a-7acc-40d6-8743-9afb0ce41c53 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1318 microversion: 2.1 time: 0.277877 Aug 08 09:21:28.938879 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1352/2606] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:28 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:21:29.958070 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-45de04cf-69b3-4845-a9a8-02db0ebe24a0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:29.958683 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-45de04cf-69b3-4845-a9a8-02db0ebe24a0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:29.964977 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45de04cf-69b3-4845-a9a8-02db0ebe24a0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:29.965514 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45de04cf-69b3-4845-a9a8-02db0ebe24a0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:29.965946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45de04cf-69b3-4845-a9a8-02db0ebe24a0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:29.966627 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45de04cf-69b3-4845-a9a8-02db0ebe24a0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:29.967075 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45de04cf-69b3-4845-a9a8-02db0ebe24a0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:29.967552 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-45de04cf-69b3-4845-a9a8-02db0ebe24a0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:30.099526 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-45de04cf-69b3-4845-a9a8-02db0ebe24a0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:30.107060 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-45de04cf-69b3-4845-a9a8-02db0ebe24a0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1318 microversion: 2.1 time: 0.152857 Aug 08 09:21:30.107616 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1255/2607] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:29 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:21:31.127679 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-93544653-0505-4a9e-824c-1f0e68d63000 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:31.128292 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-93544653-0505-4a9e-824c-1f0e68d63000 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:31.134731 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-93544653-0505-4a9e-824c-1f0e68d63000 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:31.135212 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-93544653-0505-4a9e-824c-1f0e68d63000 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:31.135648 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-93544653-0505-4a9e-824c-1f0e68d63000 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:31.136337 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-93544653-0505-4a9e-824c-1f0e68d63000 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:31.136792 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-93544653-0505-4a9e-824c-1f0e68d63000 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:31.137246 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-93544653-0505-4a9e-824c-1f0e68d63000 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:31.274740 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-93544653-0505-4a9e-824c-1f0e68d63000 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:31.283114 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-93544653-0505-4a9e-824c-1f0e68d63000 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1318 microversion: 2.1 time: 0.159598 Aug 08 09:21:31.283697 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1353/2608] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:31 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:21:32.303612 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-67c6cef2-32c2-4b41-9488-96a0704d3201 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:32.304292 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-67c6cef2-32c2-4b41-9488-96a0704d3201 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:32.310966 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c6cef2-32c2-4b41-9488-96a0704d3201 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:32.311486 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c6cef2-32c2-4b41-9488-96a0704d3201 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:32.311959 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c6cef2-32c2-4b41-9488-96a0704d3201 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:32.312906 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c6cef2-32c2-4b41-9488-96a0704d3201 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:32.313399 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c6cef2-32c2-4b41-9488-96a0704d3201 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:32.313829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-67c6cef2-32c2-4b41-9488-96a0704d3201 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:32.444211 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-67c6cef2-32c2-4b41-9488-96a0704d3201 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:32.451583 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-67c6cef2-32c2-4b41-9488-96a0704d3201 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1318 microversion: 2.1 time: 0.151954 Aug 08 09:21:32.452138 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1256/2609] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:32 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:21:33.472004 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-1e2f2a0f-9467-498f-ae3f-47a9dd4801af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:33.472717 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-1e2f2a0f-9467-498f-ae3f-47a9dd4801af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:33.475274 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell0:SELECT=2 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:21:33.479972 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f2a0f-9467-498f-ae3f-47a9dd4801af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:33.480457 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f2a0f-9467-498f-ae3f-47a9dd4801af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:33.480892 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f2a0f-9467-498f-ae3f-47a9dd4801af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:33.481608 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f2a0f-9467-498f-ae3f-47a9dd4801af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:33.482064 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f2a0f-9467-498f-ae3f-47a9dd4801af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:33.482489 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-1e2f2a0f-9467-498f-ae3f-47a9dd4801af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:33.510167 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=2 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:21:33.511119 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell0:SELECT=6 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:21:33.571655 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [req-18d22ae5-c495-4ac1-9e4e-bf1ea6ed3b49 req-78fee19f-cf08-43be-951b-ccf220b94cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e352c27-dae1-493b-a0d4-03510db9fdd5", "name": "network-vif-plugged", "status": "completed", "tag": "5bb806cf-ac5f-40c1-874b-781b0ee3385a"}]} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 09:21:33.581529 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-18d22ae5-c495-4ac1-9e4e-bf1ea6ed3b49 req-78fee19f-cf08-43be-951b-ccf220b94cb1 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:33.586180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-18d22ae5-c495-4ac1-9e4e-bf1ea6ed3b49 req-78fee19f-cf08-43be-951b-ccf220b94cb1 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:33.586180 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [req-18d22ae5-c495-4ac1-9e4e-bf1ea6ed3b49 req-78fee19f-cf08-43be-951b-ccf220b94cb1 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:33.593968 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.compute.server_external_events [req-18d22ae5-c495-4ac1-9e4e-bf1ea6ed3b49 req-78fee19f-cf08-43be-951b-ccf220b94cb1 service nova] Creating event network-vif-plugged:5bb806cf-ac5f-40c1-874b-781b0ee3385a for instance 0e352c27-dae1-493b-a0d4-03510db9fdd5 on hv-cinder-83697 Aug 08 09:21:33.600309 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [req-18d22ae5-c495-4ac1-9e4e-bf1ea6ed3b49 req-78fee19f-cf08-43be-951b-ccf220b94cb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094535 Aug 08 09:21:33.601165 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1257/2610] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 09:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 09:21:33.620181 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-1e2f2a0f-9467-498f-ae3f-47a9dd4801af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:33.629635 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-1e2f2a0f-9467-498f-ae3f-47a9dd4801af tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1318 microversion: 2.1 time: 0.161473 Aug 08 09:21:33.635745 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1354/2611] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:33 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:21:34.652205 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-167a95b5-0065-4dc4-803d-223b5c17ee46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:34.652902 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-167a95b5-0065-4dc4-803d-223b5c17ee46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:34.659905 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-167a95b5-0065-4dc4-803d-223b5c17ee46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:34.660390 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-167a95b5-0065-4dc4-803d-223b5c17ee46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:34.660826 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-167a95b5-0065-4dc4-803d-223b5c17ee46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:34.661536 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-167a95b5-0065-4dc4-803d-223b5c17ee46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:34.661989 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-167a95b5-0065-4dc4-803d-223b5c17ee46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:34.662415 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-167a95b5-0065-4dc4-803d-223b5c17ee46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:34.790929 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-167a95b5-0065-4dc4-803d-223b5c17ee46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:34.799031 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-167a95b5-0065-4dc4-803d-223b5c17ee46 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1318 microversion: 2.1 time: 0.151877 Aug 08 09:21:34.799584 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1258/2612] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:34 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:21:35.819462 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-f3c69e3f-54dd-458a-baab-38e6235b0dc0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:35.819999 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-f3c69e3f-54dd-458a-baab-38e6235b0dc0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:35.826538 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c69e3f-54dd-458a-baab-38e6235b0dc0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:35.827023 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c69e3f-54dd-458a-baab-38e6235b0dc0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:35.827505 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c69e3f-54dd-458a-baab-38e6235b0dc0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:35.828192 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c69e3f-54dd-458a-baab-38e6235b0dc0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:35.828651 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c69e3f-54dd-458a-baab-38e6235b0dc0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:35.829080 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-f3c69e3f-54dd-458a-baab-38e6235b0dc0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:35.956294 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-f3c69e3f-54dd-458a-baab-38e6235b0dc0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:35.963728 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-f3c69e3f-54dd-458a-baab-38e6235b0dc0 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1507 microversion: 2.1 time: 0.148645 Aug 08 09:21:35.964283 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1355/2613] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:35 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:21:35.985084 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-4c0b80b1-de4b-46fd-a4d7-4d71db81099b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4521866-f4fd-4ab8-b472-ec5d1d83bfb4", "device": "/dev/sdb"}} {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 09:21:35.987643 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-4c0b80b1-de4b-46fd-a4d7-4d71db81099b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:35.994053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c0b80b1-de4b-46fd-a4d7-4d71db81099b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:35.994541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c0b80b1-de4b-46fd-a4d7-4d71db81099b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:35.994982 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c0b80b1-de4b-46fd-a4d7-4d71db81099b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:35.995671 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c0b80b1-de4b-46fd-a4d7-4d71db81099b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:35.996132 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c0b80b1-de4b-46fd-a4d7-4d71db81099b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:35.996565 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-4c0b80b1-de4b-46fd-a4d7-4d71db81099b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:36.742791 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-4c0b80b1-de4b-46fd-a4d7-4d71db81099b tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "POST /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.762362 Aug 08 09:21:36.743777 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1259/2614] 10.222.0.33 () {60 vars in 1323 bytes} [Mon Aug 8 09:21:35 2022] POST /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5/os-volume_attachments => generated 194 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 09:21:48.634082 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:21:48.634536 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:21:52.057779 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:21:52.058426 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:21:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:21:57.854590 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-91ea17dd-3f45-4f7b-85c8-5bd65126ce79 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:57.855166 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-91ea17dd-3f45-4f7b-85c8-5bd65126ce79 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:57.858654 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_api:SELECT=16 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:21:57.859335 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG dbcounter [-] [124673] Writing DB stats nova_cell1:SELECT=32 {{(pid=124673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:21:57.863417 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91ea17dd-3f45-4f7b-85c8-5bd65126ce79 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:57.863957 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91ea17dd-3f45-4f7b-85c8-5bd65126ce79 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:57.864438 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91ea17dd-3f45-4f7b-85c8-5bd65126ce79 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:57.865236 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91ea17dd-3f45-4f7b-85c8-5bd65126ce79 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:57.865753 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91ea17dd-3f45-4f7b-85c8-5bd65126ce79 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:57.866252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-91ea17dd-3f45-4f7b-85c8-5bd65126ce79 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:57.949252 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.objects.instance [None req-91ea17dd-3f45-4f7b-85c8-5bd65126ce79 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lazy-loading 'services' on Instance uuid 0e352c27-dae1-493b-a0d4-03510db9fdd5 {{(pid=124673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 09:21:58.166721 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-91ea17dd-3f45-4f7b-85c8-5bd65126ce79 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5/os-volume_attachments/b4521866-f4fd-4ab8-b472-ec5d1d83bfb4" status: 202 len: 0 microversion: 2.1 time: 0.316300 Aug 08 09:21:58.167298 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1356/2615] 10.222.0.33 () {58 vars in 1416 bytes} [Mon Aug 8 09:21:57 2022] DELETE /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5/os-volume_attachments/b4521866-f4fd-4ab8-b472-ec5d1d83bfb4 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 09:21:59.288163 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:21:59.288932 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:21:59.292896 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-a8008bb6-1cbd-415a-8f25-61d73996e959 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:59.301714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a8008bb6-1cbd-415a-8f25-61d73996e959 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:59.301714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a8008bb6-1cbd-415a-8f25-61d73996e959 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:59.301714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a8008bb6-1cbd-415a-8f25-61d73996e959 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:59.301714 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a8008bb6-1cbd-415a-8f25-61d73996e959 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:59.302067 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a8008bb6-1cbd-415a-8f25-61d73996e959 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:59.302150 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a8008bb6-1cbd-415a-8f25-61d73996e959 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:59.302527 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-a8008bb6-1cbd-415a-8f25-61d73996e959 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:59.330053 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-a8008bb6-1cbd-415a-8f25-61d73996e959 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Going to try to terminate instance {{(pid=124672) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 09:21:59.639903 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-a8008bb6-1cbd-415a-8f25-61d73996e959 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 204 len: 0 microversion: 2.1 time: 0.353019 Aug 08 09:21:59.640491 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1260/2616] 10.222.0.33 () {58 vars in 1239 bytes} [Mon Aug 8 09:21:59 2022] DELETE /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 09:21:59.650708 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fc3dd1da-f567-4bee-be08-f1f50a407ce4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:21:59.651498 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fc3dd1da-f567-4bee-be08-f1f50a407ce4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:21:59.659069 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc3dd1da-f567-4bee-be08-f1f50a407ce4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:59.659616 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc3dd1da-f567-4bee-be08-f1f50a407ce4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:59.660118 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc3dd1da-f567-4bee-be08-f1f50a407ce4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:59.660920 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc3dd1da-f567-4bee-be08-f1f50a407ce4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:21:59.661463 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc3dd1da-f567-4bee-be08-f1f50a407ce4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:21:59.661973 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fc3dd1da-f567-4bee-be08-f1f50a407ce4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:21:59.795723 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.policy [None req-fc3dd1da-f567-4bee-be08-f1f50a407ce4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124673) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:21:59.803783 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fc3dd1da-f567-4bee-be08-f1f50a407ce4 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1513 microversion: 2.1 time: 0.158320 Aug 08 09:21:59.804331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1357/2617] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:21:59 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:22:00.825443 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-df6d95a3-5421-4463-9883-1c305c319342 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:22:00.826065 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-df6d95a3-5421-4463-9883-1c305c319342 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:22:00.832466 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df6d95a3-5421-4463-9883-1c305c319342 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:22:00.832946 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df6d95a3-5421-4463-9883-1c305c319342 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:22:00.833406 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df6d95a3-5421-4463-9883-1c305c319342 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:22:00.834091 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df6d95a3-5421-4463-9883-1c305c319342 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:22:00.834541 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df6d95a3-5421-4463-9883-1c305c319342 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:22:00.834965 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-df6d95a3-5421-4463-9883-1c305c319342 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:22:00.965328 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-df6d95a3-5421-4463-9883-1c305c319342 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:22:00.973869 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-df6d95a3-5421-4463-9883-1c305c319342 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1513 microversion: 2.1 time: 0.152717 Aug 08 09:22:00.974438 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1261/2618] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:22:00 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 09:22:01.957356 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [req-19006017-857e-4fdd-ba41-67cc96819e82 req-f7ceca5f-0e18-44c5-b8b5-5f5bdc5658b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e352c27-dae1-493b-a0d4-03510db9fdd5", "name": "network-vif-deleted", "tag": "5bb806cf-ac5f-40c1-874b-781b0ee3385a"}]} {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 09:22:01.969062 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-19006017-857e-4fdd-ba41-67cc96819e82 req-f7ceca5f-0e18-44c5-b8b5-5f5bdc5658b7 service nova] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:22:01.970668 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-19006017-857e-4fdd-ba41-67cc96819e82 req-f7ceca5f-0e18-44c5-b8b5-5f5bdc5658b7 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:22:01.971116 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [req-19006017-857e-4fdd-ba41-67cc96819e82 req-f7ceca5f-0e18-44c5-b8b5-5f5bdc5658b7 service nova] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:22:01.984322 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.compute.server_external_events [req-19006017-857e-4fdd-ba41-67cc96819e82 req-f7ceca5f-0e18-44c5-b8b5-5f5bdc5658b7 service nova] Creating event network-vif-deleted:5bb806cf-ac5f-40c1-874b-781b0ee3385a for instance 0e352c27-dae1-493b-a0d4-03510db9fdd5 on hv-cinder-83697 Aug 08 09:22:01.991040 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [req-19006017-857e-4fdd-ba41-67cc96819e82 req-f7ceca5f-0e18-44c5-b8b5-5f5bdc5658b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038329 Aug 08 09:22:01.991628 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1358/2619] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Aug 8 09:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 09:22:01.996159 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-52331c34-19a2-465b-bbc2-72b94de60dd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:22:01.997536 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.compute.api [None req-52331c34-19a2-465b-bbc2-72b94de60dd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124672) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:22:02.004433 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52331c34-19a2-465b-bbc2-72b94de60dd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:22:02.004909 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52331c34-19a2-465b-bbc2-72b94de60dd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:22:02.005386 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52331c34-19a2-465b-bbc2-72b94de60dd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:22:02.006118 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52331c34-19a2-465b-bbc2-72b94de60dd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:22:02.006576 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52331c34-19a2-465b-bbc2-72b94de60dd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:22:02.007005 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG oslo_concurrency.lockutils [None req-52331c34-19a2-465b-bbc2-72b94de60dd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:22:02.070597 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.policy [None req-52331c34-19a2-465b-bbc2-72b94de60dd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89b729776114f7ab97c7a99f5a777c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ea80c4a39f47e1a9f3d050c46fe2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124672) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 09:22:02.078885 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-52331c34-19a2-465b-bbc2-72b94de60dd1 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 200 len: 1471 microversion: 2.1 time: 0.087660 Aug 08 09:22:02.080071 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1262/2620] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:22:01 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 1471 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 09:22:03.101039 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Calling method '>' {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:22:03.101768 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.compute.api [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] [instance: 0e352c27-dae1-493b-a0d4-03510db9fdd5] Fetching instance by UUID {{(pid=124673) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 09:22:03.107811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:22:03.118111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:22:03.118111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:22:03.118111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Acquiring lock "567bf3f4-f382-4f0b-ae3e-26600132734b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 09:22:03.118111 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 09:22:03.118508 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG oslo_concurrency.lockutils [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Lock "567bf3f4-f382-4f0b-ae3e-26600132734b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 09:22:03.124124 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.wsgi [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] HTTP exception thrown: Instance 0e352c27-dae1-493b-a0d4-03510db9fdd5 could not be found. Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Request method failure captured: Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: request: GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 HTTP/1.1 Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept: application/json Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Accept-Encoding: identity Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Connection: close Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Length: 0 Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Content-Type: application/json Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Host: 10.222.0.33 Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Openstack-System-Scope: None Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: User-Agent: python-urllib3/1.26.11 Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Auth-Token: gAAAAABi8M4MfiyksAf7GEvx8OylzmSOEOLAvLCLP3asAqHbCSx5nNngBdDt7hcJb7KEP4TioUAEgDWDQbep1fsyOCAPmOCs6JyQ38HqCC7XaWqNOc8_9HvMqK0wJMnqLjjCBP_RZ47V6Q76nZ6Oat8d36pXpulw9ueZhAbd99qOyIZCDbG5omU Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Id: None Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Domain-Name: None Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Identity-Status: Confirmed Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Is-Admin-Project: True Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Id: default Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Domain-Name: Default Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Role: member,reader Aug 08 09:22:03.125788 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Roles: member,reader Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0ea80c4a39f47e1a9f3d050c46fe2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Id: b0ea80c4a39f47e1a9f3d050c46fe2bb Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1020394230 Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Id: default Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Domain-Name: Default Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Id: d89b729776114f7ab97c7a99f5a777c2 Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: X-User-Name: tempest-VolumesSnapshotTestJSON-1020394230-project Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: method: > Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: exception: Instance 0e352c27-dae1-493b-a0d4-03510db9fdd5 could not be found. Aug 08 09:22:03.127826 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: action_args: {'id': '0e352c27-dae1-493b-a0d4-03510db9fdd5'} Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: {{(pid=124673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e352c27-dae1-493b-a0d4-03510db9fdd5 could not be found. Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 09:22:03.128811 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e352c27-dae1-493b-a0d4-03510db9fdd5 could not be found. Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e352c27-dae1-493b-a0d4-03510db9fdd5 could not be found. Aug 08 09:22:03.130235 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: ERROR nova.api.openstack.wsgi Aug 08 09:22:03.131702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: DEBUG nova.api.openstack.wsgi [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] Returning 404 to user: Instance 0e352c27-dae1-493b-a0d4-03510db9fdd5 could not be found. {{(pid=124673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 09:22:03.131702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO nova.api.openstack.requestlog [None req-fe7b1528-c503-408b-b0ee-2ffa8ce93cb2 tempest-VolumesSnapshotTestJSON-1020394230 tempest-VolumesSnapshotTestJSON-1020394230-project] 10.222.0.33 "GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5" status: 404 len: 111 microversion: 2.1 time: 0.031478 Aug 08 09:22:03.131702 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: [pid: 124673|app: 0|req: 1359/2621] 10.222.0.33 () {58 vars in 1236 bytes} [Mon Aug 8 09:22:03 2022] GET /compute/v2.1/servers/0e352c27-dae1-493b-a0d4-03510db9fdd5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 09:23:18.814846 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:23:18.815314 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:23:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:24:28.322549 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: ERROR oslo.messaging._drivers.impl_rabbit [-] [39c83939-a7ca-4419-8906-18d3d34dd571] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 08 09:24:28.323999 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:24:28.324775 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG dbcounter [-] [124672] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124672) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 09:24:28.329829 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: DEBUG nova.api.openstack.wsgi [None req-453ca78b-b174-48dc-b6b9-46091c0b0597 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] Calling method '.version_select at 0x7f4795b83a60>' {{(pid=124672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 09:24:28.414077 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO nova.api.openstack.requestlog [None req-453ca78b-b174-48dc-b6b9-46091c0b0597 tempest-TestVolumeBootPattern-650232808 tempest-TestVolumeBootPattern-650232808-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1650248059" status: 202 len: 0 microversion: 2.1 time: 0.093378 Aug 08 09:24:28.414660 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: [pid: 124672|app: 0|req: 1263/2622] 10.222.0.33 () {58 vars in 1263 bytes} [Mon Aug 8 09:24:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1650248059 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 09:25:08.642096 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:25:08.642665 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:25:12.065685 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:25:12.066331 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:25:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:26:45.054640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:26:45.054640 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:26:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:27:02.868202 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:27:02.868748 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:27:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:27:05.041817 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:27:05.042349 dv-cinder-836973-17-iscsi devstack@n-api.service[124672]: Mon Aug 8 09:27:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:28:28.650017 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:28:28.650559 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:28:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 09:28:32.073584 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 09:28:32.074318 dv-cinder-836973-17-iscsi devstack@n-api.service[124673]: Mon Aug 8 09:28:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!